00000001:02000400:2.0F:1788271499.442452:0:3280:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg103-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1788271511.066371:0:3482:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg103-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1788271512.224185:0:3542:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1247 MB/s 00000001:01000000:3.0:1788271512.473878:0:3542:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 871 MB/s 00000001:01000000:0.0:1788271512.723836:0:3542:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 6243 MB/s 00000020:02000000:0.0:1788271513.258892:0:3575:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_64_g65721f0 00000400:02000000:1.0F:1788271513.792827:0:3590:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.201.103@tcp [8/256/0/180] 00008000:02000000:2.0:1788271518.152394:0:3739:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1788271605.627327:0:5709:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg103-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788271620.338788:0:6460:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788271620.338793:0:6460:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1788271620.338795:0:6460:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788271620.338939:0:6460:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000008fde9c8b 00000080:02000400:0.0:1788271620.338949:0:6460:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1788271620.349836:0:6460:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1788271620.349851:0:6460:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788271620.349893:0:6460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000ec84a494) 00000020:00000080:0.0:1788271620.349915:0:6460:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788271620.464165:0:6460:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788271620.464256:0:6460:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:0.0:1788271620.479116:0:6460:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788271620.479349:0:6460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788271620.479356:0:6460:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788271620.479368:0:6460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x99288105fd38e20f 00000020:01000004:0.0:1788271620.479374:0:6460:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1788271620.479379:0:6460:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788271620.479385:0:6460:0:(tgt_mount.c:101:server_register_mount()) register mount 000000008fde9c8b from MGS 00000020:01000004:0.0:1788271620.479389:0:6460:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788271620.479398:0:6460:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000a7191fb1) 00000020:00000080:0.0:1788271620.479409:0:6460:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788271620.479468:0:6460:0:(tgt_mount.c:153:server_get_mount()) get mount 000000008fde9c8b from MGS, refs=2 00080000:01000000:0.0:1788271620.479473:0:6460:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788271620.479478:0:6460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x99288105fd38e21d 00000100:00100000:0.0:1788271620.479595:0:6460:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788271620.479790:0:6460:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788271620.479797:0:6460:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788271620.480587:0:6460:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788271620.480594:0:6460:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788271620.481835:0:6460:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788271620.482012:0:6460:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788271620.482017:0:6460:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788271620.482503:0:6460:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788271620.482514:0:6460:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788271620.483148:0:6460:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788271620.483156:0:6460:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788271620.484670:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271620.484675:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271620.484677:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271620.485137:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271620.485139:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271620.485140:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271620.485579:0:6460:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788271620.491923:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788271620.736839:0:6460:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4702 MB/s 00000001:01000000:0.0:1788271620.989523:0:6460:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3301 MB/s 00000001:01000000:0.0:1788271621.238799:0:6460:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 963 MB/s 00000001:01000000:2.0:1788271621.488907:0:6460:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 719 MB/s 00080000:10000000:2.0:1788271621.497136:0:6460:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:1.0:1788271621.514120:0:6460:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788271621.522144:0:6475:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788271621.523280:0:6460:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788271621.523355:0:6460:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1788271621.523739:0:6460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788271621.523774:0:6460:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788271621.524263:0:6460:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788271621.524640:0:6460:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788271621.524648:0:6460:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788271621.526856:0:6460:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788271621.526867:0:6460:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788271621.527184:0:6460:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788271621.527191:0:6460:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788271621.529716:0:6460:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788271621.529740:0:6460:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.103@tcp' 00000020:01000004:3.0:1788271621.529741:0:6460:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788271621.529796:0:6460:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.103@tcp (typ=mgc) 00000020:00000080:3.0:1788271621.529822:0:6460:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.103@tcp (00000000e8cc1415) 00000020:00000080:3.0:1788271621.529838:0:6460:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788271621.529966:0:6460:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000033b0f5d0@MGC192.168.201.103@tcp: add connection 192.168.201.103@tcp at head 00010000:00010000:3.0:1788271621.530141:0:6460:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.103@tcp-0 is initialized 00000040:01000000:3.0:1788271621.530148:0:6460:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.103@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788271621.533834:0:6479:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:3.0:1788271621.535575:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788271621.537807:0:6480:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788271621.537915:0:6460:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.103@tcp (uuid f4eab87b-0440-4f90-8c88-4ffaef16406f) 00000020:00000080:3.0:1788271621.537936:0:6460:0:(genops.c:1385:class_connect()) connect: client f4eab87b-0440-4f90-8c88-4ffaef16406f, cookie 0x99288105fd38e22b 00000100:00080000:3.0:1788271621.537947:0:6460:0:(import.c:510:import_select_connection()) MGC192.168.201.103@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788271621.537952:0:6460:0:(import.c:624:import_select_connection()) MGC192.168.201.103@tcp: import 0000000033b0f5d0 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788271621.537994:0:6460:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000be2926df x1875138590015616/t0(0) o250->MGC192.168.201.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788271621.538022:0:6460:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import f4eab87b-0440-4f90-8c88-4ffaef16406f->MGS 00000020:01000004:3.0:1788271621.538044:0:6460:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788271621.538049:0:6460:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788271621.538062:0:6460:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000003efe6ce2) 00000020:00000080:3.0:1788271621.538074:0:6460:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788271621.538750:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000be2926df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f4eab87b-0440-4f90-8c88-4ffaef16406f:3605:1875138590015616:0@lo:250: 00000100:00100000:2.0:1788271621.538835:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271621.538899:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590015616 00000100:00100000:2.0:1788271621.538906:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590015616 00000100:00100000:2.0:1788271621.538952:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788271621.538960:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006beb7471 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3605:x1875138590015616:12345-0@lo:250: 00010000:00080000:2.0:1788271621.538981:0:6477:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f4eab87b-0440-4f90-8c88-4ffaef16406f@0@lo t0 exp 0000000000000000 cur 182 last 0 00000020:00000080:2.0:1788271621.539004:0:6477:0:(genops.c:1385:class_connect()) connect: client f4eab87b-0440-4f90-8c88-4ffaef16406f, cookie 0x99288105fd38e239 00000100:00080000:2.0:1788271621.539126:0:6477:0:(import.c:65:import_set_state_nolock()) 0000000029d1a49f : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788271621.539174:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006beb7471 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+5:3605:x1875138590015616:12345-0@lo:250: Request processed in 214us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271621.539181:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788271621.539221:0:3605:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.103@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788271621.539229:0:3605:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.103@tcp: connect to target with instance 0 00000100:00080000:2.0:1788271621.539235:0:3605:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.103@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788271621.539239:0:3605:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788271621.539241:0:3605:0:(import.c:65:import_set_state_nolock()) 0000000033b0f5d0 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788271621.539244:0:3605:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788271621.539250:0:3605:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788271621.539254:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000be2926df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f4eab87b-0440-4f90-8c88-4ffaef16406f:3605:1875138590015616:0@lo:250: 00000100:00100000:0.0:1788271621.561090:0:6460:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788271621.561955:0:6460:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788271621.561963:0:6460:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788271621.564099:0:6460:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788271621.564115:0:6460:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788271621.568438:0:6460:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788271621.568457:0:6460:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788271621.569865:0:6460:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788271621.570049:0:6460:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788271621.570055:0:6460:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788271621.572094:0:6460:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788271621.572105:0:6460:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788271621.624194:0:6460:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788271621.624404:0:6460:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788271621.624411:0:6460:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788271621.626077:0:6460:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788271621.626088:0:6460:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788271621.627006:0:6460:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788271621.627190:0:6460:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788271621.627195:0:6460:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788271621.627928:0:6460:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788271621.627936:0:6460:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788271621.628816:0:6460:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788271621.628980:0:6460:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788271621.628986:0:6460:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788271621.630069:0:6460:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788271621.630078:0:6460:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788271621.630998:0:6460:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788271621.631208:0:6460:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788271621.631214:0:6460:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788271621.631872:0:6460:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788271621.631880:0:6460:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788271621.650564:0:6460:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788271621.651015:0:6460:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788271621.651022:0:6460:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788271621.653072:0:6460:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788271621.653087:0:6460:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788271621.654996:0:6460:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788271621.655010:0:6460:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788271621.656421:0:6460:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788271621.656449:0:6460:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788271621.656456:0:6460:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.103@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788271621.656583:0:6460:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.103@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788271621.658972:0:6460:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.103@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788271621.658982:0:6460:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788271621.658984:0:6460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788271621.658986:0:6460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788271621.658987:0:6460:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788271621.658988:0:6460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788271621.658990:0:6460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788271621.658991:0:6460:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788271621.658993:0:6460:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788271621.658994:0:6460:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788271621.658996:0:6460:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788271621.658997:0:6460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788271621.658998:0:6460:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788271621.659002:0:6460:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788271621.659005:0:6460:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788271621.659006:0:6460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788271621.659007:0:6460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788271621.659009:0:6460:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788271621.659009:0:6460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788271621.659011:0:6460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788271621.659012:0:6460:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788271621.659013:0:6460:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788271621.659014:0:6460:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788271621.659015:0:6460:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788271621.659016:0:6460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788271621.659017:0:6460:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788271621.659078:0:6460:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788271621.659099:0:6460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007d2ad405 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:6460:1875138590015744:0@lo:253: 00000100:00100000:2.0:1788271621.659185:0:6460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271621.659241:0:6460:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bb0132ec going to sleep for 11 seconds 00000100:00100000:1.0:1788271621.659337:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590015744 00000100:00100000:1.0:1788271621.659344:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590015744 00000100:00100000:1.0:1788271621.659412:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788271621.659422:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a20e333 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+5:6460:x1875138590015744:12345-0@lo:253: 20000000:01000000:1.0:1788271621.659473:0:6478:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788271621.659477:0:6478:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1788271621.660012:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788271621.660074:0:6478:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1788271621.660401:0:6478:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788271621.661557:0:6500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788271621.662107:0:6478:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788271621.662112:0:6478:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788271621.662118:0:6478:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788271621.662122:0:6478:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788271621.662136:0:6478:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788271621.662309:0:6478:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788271621.662459:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788271621.662472:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788271621.662490:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788271621.662506:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788271621.662521:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788271621.662574:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788271621.662582:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788271621.662595:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788271621.662600:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788271621.662612:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1788271621.663131:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1788271621.663158:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1788271621.663173:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1788271621.663203:0:6478:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788271621.663209:0:6478:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1788271621.663215:0:6478:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788271621.663370:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1788271621.663381:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788271621.663396:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1788271621.663410:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1788271621.663425:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1788271621.663433:0:6478:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1788271621.663459:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1788271621.663467:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788271621.663489:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1788271621.663505:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1788271621.663519:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1788271621.663528:0:6478:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1788271621.663554:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1788271621.663563:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1788271621.663593:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1788271621.663612:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1788271621.663931:0:6478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1788271621.663953:0:6478:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788271621.663961:0:6478:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788271621.664344:0:6501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1788271621.664566:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1788271621.664585:0:6478:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.103@tcp for mdt 20000000:01000000:0.0:1788271621.664587:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.103@tcp (null) (null) (null) 00000040:00080000:0.0:1788271621.664599:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1788271621.664604:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788271621.664615:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1788271621.664865:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.103@tcp (null) (null) 00000040:00080000:0.0:1788271621.664884:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1788271621.664891:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788271621.664903:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1788271621.664916:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1788271621.664941:0:6478:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788271621.664945:0:6478:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788271621.664948:0:6478:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788271621.665005:0:6478:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788271621.665007:0:6478:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788271621.665252:0:6502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788271621.665447:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788271621.665466:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788271621.665481:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1788271621.665490:0:6478:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788271621.665497:0:6478:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788271621.665981:0:6503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1788271621.666131:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1788271621.666153:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1788271621.666170:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:0.0:1788271621.666180:0:6478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788271621.666183:0:6478:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1788271621.666187:0:6478:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788271621.666189:0:6478:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788271621.666194:0:6478:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788271621.666200:0:6478:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788271621.666498:0:6504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1788271621.666605:0:6478:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1788271621.679544:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1788271621.679582:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1788271621.679600:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1788271621.680177:0:6478:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788271621.680201:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000093d964c/0x99288105fd38e240 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271621.680218:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000093d964c/0x99288105fd38e240 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271621.680228:0:6478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000093d964c/0x99288105fd38e240 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271621.680235:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000093d964c/0x99288105fd38e240 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271621.680241:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000093d964c/0x99288105fd38e240 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271621.680265:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000093d964c/0x99288105fd38e240 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271621.680272:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000093d964c already unused, calling callback (00000000c2bcd1c8) 00010000:00010000:1.0:1788271621.680275:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000093d964c/0x99288105fd38e240 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271621.680283:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000093d964c/0x99288105fd38e240 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271621.680295:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000093d964c/0x99288105fd38e240 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271621.680302:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000093d964c/0x99288105fd38e240 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271621.680307:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000093d964c/0x99288105fd38e240 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788271621.680390:0:6478:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788271621.690176:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a20e333 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+5:6460:x1875138590015744:12345-0@lo:253: Request processed in 30748us (30983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271621.690192:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788271621.690283:0:6460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007d2ad405 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:6460:1875138590015744:0@lo:253: 10000000:01000000:2.0:1788271621.690298:0:6460:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788271621.690301:0:6460:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788271621.690303:0:6460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788271621.690304:0:6460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788271621.690305:0:6460:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788271621.690306:0:6460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788271621.690373:0:6460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788271621.690376:0:6460:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788271621.690384:0:6460:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788271621.690386:0:6460:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788271621.690387:0:6460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788271621.690388:0:6460:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788271621.690406:0:6460:0:(tgt_mount.c:101:server_register_mount()) register mount 000000008fde9c8b from lustre-MDT0000 10000000:01000000:2.0:1788271621.690439:0:6460:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788271621.690442:0:6460:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788271621.690446:0:6460:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8f6e85beb370 10000000:01000000:2.0:1788271621.690450:0:6460:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788271621.690458:0:6460:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f6e85beb370 from 1 10000000:01000000:2.0:1788271621.690461:0:6460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788271621.690497:0:6460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: 0000000071a4e8f2/0x99288105fd38e247 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271621.690509:0:6460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: 0000000071a4e8f2/0x99288105fd38e247 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271621.690519:0:6460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: 0000000071a4e8f2/0x99288105fd38e247 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271621.690538:0:6460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007d2ad405 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:6460:1875138590015872:0@lo:101: 00000100:00100000:2.0:1788271621.690572:0:6460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271621.690789:0:6460:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b5cd1c09 going to sleep for 11 seconds 00000100:00100000:0.0:1788271621.690915:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590015872 00000100:00100000:0.0:1788271621.690922:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590015872 00000100:00100000:0.0:1788271621.690997:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788271621.691016:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f523530 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+5:6460:x1875138590015872:12345-0@lo:101: 00010000:00010000:0.0:1788271621.691028:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271621.691042:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000087a1a04e/0x99288105fd38e24e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e247 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271621.691063:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000087a1a04e/0x99288105fd38e24e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e247 expref: 6 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271621.691072:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000087a1a04e/0x99288105fd38e24e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e247 expref: 6 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271621.691081:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000087a1a04e, rc 0) 00000100:00100000:0.0:1788271621.691146:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f523530 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+6:6460:x1875138590015872:12345-0@lo:101: Request processed in 141us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271621.691153:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788271621.691225:0:6460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007d2ad405 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:6460:1875138590015872:0@lo:101: 00010000:00010000:1.0:1788271621.691237:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: 0000000071a4e8f2/0x99288105fd38e247 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e24e expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271621.691246:0:6460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: 0000000071a4e8f2/0x99288105fd38e247 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e24e expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271621.691334:0:6460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a08a57c2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:6460:1875138590016000:0@lo:501: 00000100:00100000:1.0:1788271621.691362:0:6460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271621.691549:0:6460:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a7c39ebe going to sleep for 11 seconds 00000100:00100000:2.0:1788271621.691808:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590016000 00000100:00100000:2.0:1788271621.691814:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590016000 00000100:00100000:3.0:1788271621.691992:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788271621.692011:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002942b80a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+6:6460:x1875138590016000:12345-0@lo:501: 00000100:00100000:3.0:1788271621.692111:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002942b80a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+6:6460:x1875138590016000:12345-0@lo:501: Request processed in 112us (748us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788271621.692119:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788271621.692246:0:6460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a08a57c2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:6460:1875138590016000:0@lo:501: 10000000:01000000:2.0:1788271621.692275:0:6460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788271621.692289:0:6460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: 0000000071a4e8f2/0x99288105fd38e247 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e24e expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271621.692298:0:6460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: 0000000071a4e8f2/0x99288105fd38e247 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e24e expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271621.692323:0:6460:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f6e91513000 10000000:01000000:2.0:1788271621.692328:0:6460:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788271621.692332:0:6460:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8f6e91513000 10000000:01000000:2.0:1788271621.692335:0:6460:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788271621.692338:0:6460:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8f6e91513000 from 1 10000000:01000000:2.0:1788271621.692340:0:6460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788271621.692360:0:6460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: 000000007e019378/0x99288105fd38e255 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271621.692368:0:6460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: 000000007e019378/0x99288105fd38e255 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271621.692376:0:6460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: 000000007e019378/0x99288105fd38e255 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271621.692388:0:6460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007f8a441e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:6460:1875138590016128:0@lo:101: 00000100:00100000:2.0:1788271621.692417:0:6460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271621.692590:0:6460:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c22be01f going to sleep for 11 seconds 00000100:00100000:0.0:1788271621.696098:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590016128 00000100:00100000:0.0:1788271621.696117:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590016128 00000100:00100000:0.0:1788271621.696185:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788271621.696195:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ad1b351 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+6:6460:x1875138590016128:12345-0@lo:101: 00010000:00010000:0.0:1788271621.696212:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271621.696231:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d137665b/0x99288105fd38e25c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e255 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271621.696258:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d137665b/0x99288105fd38e25c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e255 expref: 7 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271621.696268:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d137665b/0x99288105fd38e25c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e255 expref: 7 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271621.696278:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d137665b, rc 0) 00000100:00100000:0.0:1788271621.696415:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ad1b351 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+7:6460:x1875138590016128:12345-0@lo:101: Request processed in 222us (3997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271621.696422:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788271621.696559:0:6460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007f8a441e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:6460:1875138590016128:0@lo:101: 00010000:00010000:2.0:1788271621.696576:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: 000000007e019378/0x99288105fd38e255 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e25c expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271621.696585:0:6460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: 000000007e019378/0x99288105fd38e255 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e25c expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271621.696600:0:6460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788271621.696641:0:6460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: 000000007e019378/0x99288105fd38e255 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e25c expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271621.696781:0:6460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: 000000007e019378/0x99288105fd38e255 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e25c expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271621.696789:0:6460:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788271621.696794:0:6460:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788271621.696798:0:6460:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8f6e91513000 10000000:01000000:2.0:1788271621.696801:0:6460:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788271621.696804:0:6460:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788271621.696806:0:6460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788271621.696831:0:6460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: 00000000130a941c/0x99288105fd38e263 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271621.696838:0:6460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: 00000000130a941c/0x99288105fd38e263 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271621.696846:0:6460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: 00000000130a941c/0x99288105fd38e263 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271621.696863:0:6460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007f8a441e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:6460:1875138590016256:0@lo:101: 00000100:00100000:2.0:1788271621.696899:0:6460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271621.696936:0:6460:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c22be01f going to sleep for 11 seconds 00000100:00100000:0.0:1788271621.696990:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590016256 00000100:00100000:0.0:1788271621.696995:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590016256 00000100:00100000:0.0:1788271621.697089:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788271621.697097:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085bba3a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+7:6460:x1875138590016256:12345-0@lo:101: 00010000:00010000:0.0:1788271621.697105:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271621.697113:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001683dce7/0x99288105fd38e26a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e263 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271621.697128:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001683dce7/0x99288105fd38e26a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e263 expref: 8 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271621.697136:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001683dce7/0x99288105fd38e26a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e263 expref: 8 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271621.697150:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001683dce7, rc 0) 00000100:00100000:0.0:1788271621.697227:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085bba3a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+8:6460:x1875138590016256:12345-0@lo:101: Request processed in 132us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271621.697234:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788271621.697447:0:6460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007f8a441e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:6460:1875138590016256:0@lo:101: 00010000:00010000:2.0:1788271621.697458:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: 00000000130a941c/0x99288105fd38e263 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e26a expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271621.697465:0:6460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: 00000000130a941c/0x99288105fd38e263 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e26a expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271621.697548:0:6460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007f8a441e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:6460:1875138590016384:0@lo:501: 00000100:00100000:2.0:1788271621.697574:0:6460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271621.697781:0:6460:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c22be01f going to sleep for 11 seconds 00000100:00100000:1.0:1788271621.697828:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590016384 00000100:00100000:1.0:1788271621.697834:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590016384 00000100:00100000:0.0:1788271621.697902:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788271621.697910:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005161a136 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+8:6460:x1875138590016384:12345-0@lo:501: 00000100:00100000:0.0:1788271621.698102:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005161a136 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+9:6460:x1875138590016384:12345-0@lo:501: Request processed in 193us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271621.698111:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788271621.698174:0:6460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007f8a441e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:6460:1875138590016384:0@lo:501: 00000100:00100000:2.0:1788271621.698203:0:6460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007f8a441e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:6460:1875138590016512:0@lo:503: 00000100:00100000:2.0:1788271621.698243:0:6460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271621.698265:0:6460:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c22be01f going to sleep for 11 seconds 00000100:00100000:3.0:1788271621.698386:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590016512 00000100:00100000:3.0:1788271621.698391:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590016512 00000100:00100000:3.0:1788271621.698422:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788271621.698435:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5726a7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+9:6460:x1875138590016512:12345-0@lo:503: 00000100:00100000:3.0:1788271621.698528:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5726a7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+9:6460:x1875138590016512:12345-0@lo:503: Request processed in 94us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271621.698535:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788271621.698613:0:6460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007f8a441e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:6460:1875138590016512:0@lo:503: 00000100:00100000:2.0:1788271621.699258:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007f8a441e pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:6505:1875138590016640:0@lo:502: 00000100:00100000:2.0:1788271621.699296:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271621.699425:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d68dff3c going to sleep for 11 seconds 00000100:00100000:1.0:1788271621.699490:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590016640 00000100:00100000:1.0:1788271621.699496:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590016640 00000100:00100000:1.0:1788271621.699517:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788271621.699524:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000001e2c199 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+9:6505:x1875138590016640:12345-0@lo:502: 00000100:00100000:1.0:1788271621.699640:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000001e2c199 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+9:6505:x1875138590016640:12345-0@lo:502: Request processed in 117us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271621.699752:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007f8a441e pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:6505:1875138590016640:0@lo:502: 00000020:01000000:2.0:1788271621.699785:0:6505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788271621.699795:0:6505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271621.699797:0:6505:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788271621.699802:0:6505:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788271621.699806:0:6505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788271621.699827:0:6505:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000b9c3e937) 00000020:00000080:2.0:1788271621.699846:0:6505:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788271621.699852:0:6505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788271621.699935:0:6505:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788271621.699942:0:6505:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x99288105fd38e278 00000020:00000080:2.0:1788271621.700193:0:6505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788271621.700197:0:6505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788271621.700201:0:6505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271621.700207:0:6505:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788271621.700211:0:6505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788271621.700215:0:6505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271621.700216:0:6505:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788271621.700220:0:6505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788271621.700228:0:6505:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000031bd562f) 00000020:00000080:2.0:1788271621.700239:0:6505:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788271621.700243:0:6505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788271621.700245:0:6505:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788271621.700248:0:6505:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788271621.700254:0:6505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788271621.700292:0:6505:0:(tgt_mount.c:153:server_get_mount()) get mount 000000008fde9c8b from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788271621.700307:0:6505:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000f96bacb1) 00000020:00000080:2.0:1788271621.700437:0:6505:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788271621.700511:0:6505:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788271621.700526:0:6505:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x99288105fd38e28d 00000020:00000080:2.0:1788271621.700722:0:6505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788271621.700746:0:6505:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788271621.700752:0:6505:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x99288105fd38e294 00080000:01000000:2.0:1788271621.700769:0:6505:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788271621.700773:0:6505:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x99288105fd38e29b 00080000:10000000:2.0:1788271621.701266:0:6505:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000100:00100000:1.0:1788271621.701421:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 40000000:02000000:2.0:1788271621.701809:0:6505:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788271621.709226:0:6505:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788271621.771836:0:6505:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788271621.772966:0:6505:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788271621.776193:0:6505:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788271621.776878:0:6505:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788271621.780412:0:6505:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000002e3a7da6) 00000020:00000080:1.0:1788271621.780433:0:6505:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788271621.780537:0:6505:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788271621.780542:0:6505:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x99288105fd38e2a9 00000020:00000080:0.0:1788271621.781085:0:6505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1788271621.782096:0:6505:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:0.0:1788271621.785039:0:6505:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:0.0:1788271621.787285:0:6505:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:0.0:1788271621.794090:0:6505:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:0.0:1788271621.801281:0:6505:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:0.0:1788271621.803569:0:6505:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:0.0:1788271621.806175:0:6505:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x99288105fd38e2b0 00000020:00000080:0.0:1788271621.806534:0:6505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788271621.806547:0:6505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788271621.806553:0:6505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271621.806555:0:6505:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788271621.806559:0:6505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788271621.806563:0:6505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271621.806565:0:6505:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788271621.806568:0:6505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788271621.806570:0:6505:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788271621.806573:0:6505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788271621.806581:0:6505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271621.806583:0:6505:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788271621.806586:0:6505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788271621.806591:0:6505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271621.806592:0:6505:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788271621.806596:0:6505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788271621.806673:0:6505:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1788271621.806737:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000655ed46e pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:6505:1875138590016768:0@lo:502: 00000100:00100000:0.0:1788271621.806832:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271621.806890:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ead947c5 going to sleep for 11 seconds 00000100:00100000:1.0:1788271621.807036:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590016768 00000100:00100000:1.0:1788271621.807044:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590016768 00000100:00100000:1.0:1788271621.807094:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788271621.807104:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007e7ff077 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+9:6505:x1875138590016768:12345-0@lo:502: 00000100:00100000:1.0:1788271621.807229:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007e7ff077 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+9:6505:x1875138590016768:12345-0@lo:502: Request processed in 126us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271621.807239:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788271621.807521:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000655ed46e pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:6505:1875138590016768:0@lo:502: 00000020:01000000:3.0:1788271621.807554:0:6505:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788271621.807560:0:6505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271621.807561:0:6505:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1788271621.807565:0:6505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788271621.807795:0:6460:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788271621.807818:0:6460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788271621.807830:0:6460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: 00000000130a941c/0x99288105fd38e263 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e26a expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271621.807840:0:6460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: 00000000130a941c/0x99288105fd38e263 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e26a expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271621.807848:0:6460:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f6e91513000 from 1 10000000:01000000:0.0:1788271621.807850:0:6460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788271621.807877:0:6460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: 0000000021982214/0x99288105fd38e2b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271621.807884:0:6460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: 0000000021982214/0x99288105fd38e2b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271621.807893:0:6460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: 0000000021982214/0x99288105fd38e2b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271621.807904:0:6460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000046a4d600 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:6460:1875138590016896:0@lo:101: 00000100:00100000:0.0:1788271621.807942:0:6460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271621.807964:0:6460:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c1da84a2 going to sleep for 11 seconds 00000100:00100000:3.0:1788271621.808164:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590016896 00000100:00100000:3.0:1788271621.808169:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590016896 00000100:00100000:3.0:1788271621.808205:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788271621.808211:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007753d8c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+9:6460:x1875138590016896:12345-0@lo:101: 00010000:00010000:3.0:1788271621.808220:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271621.808233:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003a715506/0x99288105fd38e2be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e2b7 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271621.808252:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003a715506/0x99288105fd38e2be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e2b7 expref: 10 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271621.808261:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003a715506/0x99288105fd38e2be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e2b7 expref: 10 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271621.808269:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003a715506, rc 0) 00000100:00100000:3.0:1788271621.808322:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007753d8c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+10:6460:x1875138590016896:12345-0@lo:101: Request processed in 111us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271621.808328:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788271621.808890:0:6460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000046a4d600 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:6460:1875138590016896:0@lo:101: 00010000:00010000:0.0:1788271621.808903:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: 0000000021982214/0x99288105fd38e2b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e2be expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271621.808911:0:6460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: 0000000021982214/0x99288105fd38e2b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e2be expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271621.809551:0:6460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000046a4d600 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:6460:1875138590017024:0@lo:256: 00000100:00100000:0.0:1788271621.809596:0:6460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271621.809639:0:6460:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c1da84a2 going to sleep for 11 seconds 00000100:00100000:0.0:1788271621.809731:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590017024 00000100:00100000:0.0:1788271621.809736:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590017024 00000100:00100000:0.0:1788271621.809780:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788271621.809787:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087aa04c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+10:6460:x1875138590017024:12345-0@lo:256: 20000000:01000000:0.0:1788271621.809802:0:6477:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788271621.809806:0:6477:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788271621.809867:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087aa04c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+10:6460:x1875138590017024:12345-0@lo:256: Request processed in 82us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271621.809874:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788271621.809907:0:6460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000046a4d600 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:6460:1875138590017024:0@lo:256: 10000000:01000000:0.0:1788271621.812108:0:6460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788271621.812168:0:6460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: 0000000021982214/0x99288105fd38e2b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e2be expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271621.812181:0:6460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: 0000000021982214/0x99288105fd38e2b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e2be expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271621.812864:0:6460:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f6e91513000 from 1 10000000:01000000:0.0:1788271621.812867:0:6460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788271621.812902:0:6460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: 00000000615a00c8/0x99288105fd38e2c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271621.812909:0:6460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: 00000000615a00c8/0x99288105fd38e2c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271621.812919:0:6460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: 00000000615a00c8/0x99288105fd38e2c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271621.812940:0:6460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000046a4d600 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:6460:1875138590017152:0@lo:101: 00000100:00100000:0.0:1788271621.813012:0:6460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271621.813054:0:6460:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c1da84a2 going to sleep for 11 seconds 00000100:00100000:2.0:1788271621.813350:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590017152 00000100:00100000:2.0:1788271621.813359:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590017152 00000100:00100000:2.0:1788271621.813409:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788271621.813417:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c2cc0d9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+10:6460:x1875138590017152:12345-0@lo:101: 00010000:00010000:2.0:1788271621.813430:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271621.813447:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fa65908e/0x99288105fd38e2cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e2c5 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271621.813467:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fa65908e/0x99288105fd38e2cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e2c5 expref: 11 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271621.813489:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fa65908e/0x99288105fd38e2cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e2c5 expref: 11 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271621.813497:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fa65908e, rc 0) 00000100:00100000:2.0:1788271621.813541:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c2cc0d9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+11:6460:x1875138590017152:12345-0@lo:101: Request processed in 125us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271621.813548:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788271621.813802:0:6460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000046a4d600 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:6460:1875138590017152:0@lo:101: 00010000:00010000:0.0:1788271621.813815:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: 00000000615a00c8/0x99288105fd38e2c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e2cc expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271621.813822:0:6460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: 00000000615a00c8/0x99288105fd38e2c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e2cc expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271621.813876:0:6460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000046a4d600 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:6460:1875138590017280:0@lo:501: 00000100:00100000:0.0:1788271621.813900:0:6460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271621.813929:0:6460:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c1da84a2 going to sleep for 11 seconds 00000100:00100000:3.0:1788271621.813971:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590017280 00000100:00100000:3.0:1788271621.813975:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590017280 00000100:00100000:2.0:1788271621.814072:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788271621.814080:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ee63e61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+11:6460:x1875138590017280:12345-0@lo:501: 00000100:00100000:2.0:1788271621.814235:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ee63e61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+11:6460:x1875138590017280:12345-0@lo:501: Request processed in 156us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271621.814241:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788271621.814338:0:6460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000046a4d600 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:6460:1875138590017280:0@lo:501: 00000100:00100000:0.0:1788271621.814366:0:6460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000046a4d600 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:6460:1875138590017408:0@lo:503: 00000100:00100000:0.0:1788271621.814407:0:6460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271621.814429:0:6460:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c1da84a2 going to sleep for 11 seconds 00000100:00100000:2.0:1788271621.814516:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590017408 00000100:00100000:2.0:1788271621.814521:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590017408 00000100:00100000:2.0:1788271621.814549:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788271621.814556:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b4a836c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+11:6460:x1875138590017408:12345-0@lo:503: 00000040:00080000:2.0:1788271621.814588:0:6478:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788271621.814662:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b4a836c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+11:6460:x1875138590017408:12345-0@lo:503: Request processed in 106us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271621.814668:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788271621.814856:0:6460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000046a4d600 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:6460:1875138590017408:0@lo:503: 00000040:00080000:2.0:1788271621.816168:0:6509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1788271621.816542:0:6460:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788271621.816564:0:6460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788271621.816609:0:6460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: 00000000615a00c8/0x99288105fd38e2c5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e2cc expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271621.816865:0:6460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: 00000000615a00c8/0x99288105fd38e2c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e2cc expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271621.816919:0:6460:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788271621.816922:0:6460:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f6e91513000 10000000:01000000:0.0:1788271621.816925:0:6460:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f6e91513000 10000000:01000000:0.0:1788271621.816929:0:6460:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788271621.816934:0:6460:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f6e91513000 from 1 10000000:01000000:0.0:1788271621.816937:0:6460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788271621.816965:0:6460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: 000000009f955cfb/0x99288105fd38e2d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271621.816974:0:6460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: 000000009f955cfb/0x99288105fd38e2d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271621.816984:0:6460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: 000000009f955cfb/0x99288105fd38e2d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271621.817080:0:6460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000046a4d600 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:6460:1875138590017536:0@lo:101: 00000100:00100000:0.0:1788271621.817142:0:6460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271621.817182:0:6460:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ead947c5 going to sleep for 11 seconds 00000100:00100000:2.0:1788271621.817279:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590017536 00000100:00100000:2.0:1788271621.817286:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590017536 00000100:00100000:2.0:1788271621.817338:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788271621.817346:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000338d1650 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+11:6460:x1875138590017536:12345-0@lo:101: 00010000:00010000:2.0:1788271621.817358:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271621.817377:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000da52b1b3/0x99288105fd38e2da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e2d3 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271621.817399:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000da52b1b3/0x99288105fd38e2da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e2d3 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271621.817408:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000da52b1b3/0x99288105fd38e2da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e2d3 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271621.817416:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000da52b1b3, rc 0) 00000100:00100000:2.0:1788271621.817458:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000338d1650 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:6460:x1875138590017536:12345-0@lo:101: Request processed in 113us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271621.817466:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788271621.817781:0:6460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000046a4d600 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:6460:1875138590017536:0@lo:101: 00010000:00010000:0.0:1788271621.817794:0:6460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: 000000009f955cfb/0x99288105fd38e2d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e2da expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271621.817803:0:6460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: 000000009f955cfb/0x99288105fd38e2d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e2da expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271621.817861:0:6460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000046a4d600 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:6460:1875138590017664:0@lo:501: 00000100:00100000:0.0:1788271621.817887:0:6460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271621.817906:0:6460:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ead947c5 going to sleep for 11 seconds 00000100:00100000:2.0:1788271621.817981:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590017664 00000100:00100000:2.0:1788271621.817986:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590017664 00000100:00100000:2.0:1788271621.818090:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788271621.818097:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000008f9e415 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:6460:x1875138590017664:12345-0@lo:501: 00000100:00100000:2.0:1788271621.818207:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000008f9e415 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:6460:x1875138590017664:12345-0@lo:501: Request processed in 111us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271621.818215:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788271621.818385:0:6460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000046a4d600 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:6460:1875138590017664:0@lo:501: 00000100:00100000:0.0:1788271621.818409:0:6460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000046a4d600 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:6460:1875138590017792:0@lo:503: 00000100:00100000:0.0:1788271621.818443:0:6460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271621.818495:0:6460:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ead947c5 going to sleep for 11 seconds 00000100:00100000:3.0:1788271621.818576:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590017792 00000100:00100000:3.0:1788271621.818581:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590017792 00000100:00100000:3.0:1788271621.818609:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788271621.818614:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a35266c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:6460:x1875138590017792:12345-0@lo:503: 00000100:00100000:3.0:1788271621.819195:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a35266c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:6460:x1875138590017792:12345-0@lo:503: Request processed in 580us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271621.819202:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788271621.819261:0:6460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000046a4d600 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:6460:1875138590017792:0@lo:503: 00000100:00100000:2.0:1788271621.819831:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007f8a441e pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:6510:1875138590017920:0@lo:502: 00000100:00100000:2.0:1788271621.819869:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271621.819901:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set 00000000627004fd going to sleep for 11 seconds 00000100:00100000:3.0:1788271621.819939:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590017920 00000100:00100000:3.0:1788271621.819944:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590017920 00000100:00100000:3.0:1788271621.820078:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788271621.820087:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007dd989e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:6510:x1875138590017920:12345-0@lo:502: 00000100:00100000:3.0:1788271621.820223:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007dd989e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:6510:x1875138590017920:12345-0@lo:502: Request processed in 136us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271621.820275:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007f8a441e pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:6510:1875138590017920:0@lo:502: 00000020:01000004:0.0:1788271621.820338:0:6510:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788271621.820350:0:6510:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000007f07996a) 00000020:00000080:0.0:1788271621.820369:0:6510:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1788271621.820458:0:6510:0:(tgt_mount.c:153:server_get_mount()) get mount 000000008fde9c8b from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788271621.820462:0:6510:0:(tgt_mount.c:187:server_put_mount()) put mount 000000008fde9c8b from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788271621.820464:0:6510:0:(obd_mount.c:710:lustre_put_lsi()) put 000000008fde9c8b 4 00010000:00080000:0.0:1788271621.820497:0:6510:0:(ldlm_lib.c:102:import_set_conn()) imp 000000003f56a4f7@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.103@tcp at head 00000100:00100000:3.0:1788271621.822415:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788271621.823171:0:6510:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1788271621.823527:0:6510:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788271621.823572:0:6510:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788271621.823590:0:6510:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x99288105fd38e2e8 00000100:00080000:0.0:1788271621.823599:0:6510:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788271621.823604:0:6510:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000003f56a4f7 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:0.0:1788271621.823774:0:6510:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000046a4d600 x1875138590018048/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788271621.823803:0:6510:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788271621.825803:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000046a4d600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3605:1875138590018048:0@lo:38: 00000100:00100000:1.0:1788271621.825897:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271621.827603:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f4bbd2e6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:6510:1875138590018176:0@lo:502: 00000100:00100000:0.0:1788271621.827697:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271621.827747:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aebbfd3e going to sleep for 11 seconds 00000100:00100000:3.0:1788271621.827945:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590018176 00000100:00100000:3.0:1788271621.827953:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590018176 00000100:00100000:3.0:1788271621.828072:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788271621.828082:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b4b792e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:6510:x1875138590018176:12345-0@lo:502: 00000100:00100000:3.0:1788271621.828202:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b4b792e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:6510:x1875138590018176:12345-0@lo:502: Request processed in 122us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271621.828210:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788271621.828420:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f4bbd2e6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:6510:1875138590018176:0@lo:502: 00000040:00080000:0.0:1788271621.828449:0:6510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1788271621.828502:0:6460:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1788271621.828521:0:6460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788271621.828536:0:6460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: 000000009f955cfb/0x99288105fd38e2d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e2da expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271621.828546:0:6460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: 000000009f955cfb/0x99288105fd38e2d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e2da expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788271621.828594:0:6460:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788271621.828597:0:6460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788271621.828598:0:6460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788271621.828599:0:6460:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788271621.828600:0:6460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788271621.828602:0:6460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788271621.828603:0:6460:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788271621.828605:0:6460:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788271621.828606:0:6460:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788271621.828607:0:6460:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788271621.828609:0:6460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788271621.828610:0:6460:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788271621.828633:0:6460:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1788271621.828636:0:6460:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788271621.828637:0:6460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788271621.828707:0:6460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788271621.828708:0:6460:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788271621.828709:0:6460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788271621.828710:0:6460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788271621.828711:0:6460:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788271621.828712:0:6460:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788271621.828713:0:6460:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788271621.828714:0:6460:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788271621.828715:0:6460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788271621.828716:0:6460:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788271621.828732:0:6460:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788271621.828740:0:6460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f4bbd2e6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:6460:1875138590018304:0@lo:253: 00000100:00100000:0.0:1788271621.828784:0:6460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271621.828804:0:6460:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aebbfd3e going to sleep for 11 seconds 00000100:00100000:2.0:1788271621.828985:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590018304 00000100:00100000:2.0:1788271621.828990:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590018304 00000100:00100000:2.0:1788271621.829029:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788271621.829037:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6a43beb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:6460:x1875138590018304:12345-0@lo:253: 20000000:01000000:2.0:1788271621.829061:0:6478:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788271621.829082:0:6478:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788271621.833837:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590018048 00000100:00100000:2.0:1788271621.833850:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590018048 00000100:00100000:2.0:1788271621.833898:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788271621.833905:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085b2c0dc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3605:x1875138590018048:12345-0@lo:38: 00000100:00100000:2.0:1788271621.833989:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085b2c0dc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3605:x1875138590018048:12345-0@lo:38: Request processed in 83us (8092us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788271621.833997:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788271621.834065:0:3605:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788271621.834076:0:3605:0:(import.c:65:import_set_state_nolock()) 000000003f56a4f7 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788271621.834081:0:3605:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788271621.834084:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000046a4d600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3605:1875138590018048:0@lo:38: 20000000:01000000:3.0:1788271621.836301:0:6478:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788271621.836328:0:6478:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788271621.836559:0:6499:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788271621.836565:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788271621.836583:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000026955487/0x99288105fd38e2ef lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271621.836601:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003a715506/0x99288105fd38e2be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e2b7 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271621.836608:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000026955487/0x99288105fd38e2ef lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271621.836784:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003a715506/0x99288105fd38e2be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e2b7 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271621.836800:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003a715506/0x99288105fd38e2be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e2b7 expref: 12 pid: 6478 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271621.836813:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001e1db935 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6499:1875138590018432:0@lo:104: 00000100:00100000:2.0:1788271621.836877:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271621.836917:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set 0000000011773d60 going to sleep for 11 seconds 00000100:00100000:3.0:1788271621.837029:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590018432 00000100:00100000:3.0:1788271621.837037:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590018432 00000100:00100000:2.0:1788271621.837162:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6a43beb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:6460:x1875138590018304:12345-0@lo:253: Request processed in 8127us (8377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271621.837172:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788271621.837277:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788271621.837287:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f308dca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+3:6499:x1875138590018432:12345-0@lo:104: 00010000:00010000:3.0:1788271621.837299:0:6466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: 0000000021982214/0x99288105fd38e2b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e2be expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271621.837366:0:6466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788271621.837371:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f308dca2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+3:6499:x1875138590018432:12345-0@lo:104: Request processed in 87us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271621.837377:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788271621.837417:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271621.837422:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: 0000000021982214/0x99288105fd38e2b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e2be expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271621.837429:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000021982214 already unused, calling callback (000000008f234c73) 10000000:00010000:2.0:1788271621.837432:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: 0000000021982214/0x99288105fd38e2b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e2be expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271621.837440:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: 0000000021982214/0x99288105fd38e2b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e2be expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788271621.837445:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: 0000000021982214/0x99288105fd38e2b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e2be expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271621.837450:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788271621.837477:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: 0000000021982214/0x99288105fd38e2b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e2be expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271621.837483:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788271621.837500:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: 0000000021982214/0x99288105fd38e2b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e2be expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271621.837506:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: 0000000021982214/0x99288105fd38e2b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e2be expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271621.837521:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271621.837528:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271621.837529:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271621.837580:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788271621.837590:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007dbdee0f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590018560:0@lo:103: 00000100:00100000:2.0:1788271621.837650:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271621.837695:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001e1db935 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6499:1875138590018432:0@lo:104: 00010000:00010000:2.0:1788271621.837713:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000026955487/0x99288105fd38e2ef lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271621.838431:0:6460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f4bbd2e6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:6460:1875138590018304:0@lo:253: 10000000:01000000:0.0:1788271621.838442:0:6460:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788271621.838446:0:6460:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788271621.838448:0:6460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788271621.838449:0:6460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788271621.838450:0:6460:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788271621.838451:0:6460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788271621.838452:0:6460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788271621.838454:0:6460:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788271621.838455:0:6460:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788271621.838456:0:6460:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788271621.838457:0:6460:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788271621.838459:0:6460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788271621.838460:0:6460:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788271621.838471:0:6460:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788271621.839132:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590018560 00000100:00100000:2.0:1788271621.839139:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590018560 00010000:00010000:2.0:1788271621.839163:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003a715506/0x99288105fd38e2be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e2b7 expref: 12 pid: 6478 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271621.839203:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788271621.839211:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011a19a27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:3606:x1875138590018560:12345-0@lo:103: 00010000:00010000:2.0:1788271621.839234:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271621.839240:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003a715506/0x99288105fd38e2be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e2b7 expref: 12 pid: 6478 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271621.839251:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003a715506/0x99288105fd38e2be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e2b7 expref: 12 pid: 6478 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271621.839267:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003a715506/0x99288105fd38e2be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e2b7 expref: 12 pid: 6478 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271621.839281:0:6468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000026955487/0x99288105fd38e2ef lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271621.839288:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000026955487/0x99288105fd38e2ef lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788271621.839377:0:6468:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002812273s 00010000:00010000:2.0:1788271621.839382:0:6468:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000026955487/0x99288105fd38e2ef lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271621.839389:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000026955487/0x99288105fd38e2ef lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271621.839395:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000026955487/0x99288105fd38e2ef lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271621.839401:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000026955487/0x99288105fd38e2ef lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271621.839407:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000026955487 already unused, calling callback (00000000c2bcd1c8) 00010000:00010000:2.0:1788271621.839410:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000026955487/0x99288105fd38e2ef lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271621.839418:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000026955487/0x99288105fd38e2ef lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271621.839433:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000026955487/0x99288105fd38e2ef lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271621.839442:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271621.839489:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011a19a27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+11:3606:x1875138590018560:12345-0@lo:103: Request processed in 280us (1870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271621.839497:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788271621.839532:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007dbdee0f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590018560:0@lo:103: 00010000:00010000:2.0:1788271621.839553:0:6499:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000026955487/0x99288105fd38e2ef lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271621.839567:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000026955487/0x99288105fd38e2ef lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271621.839573:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000026955487/0x99288105fd38e2ef lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1788271621.846898:0:6460:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1788271621.847154:0:6460:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788271621.847473:0:6460:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1788271621.847967:0:6460:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788271621.848251:0:6460:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1788271621.848487:0:6460:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1788271621.851595:0:6460:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1788271621.852187:0:6460:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1788271621.852478:0:6460:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1788271621.853135:0:6460:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1788271621.853411:0:6460:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1788271621.853600:0:6460:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:2.0:1788271621.857157:0:6460:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1788271621.866039:0:6460:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1788271621.866206:0:6516:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:2.0:1788271621.867405:0:6515:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1788271621.867413:0:6515:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788271621.870475:0:6460:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788271621.870613:0:6460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788271621.871360:0:6460:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788271621.871371:0:6460:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788271621.871505:0:6460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788271621.872816:0:6460:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788271621.873970:0:6460:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788271621.874035:0:6460:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788271621.874384:0:6460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788271621.874815:0:6460:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:1.0:1788271621.875521:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1788271621.875688:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1788271621.875866:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1788271621.876001:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1788271621.876131:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1788271621.876276:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1788271621.876421:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1788271621.876605:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788271621.876779:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1788271621.876922:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1788271621.877086:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788271621.878198:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788271621.878453:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788271621.878595:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1788271621.878950:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00000040:00080000:3.0:1788271621.879132:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:1.0:1788271621.879410:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788271621.887111:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788271621.887299:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00000040:00080000:2.0:1788271621.888572:0:6516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00100000:10000000:1.0:1788271621.888980:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788271621.889120:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788271621.889259:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00000004:00080000:2.0:1788271621.889530:0:6516:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788271621.889535:0:6516:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:1.0:1788271621.889907:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788271621.890069:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788271621.890216:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788271621.890809:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788271621.890984:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788271621.891178:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788271621.891746:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788271621.891880:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788271621.892076:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788271621.892203:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788271621.892516:0:6460:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788271621.893200:0:6460:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1788271621.895901:0:6460:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788271621.895940:0:6460:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa349c1c8b988 00100000:10000000:1.0:1788271621.895948:0:6460:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788271621.896906:0:6460:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788271621.896921:0:6460:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.103@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788271621.896937:0:6460:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1788271621.896966:0:6460:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788271621.897869:0:6460:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788271621.898049:0:6460:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1788271622.570235:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271623.583045:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271624.607988:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271625.630116:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788271626.179147:0:6760:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg103-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788271626.653924:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788271627.011266:0:6812:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788271627.011526:0:6812:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:1.0:1788271627.294205:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788271627.294212:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788271627.294215:0:8:0:(import.c:65:import_set_state_nolock()) 000000003f56a4f7 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788271627.294228:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000003f56a4f7 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788271627.294247:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000bb3b8f42 x1875138590018816/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788271627.294474:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c81b532b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590018688:0@lo:400: 00000100:00100000:1.0:1788271627.294544:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271627.300464:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bb3b8f42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3605:1875138590018816:0@lo:38: 00000100:00100000:1.0:1788271627.300549:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271627.300690:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590018816 00000100:00100000:3.0:1788271627.300706:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590018816 00000100:00100000:3.0:1788271627.300771:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788271627.300781:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000fec7272 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3605:x1875138590018816:12345-0@lo:38: 00010000:00080000:3.0:1788271627.300822:0:6485:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 188 last 0 00000020:00000080:3.0:1788271627.300883:0:6485:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x99288105fd38e2f6 00000004:00100000:3.0:1788271627.300957:0:6485:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788271627.301101:0:6485:0:(import.c:65:import_set_state_nolock()) 000000005685ec21 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788271627.301206:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000fec7272 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1875138590018816:12345-0@lo:38: Request processed in 425us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271627.301215:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788271627.301264:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000bb3b8f42 x1875138590018816/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788271637 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788271627.301285:0:3605:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788271627.301292:0:3605:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788271627.301297:0:3605:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788271627.301301:0:3605:0:(import.c:65:import_set_state_nolock()) 000000003f56a4f7 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788271627.301307:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bb3b8f42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3605:1875138590018816:0@lo:38: 00000100:00100000:2.0:1788271627.301562:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590018688 00000100:00100000:2.0:1788271627.301580:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590018688 00000100:00100000:2.0:1788271627.301675:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788271627.301684:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c45f802 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+11:3608:x1875138590018688:12345-0@lo:400: 00000100:00100000:2.0:1788271627.301749:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c45f802 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+11:3608:x1875138590018688:12345-0@lo:400: Request processed in 67us (7206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271627.301756:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788271627.301796:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c81b532b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590018688:0@lo:400: 00010000:00010000:3.0:1788271627.678860:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788271627.805767:0:6480:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788271627.805777:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f6e91513000 from 3 10000000:01000000:0.0:1788271627.805782:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788271627.805829:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: 0000000097d8520e/0x99288105fd38e2fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271627.805863:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: 0000000097d8520e/0x99288105fd38e2fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271627.805874:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: 0000000097d8520e/0x99288105fd38e2fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271627.805898:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f4bbd2e6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590018944:0@lo:101: 00000100:00100000:0.0:1788271627.805972:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271627.806050:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set 00000000023a0f13 going to sleep for 11 seconds 00000100:00100000:2.0:1788271627.806669:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590018944 00000100:00100000:2.0:1788271627.806678:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590018944 00000100:00100000:2.0:1788271627.807080:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788271627.807091:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000f528547 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+11:6480:x1875138590018944:12345-0@lo:101: 00010000:00010000:2.0:1788271627.807113:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271627.807131:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b5b8ac9b/0x99288105fd38e304 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e2fd expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271627.807155:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b5b8ac9b/0x99288105fd38e304 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e2fd expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271627.807165:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b5b8ac9b/0x99288105fd38e304 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e2fd expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271627.807173:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b5b8ac9b, rc 0) 00000100:00100000:2.0:1788271627.807228:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000f528547 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:6480:x1875138590018944:12345-0@lo:101: Request processed in 140us (1257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271627.807235:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788271627.807301:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f4bbd2e6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590018944:0@lo:101: 00010000:00010000:0.0:1788271627.807314:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: 0000000097d8520e/0x99288105fd38e2fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e304 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271627.807322:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: 0000000097d8520e/0x99288105fd38e2fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e304 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271627.807370:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f4bbd2e6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590019072:0@lo:256: 00000100:00100000:0.0:1788271627.807400:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271627.807816:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set 00000000023a0f13 going to sleep for 11 seconds 00000100:00100000:3.0:1788271627.807899:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590019072 00000100:00100000:3.0:1788271627.807905:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590019072 00000100:00100000:3.0:1788271627.807935:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788271627.807948:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a1a2e0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:6480:x1875138590019072:12345-0@lo:256: 20000000:01000000:3.0:1788271627.807965:0:6477:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788271627.807981:0:6477:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788271627.807984:0:6477:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788271627.808335:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a1a2e0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:6480:x1875138590019072:12345-0@lo:256: Request processed in 387us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271627.808344:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788271627.808422:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f4bbd2e6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590019072:0@lo:256: 10000000:01000000:0.0:1788271627.808462:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788271627.808469:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: 0000000097d8520e/0x99288105fd38e2fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e304 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271627.808477:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: 0000000097d8520e/0x99288105fd38e2fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e304 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271628.703925:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271629.731918:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788271629.902478:0:6914:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788271629.905385:0:6914:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788271630.755418:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271631.773929:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271632.414845:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788271632.414877:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000004c95c90 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875138590019328:0@lo:400: 00000100:00100000:1.0:1788271632.414967:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271632.415125:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bb3b8f42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590019200:0@lo:400: 00000100:00100000:0.0:1788271632.415168:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271632.415250:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590019200 00000100:00100000:2.0:1788271632.415260:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590019200 00000100:00100000:2.0:1788271632.415336:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788271632.415347:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000edaf1d63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:3609:x1875138590019200:12345-0@lo:400: 00000100:00100000:2.0:1788271632.415427:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000edaf1d63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:3609:x1875138590019200:12345-0@lo:400: Request processed in 81us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271632.415435:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788271632.415486:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bb3b8f42 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590019200:0@lo:400: 00000100:00100000:3.0:1788271632.417721:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590019328 00000100:00100000:3.0:1788271632.417742:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590019328 00000100:00100000:3.0:1788271632.417818:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788271632.417828:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002753969 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875138590019328:12345-0@lo:400: 00000100:00100000:3.0:1788271632.417947:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002753969 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875138590019328:12345-0@lo:400: Request processed in 120us (2980us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271632.417955:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788271632.418531:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000004c95c90 x1875138590019328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271648 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271632.418549:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000004c95c90 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875138590019328:0@lo:400: 00010000:00010000:1.0:1788271632.803445:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271633.822160:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271634.852612:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271635.870174:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271636.906221:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271637.536125:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007db0edf8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875138590019584:0@lo:400: 00000100:00100000:3.0:1788271637.536210:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271637.536286:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590019584 00000100:00100000:3.0:1788271637.536294:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590019584 00000100:00100000:3.0:1788271637.536341:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788271637.536350:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f8063753 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875138590019584:12345-0@lo:400: 00000100:00100000:3.0:1788271637.536403:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f8063753 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875138590019584:12345-0@lo:400: Request processed in 54us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271637.536410:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788271637.536469:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007db0edf8 x1875138590019584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271653 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271637.536498:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007db0edf8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875138590019584:0@lo:400: 00000100:00100000:1.0:1788271637.536564:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008b88b5f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590019456:0@lo:400: 00000100:00100000:1.0:1788271637.536606:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271637.536715:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590019456 00000100:00100000:3.0:1788271637.536719:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590019456 00000100:00100000:3.0:1788271637.536758:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788271637.536764:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef70726b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:3607:x1875138590019456:12345-0@lo:400: 00000100:00100000:3.0:1788271637.536804:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef70726b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:3607:x1875138590019456:12345-0@lo:400: Request processed in 40us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271637.536821:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788271637.536858:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008b88b5f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590019456:0@lo:400: 00010000:00010000:0.0:1788271637.928698:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271638.942663:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788271639.561931:0:7412:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788271639.561935:0:7412:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788271639.561937:0:7412:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788271639.562075:0:7412:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000009b983222 00000020:01000004:2.0:1788271639.562165:0:7412:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1788271639.562177:0:7412:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788271639.562190:0:7412:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (0000000015d1de62) 00000020:00000080:2.0:1788271639.562204:0:7412:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788271639.606351:0:7412:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:0.0:1788271639.606427:0:7412:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:1.0:1788271639.625794:0:7412:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788271639.626015:0:7412:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1788271639.626035:0:7412:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788271639.626049:0:7412:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x99288105fd38e312 00000020:01000004:1.0:1788271639.626055:0:7412:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788271639.626078:0:7412:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.103@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788271639.626208:0:7412:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788271639.626215:0:7412:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1788271639.626259:0:7412:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1788271639.626264:0:7412:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.103@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1788271639.651990:0:7412:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.103@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788271639.652042:0:7412:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.201.103@tcp, index=0001, flags=0x20061 00000020:01000004:0.0:1788271639.652047:0:7412:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788271639.652049:0:7412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788271639.652051:0:7412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788271639.652052:0:7412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788271639.652053:0:7412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788271639.652055:0:7412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788271639.652056:0:7412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788271639.652058:0:7412:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788271639.652059:0:7412:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788271639.652060:0:7412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788271639.652062:0:7412:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788271639.652066:0:7412:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:0.0:1788271639.652069:0:7412:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788271639.652070:0:7412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788271639.652071:0:7412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788271639.652072:0:7412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788271639.652073:0:7412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788271639.652074:0:7412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788271639.652075:0:7412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788271639.652076:0:7412:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788271639.652077:0:7412:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788271639.652077:0:7412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788271639.652078:0:7412:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788271639.652227:0:7412:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788271639.652244:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f4bbd2e6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590019712:0@lo:253: 00000100:00100000:0.0:1788271639.652395:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271639.652527:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 000000000b59c3a4 going to sleep for 11 seconds 00000100:00100000:1.0:1788271639.652572:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590019712 00000100:00100000:1.0:1788271639.652580:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590019712 00000100:00100000:1.0:1788271639.652803:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788271639.652813:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dcc09365 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:7412:x1875138590019712:12345-0@lo:253: 20000000:01000000:1.0:1788271639.652845:0:6478:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788271639.652849:0:6478:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:1.0:1788271639.652855:0:6478:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:1.0:1788271639.652859:0:6478:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:1.0:1788271639.652894:0:6478:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:1.0:1788271639.653154:0:6478:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788271639.653301:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1788271639.653315:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788271639.653332:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1788271639.653349:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1788271639.653362:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1788271639.653420:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:1.0:1788271639.653429:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:1.0:1788271639.653468:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:1.0:1788271639.653477:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:1.0:1788271639.653490:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:1.0:1788271639.653496:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:1.0:1788271639.653508:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1788271639.653523:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1788271639.653983:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:1.0:1788271639.653997:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.103@tcp (null) (null) (null) 00000040:00080000:1.0:1788271639.654014:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:1.0:1788271639.654133:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788271639.654150:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:1.0:1788271639.654156:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.201.103@tcp (null) (null) 00000040:00080000:1.0:1788271639.654168:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:1.0:1788271639.654174:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788271639.654186:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1788271639.654200:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1788271639.654211:0:6478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1788271639.654509:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:1.0:1788271639.654520:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:1.0:1788271639.654532:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1788271639.654548:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1788271639.654565:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:1.0:1788271639.654571:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:1.0:1788271639.654598:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1788271639.654761:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1788271639.654770:0:6478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:1.0:1788271639.654794:0:6478:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1788271639.654801:0:6478:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:1.0:1788271639.655514:0:7418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1788271639.655707:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788271639.655728:0:6478:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.103@tcp for mdt 20000000:01000000:2.0:1788271639.655730:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.103@tcp (null) (null) (null) 00000040:00080000:2.0:1788271639.655746:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788271639.655754:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788271639.655768:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788271639.655775:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.201.103@tcp (null) (null) 00000040:00080000:2.0:1788271639.655791:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788271639.655799:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:2.0:1788271639.655813:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:2.0:1788271639.655827:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:2.0:1788271639.655876:0:6478:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:2.0:1788271639.655883:0:6478:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:0.0:1788271639.656208:0:7419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:2.0:1788271639.656529:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1788271639.656543:0:6478:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.201.103@tcp for mdt 20000000:01000000:2.0:1788271639.656546:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.103@tcp (null) (null) (null) 00000040:00080000:2.0:1788271639.656563:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1788271639.656568:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788271639.656575:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1788271639.656578:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.201.103@tcp (null) (null) 00000040:00080000:2.0:1788271639.656584:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1788271639.656588:0:6478:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:2.0:1788271639.656594:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1788271639.656601:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:2.0:1788271639.656613:0:6478:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788271639.656615:0:6478:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788271639.656666:0:6478:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788271639.656712:0:6478:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788271639.656713:0:6478:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788271639.657096:0:7420:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1788271639.657117:0:7420:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1788271639.657131:0:7420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:2.0:1788271639.657287:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1788271639.657319:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1788271639.657338:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:2.0:1788271639.657348:0:6478:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788271639.657350:0:6478:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788271639.657721:0:7421:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788271639.657739:0:7421:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788271639.657752:0:7421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1788271639.657870:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:1.0:1788271639.657902:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:1.0:1788271639.657918:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:1.0:1788271639.657933:0:6478:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788271639.657935:0:6478:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788271639.658220:0:7422:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1788271639.658237:0:7422:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1788271639.658245:0:7422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1788271639.658361:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1788271639.658372:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1788271639.658385:0:6478:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1788271639.658406:0:6478:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788271639.658409:0:6478:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788271639.658414:0:6478:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788271639.658419:0:6478:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788271639.658662:0:7423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:2.0:1788271639.658766:0:6478:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788271639.666109:0:6478:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788271639.666153:0:6478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000026955487/0x99288105fd38e319 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271639.666196:0:6478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000087a1a04e/0x99288105fd38e24e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e247 expref: 12 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271639.666204:0:6478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001683dce7/0x99288105fd38e26a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e263 expref: 12 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271639.666209:0:6478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000da52b1b3/0x99288105fd38e2da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e2d3 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271639.666215:0:6478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000026955487/0x99288105fd38e319 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271639.666263:0:6478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000da52b1b3/0x99288105fd38e2da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e2d3 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271639.666290:0:6478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000da52b1b3/0x99288105fd38e2da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e2d3 expref: 12 pid: 6478 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271639.666303:0:6478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007dbdee0f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6478:1875138590019840:0@lo:104: 00000100:00100000:2.0:1788271639.666362:0:6478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788271639.666420:0:6478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001683dce7/0x99288105fd38e26a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e263 expref: 12 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271639.666428:0:6478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001683dce7/0x99288105fd38e26a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e263 expref: 12 pid: 6476 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271639.666436:0:6478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7b5641f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6478:1875138590019968:0@lo:104: 00000100:00100000:2.0:1788271639.666485:0:6478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788271639.666512:0:6478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000087a1a04e/0x99288105fd38e24e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e247 expref: 12 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271639.666524:0:6478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000087a1a04e/0x99288105fd38e24e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e247 expref: 12 pid: 6476 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271639.666532:0:6478:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8551b1f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6478:1875138590020096:0@lo:104: 00000100:00100000:2.0:1788271639.666550:0:6478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271639.666559:0:6478:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fb9ac33e going to sleep for 11 seconds 00000100:00100000:1.0:1788271639.666666:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590019840 00000100:00100000:1.0:1788271639.666674:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590019840 00000100:00100000:1.0:1788271639.666714:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590019968 00000100:00100000:1.0:1788271639.666717:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590019968 00000100:00100000:1.0:1788271639.666726:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590020096 00000100:00100000:1.0:1788271639.666728:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590020096 00000100:00100000:1.0:1788271639.666740:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788271639.666747:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e1db935 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+5:6478:x1875138590019840:12345-0@lo:104: 00010000:00010000:1.0:1788271639.666759:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: 000000009f955cfb/0x99288105fd38e2d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e2da expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271639.666817:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788271639.666822:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e1db935 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+5:6478:x1875138590019840:12345-0@lo:104: Request processed in 76us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271639.666829:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788271639.666845:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788271639.666847:0:6478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007dbdee0f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6478:1875138590019840:0@lo:104: 00000100:00100000:1.0:1788271639.666850:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a793d195 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+4:6478:x1875138590019968:12345-0@lo:104: 00010000:00010000:1.0:1788271639.666856:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: 00000000130a941c/0x99288105fd38e263 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e26a expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271639.666896:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788271639.666900:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a793d195 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+4:6478:x1875138590019968:12345-0@lo:104: Request processed in 51us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271639.666912:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788271639.666923:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788271639.666927:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e188af18 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+3:6478:x1875138590020096:12345-0@lo:104: 00010000:00010000:1.0:1788271639.666933:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: 0000000071a4e8f2/0x99288105fd38e247 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e24e expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271639.666957:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788271639.666960:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e188af18 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+3:6478:x1875138590020096:12345-0@lo:104: Request processed in 33us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271639.666964:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788271639.667104:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788271639.667109:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: 000000009f955cfb/0x99288105fd38e2d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e2da expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271639.667117:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009f955cfb already unused, calling callback (000000008f234c73) 10000000:00010000:2.0:1788271639.667120:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: 000000009f955cfb/0x99288105fd38e2d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e2da expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271639.667128:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: 000000009f955cfb/0x99288105fd38e2d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e2da expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788271639.667134:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: 000000009f955cfb/0x99288105fd38e2d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e2da expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271639.667140:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788271639.667174:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: 000000009f955cfb/0x99288105fd38e2d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e2da expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271639.667181:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788271639.667208:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: 000000009f955cfb/0x99288105fd38e2d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e2da expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271639.667223:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: 000000009f955cfb/0x99288105fd38e2d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e2da expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271639.667223:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788271639.667234:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f9a6ba25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590020224:0@lo:103: 00010000:00010000:2.0:1788271639.667237:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788271639.667239:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: 00000000130a941c/0x99288105fd38e263 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e26a expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271639.667244:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000130a941c already unused, calling callback (000000008f234c73) 10000000:00010000:2.0:1788271639.667246:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: 00000000130a941c/0x99288105fd38e263 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e26a expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271639.667252:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: 00000000130a941c/0x99288105fd38e263 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e26a expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788271639.667257:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: 00000000130a941c/0x99288105fd38e263 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e26a expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271639.667262:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788271639.667262:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788271639.667370:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: 00000000130a941c/0x99288105fd38e263 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e26a expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271639.667376:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788271639.667393:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: 00000000130a941c/0x99288105fd38e263 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e26a expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271639.667407:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: 00000000130a941c/0x99288105fd38e263 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e26a expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271639.667416:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271639.667424:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: 0000000071a4e8f2/0x99288105fd38e247 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e24e expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271639.667429:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000071a4e8f2 already unused, calling callback (000000008f234c73) 10000000:00010000:2.0:1788271639.667431:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: 0000000071a4e8f2/0x99288105fd38e247 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e24e expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271639.667436:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: 0000000071a4e8f2/0x99288105fd38e247 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e24e expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788271639.667450:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: 0000000071a4e8f2/0x99288105fd38e247 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e24e expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271639.667455:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788271639.667467:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: 0000000071a4e8f2/0x99288105fd38e247 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e24e expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271639.667473:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788271639.667477:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: 0000000071a4e8f2/0x99288105fd38e247 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e24e expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271639.667481:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: 0000000071a4e8f2/0x99288105fd38e247 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e24e expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271639.667493:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271639.667494:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271639.667496:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271639.667527:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009a27e267 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590020352:0@lo:103: 00000100:00100000:3.0:1788271639.667559:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c3d2bdca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590020480:0@lo:103: 00010000:00010000:0.0:1788271639.667889:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271639.669923:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271639.669966:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590020224 00000100:00100000:2.0:1788271639.669975:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590020224 00010000:00010000:2.0:1788271639.670011:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000da52b1b3/0x99288105fd38e2da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e2d3 expref: 13 pid: 6478 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271639.670107:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788271639.670117:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004c95c90 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+13:3608:x1875138590020224:12345-0@lo:103: 00010000:00010000:2.0:1788271639.670129:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271639.670134:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000da52b1b3/0x99288105fd38e2da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e2d3 expref: 13 pid: 6478 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271639.670145:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000da52b1b3/0x99288105fd38e2da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e2d3 expref: 13 pid: 6478 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271639.670160:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000da52b1b3/0x99288105fd38e2da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e2d3 expref: 13 pid: 6478 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271639.670173:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271639.670235:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004c95c90 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:3608:x1875138590020224:12345-0@lo:103: Request processed in 121us (2972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271639.670242:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788271639.670315:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f9a6ba25 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590020224:0@lo:103: 00000100:00100000:3.0:1788271639.670574:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271639.670603:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590020480 00000100:00100000:1.0:1788271639.670608:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590020480 00010000:00010000:1.0:1788271639.670646:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000087a1a04e/0x99288105fd38e24e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e247 expref: 12 pid: 6476 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271639.670705:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788271639.670713:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008b88b5f0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:3607:x1875138590020480:12345-0@lo:103: 00010000:00010000:0.0:1788271639.670723:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271639.670727:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000087a1a04e/0x99288105fd38e24e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e247 expref: 12 pid: 6476 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.670735:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000087a1a04e/0x99288105fd38e24e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e247 expref: 12 pid: 6476 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.670744:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271639.670775:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008b88b5f0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:3607:x1875138590020480:12345-0@lo:103: Request processed in 64us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271639.670780:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788271639.672427:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c3d2bdca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590020480:0@lo:103: 00000100:00100000:3.0:1788271639.672480:0:6478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7b5641f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6478:1875138590019968:0@lo:104: 00010000:00010000:3.0:1788271639.672491:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000087a1a04e/0x99288105fd38e24e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e247 expref: 11 pid: 6476 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271639.672509:0:6478:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8551b1f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6478:1875138590020096:0@lo:104: 00010000:00010000:3.0:1788271639.672526:0:6478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000026955487/0x99288105fd38e319 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271639.672861:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590020352 00000100:00100000:0.0:1788271639.672870:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590020352 00010000:00010000:0.0:1788271639.672902:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001683dce7/0x99288105fd38e26a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e263 expref: 11 pid: 6476 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271639.672929:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788271639.672937:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007db0edf8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4eab87b-0440-4f90-8c88-4ffaef16406f+11:3606:x1875138590020352:12345-0@lo:103: 00010000:00010000:0.0:1788271639.672963:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271639.672969:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001683dce7/0x99288105fd38e26a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e263 expref: 11 pid: 6476 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.672979:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001683dce7/0x99288105fd38e26a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e263 expref: 11 pid: 6476 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.672995:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001683dce7/0x99288105fd38e26a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e263 expref: 11 pid: 6476 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.673005:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000026955487/0x99288105fd38e319 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.673012:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000026955487/0x99288105fd38e319 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.673024:0:6470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000026955487/0x99288105fd38e319 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.673030:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000026955487/0x99288105fd38e319 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.673036:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000026955487/0x99288105fd38e319 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.673041:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000026955487/0x99288105fd38e319 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.673046:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000026955487 already unused, calling callback (00000000c2bcd1c8) 00010000:00010000:0.0:1788271639.673049:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000026955487/0x99288105fd38e319 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.673066:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000026955487/0x99288105fd38e319 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.673078:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000026955487/0x99288105fd38e319 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.673088:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271639.673146:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007db0edf8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4eab87b-0440-4f90-8c88-4ffaef16406f+10:3606:x1875138590020352:12345-0@lo:103: Request processed in 210us (2573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271639.673153:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788271639.673178:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009a27e267 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590020352:0@lo:103: 00010000:00010000:3.0:1788271639.673233:0:6478:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000026955487/0x99288105fd38e319 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271639.673246:0:6478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000026955487/0x99288105fd38e319 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271639.673251:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000026955487/0x99288105fd38e319 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788271639.673267:0:6478:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788271639.675153:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dcc09365 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+9:7412:x1875138590019712:12345-0@lo:253: Request processed in 22334us (22751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271639.675167:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788271639.675259:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f4bbd2e6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590019712:0@lo:253: 10000000:01000000:0.0:1788271639.675350:0:7412:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788271639.675354:0:7412:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788271639.675356:0:7412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788271639.675358:0:7412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788271639.675359:0:7412:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1788271639.675360:0:7412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788271639.675361:0:7412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788271639.675362:0:7412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788271639.675364:0:7412:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788271639.675366:0:7412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788271639.675367:0:7412:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788271639.675390:0:7412:0:(tgt_mount.c:101:server_register_mount()) register mount 000000009b983222 from lustre-MDT0001 10000000:01000000:0.0:1788271639.675422:0:7412:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788271639.675425:0:7412:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788271639.675432:0:7412:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f6e85beb370 local copy 10000000:01000000:0.0:1788271639.675435:0:7412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788271639.675478:0:7412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: 0000000075320275/0x99288105fd38e320 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.675501:0:7412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.103@tcp lock: 0000000075320275/0x99288105fd38e320 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.675509:0:7412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: 0000000075320275/0x99288105fd38e320 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271639.675527:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f4bbd2e6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590020608:0@lo:101: 00000100:00100000:0.0:1788271639.675562:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271639.675603:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bdd6a2bb going to sleep for 11 seconds 00000100:00100000:3.0:1788271639.675685:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590020608 00000100:00100000:3.0:1788271639.675757:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590020608 00000100:00100000:3.0:1788271639.675807:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788271639.675814:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3323273 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+9:7412:x1875138590020608:12345-0@lo:101: 00010000:00010000:3.0:1788271639.675827:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271639.675839:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000051091a6a/0x99288105fd38e327 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e320 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271639.675859:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000051091a6a/0x99288105fd38e327 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e320 expref: 10 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271639.675869:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000051091a6a/0x99288105fd38e327 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e320 expref: 10 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271639.675876:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000051091a6a, rc 0) 00000100:00100000:3.0:1788271639.675906:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3323273 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+10:7412:x1875138590020608:12345-0@lo:101: Request processed in 93us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271639.675912:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788271639.676044:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f4bbd2e6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590020608:0@lo:101: 00010000:00010000:0.0:1788271639.676056:0:7412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: 0000000075320275/0x99288105fd38e320 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x99288105fd38e327 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.676065:0:7412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: 0000000075320275/0x99288105fd38e320 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x99288105fd38e327 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271639.676149:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f4bbd2e6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590020736:0@lo:501: 00000100:00100000:0.0:1788271639.676173:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271639.676197:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bdd6a2bb going to sleep for 11 seconds 00000100:00100000:3.0:1788271639.676351:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590020736 00000100:00100000:3.0:1788271639.676355:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590020736 00000100:00100000:3.0:1788271639.676387:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788271639.676394:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000095a2e90b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+10:7412:x1875138590020736:12345-0@lo:501: 00000100:00100000:3.0:1788271639.676460:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000095a2e90b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+10:7412:x1875138590020736:12345-0@lo:501: Request processed in 67us (286us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788271639.676467:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788271639.676547:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f4bbd2e6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590020736:0@lo:501: 10000000:01000000:0.0:1788271639.676558:0:7412:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788271639.676572:0:7412:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788271639.676576:0:7412:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: 0000000075320275/0x99288105fd38e320 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x99288105fd38e327 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.676582:0:7412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: 0000000075320275/0x99288105fd38e320 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x99288105fd38e327 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.676593:0:7412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: 0000000075320275/0x99288105fd38e320 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x99288105fd38e327 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.676613:0:7412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788271639.676788:0:7412:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f6eb0cef800 10000000:01000000:0.0:1788271639.676795:0:7412:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788271639.676799:0:7412:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8f6e85beb370 10000000:01000000:0.0:1788271639.676801:0:7412:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788271639.676804:0:7412:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8f6e85beb370 from 1 10000000:01000000:0.0:1788271639.676806:0:7412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788271639.676822:0:7412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: 00000000f8b50a01/0x99288105fd38e32e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.676829:0:7412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: 00000000f8b50a01/0x99288105fd38e32e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.676836:0:7412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: 00000000f8b50a01/0x99288105fd38e32e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271639.676848:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f4bbd2e6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590020864:0@lo:101: 00000100:00100000:0.0:1788271639.676871:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271639.676894:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bd7e0ee6 going to sleep for 11 seconds 00010000:00010000:2.0:1788271639.676978:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271639.676984:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: 0000000075320275/0x99288105fd38e320 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x99288105fd38e327 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271639.676990:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000075320275 already unused, calling callback (000000008f234c73) 10000000:00010000:2.0:1788271639.676993:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: 0000000075320275/0x99288105fd38e320 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x99288105fd38e327 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271639.677000:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: 0000000075320275/0x99288105fd38e320 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x99288105fd38e327 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788271639.677006:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: 0000000075320275/0x99288105fd38e320 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x99288105fd38e327 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271639.677017:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788271639.677033:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: 0000000075320275/0x99288105fd38e320 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x99288105fd38e327 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271639.677040:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788271639.677063:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: 0000000075320275/0x99288105fd38e320 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x99288105fd38e327 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271639.677069:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: 0000000075320275/0x99288105fd38e320 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x99288105fd38e327 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271639.677086:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271639.677088:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271639.677089:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271639.677123:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590020864 00000100:00100000:1.0:1788271639.677129:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590020864 00000100:00100000:1.0:1788271639.677162:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788271639.677168:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eab7a237 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+10:7412:x1875138590020864:12345-0@lo:101: 00010000:00010000:1.0:1788271639.677175:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271639.677185:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ab3eed5b/0x99288105fd38e335 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e32e expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271639.677199:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ab3eed5b/0x99288105fd38e335 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e32e expref: 11 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271639.677217:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ab3eed5b/0x99288105fd38e335 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e32e expref: 11 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271639.677224:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ab3eed5b, rc 0) 00000100:00100000:1.0:1788271639.677255:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eab7a237 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+11:7412:x1875138590020864:12345-0@lo:101: Request processed in 87us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271639.677260:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788271639.677390:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000006fff530 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590020992:0@lo:103: 00000100:00100000:0.0:1788271639.677418:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271639.677582:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f4bbd2e6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590020864:0@lo:101: 00010000:00010000:0.0:1788271639.677591:0:7412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: 00000000f8b50a01/0x99288105fd38e32e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e335 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.677613:0:7412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: 00000000f8b50a01/0x99288105fd38e32e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e335 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271639.677728:0:7412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788271639.677739:0:7412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: 00000000f8b50a01/0x99288105fd38e32e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e335 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.677745:0:7412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: 00000000f8b50a01/0x99288105fd38e32e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e335 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271639.677754:0:7412:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8f6eb0cef800 10000000:01000000:0.0:1788271639.677758:0:7412:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788271639.677761:0:7412:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8f6eb0cef800 from 1 10000000:01000000:0.0:1788271639.677763:0:7412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788271639.677779:0:7412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: 0000000021982214/0x99288105fd38e33c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.677785:0:7412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: 0000000021982214/0x99288105fd38e33c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.677791:0:7412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: 0000000021982214/0x99288105fd38e33c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271639.677803:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f4bbd2e6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590021120:0@lo:101: 00000100:00100000:0.0:1788271639.677826:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271639.677843:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fb70b010 going to sleep for 11 seconds 00000100:00100000:1.0:1788271639.677917:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590021120 00000100:00100000:1.0:1788271639.677921:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590021120 00000100:00100000:1.0:1788271639.677945:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788271639.677951:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1a1ebe0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+11:7412:x1875138590021120:12345-0@lo:101: 00010000:00010000:1.0:1788271639.677958:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271639.677965:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004beea677/0x99288105fd38e343 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e33c expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271639.677977:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004beea677/0x99288105fd38e343 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e33c expref: 12 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271639.677984:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004beea677/0x99288105fd38e343 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e33c expref: 12 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271639.677990:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004beea677, rc 0) 00000100:00100000:1.0:1788271639.678017:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1a1ebe0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:7412:x1875138590021120:12345-0@lo:101: Request processed in 66us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271639.678023:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788271639.678205:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590020992 00000100:00100000:2.0:1788271639.678210:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590020992 00000100:00100000:2.0:1788271639.678247:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788271639.678254:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb80b701 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:3608:x1875138590020992:12345-0@lo:103: 00010000:00010000:2.0:1788271639.678261:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271639.678283:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000051091a6a/0x99288105fd38e327 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x99288105fd38e320 expref: 12 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271639.678294:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271639.678330:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb80b701 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4eab87b-0440-4f90-8c88-4ffaef16406f+11:3608:x1875138590020992:12345-0@lo:103: Request processed in 78us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271639.678337:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788271639.678458:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000006fff530 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590020992:0@lo:103: 00000100:00100000:0.0:1788271639.678550:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f4bbd2e6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590021120:0@lo:101: 00010000:00010000:0.0:1788271639.678559:0:7412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: 0000000021982214/0x99288105fd38e33c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e343 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.678572:0:7412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: 0000000021982214/0x99288105fd38e33c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e343 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271639.678582:0:7412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788271639.678801:0:7412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: 0000000021982214/0x99288105fd38e33c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e343 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.678809:0:7412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: 0000000021982214/0x99288105fd38e33c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e343 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271639.678816:0:7412:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788271639.678820:0:7412:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788271639.678824:0:7412:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8f6eb0cef800 10000000:01000000:0.0:1788271639.678827:0:7412:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788271639.678830:0:7412:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1788271639.678832:0:7412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788271639.678859:0:7412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: 000000000e76871c/0x99288105fd38e34a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.678866:0:7412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: 000000000e76871c/0x99288105fd38e34a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.678874:0:7412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: 000000000e76871c/0x99288105fd38e34a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271639.678885:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f4bbd2e6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590021248:0@lo:101: 00000100:00100000:0.0:1788271639.678913:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271639.678942:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fb70b010 going to sleep for 11 seconds 00000100:00100000:2.0:1788271639.678987:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590021248 00000100:00100000:2.0:1788271639.678991:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590021248 00000100:00100000:2.0:1788271639.679022:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788271639.679033:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cbe33a4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+11:7412:x1875138590021248:12345-0@lo:101: 00010000:00010000:2.0:1788271639.679041:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271639.679048:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000008f4236d/0x99288105fd38e351 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e34a expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271639.679060:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000008f4236d/0x99288105fd38e351 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e34a expref: 12 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271639.679067:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000008f4236d/0x99288105fd38e351 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e34a expref: 12 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271639.679073:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000008f4236d, rc 0) 00000100:00100000:2.0:1788271639.679097:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cbe33a4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:7412:x1875138590021248:12345-0@lo:101: Request processed in 65us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271639.679102:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788271639.679165:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f4bbd2e6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590021248:0@lo:101: 00010000:00010000:0.0:1788271639.679175:0:7412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: 000000000e76871c/0x99288105fd38e34a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e351 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.679182:0:7412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: 000000000e76871c/0x99288105fd38e34a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e351 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271639.679253:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f4bbd2e6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590021376:0@lo:501: 00000100:00100000:0.0:1788271639.679340:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271639.679357:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fb70b010 going to sleep for 11 seconds 00000100:00100000:2.0:1788271639.679392:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590021376 00000100:00100000:2.0:1788271639.679395:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590021376 00000100:00100000:2.0:1788271639.679422:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788271639.679428:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e0cb9fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:7412:x1875138590021376:12345-0@lo:501: 00000100:00100000:2.0:1788271639.679532:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e0cb9fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:7412:x1875138590021376:12345-0@lo:501: Request processed in 103us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271639.679538:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788271639.679654:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f4bbd2e6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590021376:0@lo:501: 00000100:00100000:0.0:1788271639.679675:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f4bbd2e6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590021504:0@lo:503: 00000100:00100000:0.0:1788271639.679825:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271639.679846:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fb70b010 going to sleep for 11 seconds 00000100:00100000:3.0:1788271639.679879:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590021504 00000100:00100000:3.0:1788271639.679883:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590021504 00000100:00100000:3.0:1788271639.679909:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788271639.679914:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a436089 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:7412:x1875138590021504:12345-0@lo:503: 00000100:00100000:3.0:1788271639.679980:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a436089 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:7412:x1875138590021504:12345-0@lo:503: Request processed in 66us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271639.679987:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788271639.680157:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f4bbd2e6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590021504:0@lo:503: 00000040:00080000:0.0:1788271639.680500:0:7412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788271639.680568:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f4bbd2e6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590021632:0@lo:502: 00000100:00100000:0.0:1788271639.680604:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271639.680716:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fb70b010 going to sleep for 11 seconds 00000100:00100000:2.0:1788271639.680951:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590021632 00000100:00100000:2.0:1788271639.680956:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590021632 00000100:00100000:2.0:1788271639.680992:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788271639.680998:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc05bab5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:7412:x1875138590021632:12345-0@lo:502: 00000100:00100000:2.0:1788271639.681089:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc05bab5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:7412:x1875138590021632:12345-0@lo:502: Request processed in 91us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271639.681105:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788271639.681207:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f4bbd2e6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590021632:0@lo:502: 00000040:00080000:1.0:1788271639.681418:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788271639.681460:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:1.0:1788271639.681476:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:1.0:1788271639.681489:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:1.0:1788271639.681501:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:1.0:1788271639.681515:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:1.0:1788271639.681528:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:1.0:1788271639.681542:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:1.0:1788271639.681554:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:1.0:1788271639.681567:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:1.0:1788271639.681579:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:1.0:1788271639.681592:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:1.0:1788271639.681606:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:1.0:1788271639.681882:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:1.0:1788271639.681902:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:1.0:1788271639.681917:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:1.0:1788271639.681930:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:1.0:1788271639.681943:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:1.0:1788271639.681956:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:1.0:1788271639.681968:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:1.0:1788271639.681981:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:1.0:1788271639.681993:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:1.0:1788271639.682005:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:1.0:1788271639.682033:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dd29ac57 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590021760:0@lo:502: 00000100:00100000:1.0:1788271639.682079:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271639.682108:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 0000000025a27bd2 going to sleep for 11 seconds 00000100:00100000:2.0:1788271639.682211:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590021760 00000100:00100000:2.0:1788271639.682216:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590021760 00000100:00100000:2.0:1788271639.682241:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788271639.682247:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002704a4b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:7412:x1875138590021760:12345-0@lo:502: 00000100:00100000:2.0:1788271639.682333:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002704a4b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:7412:x1875138590021760:12345-0@lo:502: Request processed in 86us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271639.682339:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788271639.682596:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dd29ac57 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590021760:0@lo:502: 00000040:00080000:0.0:1788271639.682927:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:0.0:1788271639.682936:0:7412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:2.0:1788271639.683417:0:7424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788271639.683429:0:7424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271639.683431:0:7424:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788271639.683437:0:7424:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1788271639.683449:0:7424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788271639.683472:0:7424:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000e7100688) 00000020:00000080:2.0:1788271639.683493:0:7424:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:2.0:1788271639.683500:0:7424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788271639.683583:0:7424:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788271639.683590:0:7424:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x99288105fd38e35f 00000020:00000080:2.0:1788271639.684086:0:7424:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788271639.684091:0:7424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788271639.684095:0:7424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271639.684096:0:7424:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788271639.684099:0:7424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788271639.684102:0:7424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271639.684103:0:7424:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1788271639.684106:0:7424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788271639.684113:0:7424:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000993ca958) 00000020:00000080:2.0:1788271639.684124:0:7424:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:2.0:1788271639.684128:0:7424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788271639.684129:0:7424:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1788271639.684137:0:7424:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1788271639.684146:0:7424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788271639.684203:0:7424:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009b983222 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1788271639.684216:0:7424:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (000000001a3e3081) 00000020:00000080:2.0:1788271639.684223:0:7424:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:2.0:1788271639.684365:0:7424:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788271639.684371:0:7424:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x99288105fd38e374 00000020:00000080:2.0:1788271639.684477:0:7424:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1788271639.684483:0:7424:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788271639.684487:0:7424:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x99288105fd38e37b 00080000:01000000:2.0:1788271639.684492:0:7424:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788271639.684495:0:7424:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x99288105fd38e382 00080000:10000000:2.0:1788271639.685068:0:7424:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1788271639.685198:0:7424:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:1.0:1788271639.757391:0:7424:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:1.0:1788271639.758063:0:7424:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:1.0:1788271639.760469:0:7424:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1788271639.760967:0:7424:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788271639.771539:0:7424:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788271639.771553:0:7424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788271639.771560:0:7424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271639.771562:0:7424:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788271639.771567:0:7424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788271639.771573:0:7424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271639.771574:0:7424:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788271639.771577:0:7424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788271639.771581:0:7424:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.103@tcp to nid 0x20000c0a8c967 (192.168.201.103@tcp) 00000020:00000080:3.0:1788271639.771608:0:7424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788271639.771638:0:7424:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (0000000013a62e7f) 00000020:00000080:3.0:1788271639.771662:0:7424:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788271639.771668:0:7424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788271639.771760:0:7424:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788271639.771771:0:7424:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788271639.771778:0:7424:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x99288105fd38e390 00010000:00080000:3.0:1788271639.771808:0:7424:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000684a0b9b@lustre-MDT0000-osp-MDT0001: add connection 192.168.201.103@tcp at head 00010000:00010000:3.0:1788271639.773367:0:7424:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:3.0:1788271639.778091:0:7424:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788271639.778112:0:7424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788271639.778147:0:7424:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788271639.778170:0:7424:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x99288105fd38e397 00000100:00080000:3.0:1788271639.778181:0:7424:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788271639.778186:0:7424:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000684a0b9b using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788271639.778222:0:7424:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006d6f8097 x1875138590021888/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788271639.778255:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006d6f8097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3605:1875138590021888:0@lo:38: 00000100:00100000:3.0:1788271639.779944:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788271639.780094:0:7424:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1788271639.780179:0:7424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788271639.780186:0:7424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271639.780188:0:7424:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1788271639.780191:0:7424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788271639.780194:0:7424:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788271639.780195:0:7424:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788271639.780196:0:7424:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788271639.780197:0:7424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788271639.780199:0:7424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271639.780201:0:7424:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788271639.780203:0:7424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788271639.780208:0:7424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271639.780209:0:7424:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1788271639.780213:0:7424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788271639.780258:0:7424:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788271639.780272:0:7424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788271639.780287:0:7424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271639.780288:0:7424:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1788271639.780291:0:7424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788271639.780294:0:7424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271639.780295:0:7424:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788271639.780297:0:7424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788271639.780299:0:7424:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788271639.780328:0:7424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788271639.780330:0:7424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271639.780331:0:7424:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788271639.780334:0:7424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:3.0:1788271639.780541:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000438139a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875138590022016:0@lo:400: 00000100:00100000:3.0:1788271639.780594:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271639.780652:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590022016 00000100:00100000:3.0:1788271639.780659:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590022016 00000100:00100000:3.0:1788271639.781846:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788271639.781862:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000773f0a5c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875138590022016:12345-0@lo:400: 00000100:00100000:3.0:1788271639.781940:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000773f0a5c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875138590022016:12345-0@lo:400: Request processed in 85us (1345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271639.781948:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788271639.781992:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000438139a x1875138590022016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271639.782005:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000438139a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875138590022016:0@lo:400: 00000020:01000000:3.0:1788271639.782048:0:7412:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:3.0:1788271639.782085:0:7412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788271639.782099:0:7412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: 000000000e76871c/0x99288105fd38e34a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e351 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271639.782110:0:7412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: 000000000e76871c/0x99288105fd38e34a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e351 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271639.782126:0:7412:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f6eb0cef800 from 1 10000000:01000000:3.0:1788271639.782129:0:7412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788271639.782157:0:7412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: 000000002e3869ec/0x99288105fd38e39e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271639.782163:0:7412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: 000000002e3869ec/0x99288105fd38e39e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271639.782174:0:7412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: 000000002e3869ec/0x99288105fd38e39e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271639.782190:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000438139a pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590022144:0@lo:101: 00000100:00100000:3.0:1788271639.782224:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271639.782251:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 00000000750c1079 going to sleep for 11 seconds 00000100:00100000:2.0:1788271639.782337:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590022144 00000100:00100000:2.0:1788271639.782342:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590022144 00000100:00100000:2.0:1788271639.782379:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788271639.782385:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dcd98280 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:7412:x1875138590022144:12345-0@lo:101: 00010000:00010000:2.0:1788271639.782394:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271639.782405:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000da52b1b3/0x99288105fd38e3a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e39e expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271639.782427:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000da52b1b3/0x99288105fd38e3a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e39e expref: 13 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271639.782447:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000da52b1b3/0x99288105fd38e3a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e39e expref: 13 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271639.782456:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000da52b1b3, rc 0) 00000100:00100000:2.0:1788271639.782485:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dcd98280 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+13:7412:x1875138590022144:12345-0@lo:101: Request processed in 100us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271639.782500:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788271639.782606:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590021888 00000100:00100000:0.0:1788271639.782611:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590021888 00000100:00100000:0.0:1788271639.782644:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788271639.782649:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2fafe6b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3605:x1875138590021888:12345-0@lo:38: 00010000:00080000:0.0:1788271639.782672:0:6488:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:0.0:1788271639.782783:0:6488:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x99288105fd38e3ac 00000004:00100000:0.0:1788271639.782802:0:6488:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788271639.782808:0:6488:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1788271639.783678:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000438139a pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590022144:0@lo:101: 00010000:00010000:3.0:1788271639.783765:0:7412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: 000000002e3869ec/0x99288105fd38e39e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e3a5 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271639.783775:0:7412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: 000000002e3869ec/0x99288105fd38e39e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e3a5 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271639.784273:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000438139a pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590022272:0@lo:256: 00000100:00100000:3.0:1788271639.784325:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271639.784927:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 00000000750c1079 going to sleep for 11 seconds 00000100:00100000:2.0:1788271639.785005:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590022272 00000100:00100000:2.0:1788271639.785011:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590022272 00000100:00100000:2.0:1788271639.785080:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788271639.785088:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e2fd100 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+13:7412:x1875138590022272:12345-0@lo:256: 20000000:01000000:2.0:1788271639.785105:0:6478:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788271639.785122:0:6478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788271639.785125:0:6478:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788271639.785208:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e2fd100 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+13:7412:x1875138590022272:12345-0@lo:256: Request processed in 121us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271639.785216:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788271639.785272:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000438139a pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590022272:0@lo:256: 10000000:01000000:3.0:1788271639.785932:0:7412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788271639.785953:0:7412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: 000000002e3869ec/0x99288105fd38e39e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e3a5 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271639.786650:0:7412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: 000000002e3869ec/0x99288105fd38e39e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e3a5 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271639.786659:0:7412:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f6eb0cef800 from 1 10000000:01000000:3.0:1788271639.786661:0:7412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788271639.786693:0:7412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: 00000000027fa5e3/0x99288105fd38e3b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271639.786699:0:7412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: 00000000027fa5e3/0x99288105fd38e3b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271639.786709:0:7412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: 00000000027fa5e3/0x99288105fd38e3b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271639.786728:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000438139a pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590022400:0@lo:101: 00000100:00100000:3.0:1788271639.786782:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271639.789071:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 00000000750c1079 going to sleep for 11 seconds 00000100:00100000:0.0:1788271639.789144:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590022400 00000100:00100000:0.0:1788271639.789154:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590022400 00000100:00100000:0.0:1788271639.789205:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788271639.789214:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000cec5508 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+13:7412:x1875138590022400:12345-0@lo:101: 00010000:00010000:0.0:1788271639.789229:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271639.789245:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000f9783ea/0x99288105fd38e3ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e3b3 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.789272:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000f9783ea/0x99288105fd38e3ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e3b3 expref: 14 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.789281:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000f9783ea/0x99288105fd38e3ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e3b3 expref: 14 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.789288:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000f9783ea, rc 0) 00000100:00100000:0.0:1788271639.789424:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000cec5508 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+14:7412:x1875138590022400:12345-0@lo:101: Request processed in 210us (2641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271639.789431:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1788271639.791411:0:6488:0:(import.c:65:import_set_state_nolock()) 0000000016f0e971 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788271639.791530:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2fafe6b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3605:x1875138590021888:12345-0@lo:38: Request processed in 8878us (11589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271639.791546:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788271639.791678:0:3605:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788271639.791697:0:3605:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788271639.791706:0:3605:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788271639.791712:0:3605:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788271639.791714:0:3605:0:(import.c:65:import_set_state_nolock()) 00000000684a0b9b lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788271639.791725:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006d6f8097 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3605:1875138590021888:0@lo:38: 00000100:00100000:0.0:1788271639.791921:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b0d3641c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590022528:0@lo:41: 00000100:00100000:0.0:1788271639.791961:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271639.792060:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590022528 00000100:00100000:2.0:1788271639.792067:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590022528 00000100:00100000:2.0:1788271639.792108:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788271639.792115:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cfcc3358 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3606:x1875138590022528:12345-0@lo:41: 00000004:00000024:2.0:1788271639.792140:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1788271639.792177:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cfcc3358 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3606:x1875138590022528:12345-0@lo:41: Request processed in 62us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271639.792183:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788271639.792218:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b0d3641c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590022528:0@lo:41: 00000100:00100000:3.0:1788271639.792451:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000438139a pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590022400:0@lo:101: 00010000:00010000:3.0:1788271639.792472:0:7412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: 00000000027fa5e3/0x99288105fd38e3b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e3ba expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271639.792485:0:7412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: 00000000027fa5e3/0x99288105fd38e3b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e3ba expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271639.792582:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000438139a pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590022656:0@lo:501: 00000100:00100000:3.0:1788271639.792611:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271639.792869:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 00000000750c1079 going to sleep for 11 seconds 00000100:00100000:2.0:1788271639.792911:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590022656 00000100:00100000:2.0:1788271639.792915:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590022656 00000100:00100000:2.0:1788271639.792975:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788271639.792987:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b301e70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+14:7412:x1875138590022656:12345-0@lo:501: 00000100:00100000:2.0:1788271639.793093:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b301e70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+14:7412:x1875138590022656:12345-0@lo:501: Request processed in 106us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271639.793100:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788271639.793157:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000438139a pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590022656:0@lo:501: 00000100:00100000:3.0:1788271639.793184:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000438139a pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590022784:0@lo:503: 00000100:00100000:3.0:1788271639.793220:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271639.793300:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 00000000750c1079 going to sleep for 11 seconds 00000100:00100000:0.0:1788271639.793366:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590022784 00000100:00100000:0.0:1788271639.793370:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590022784 00000100:00100000:0.0:1788271639.793393:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788271639.793398:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7fc3f5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+14:7412:x1875138590022784:12345-0@lo:503: 00000040:00080000:0.0:1788271639.793429:0:6476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788271639.793482:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7fc3f5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+14:7412:x1875138590022784:12345-0@lo:503: Request processed in 84us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271639.793489:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788271639.793555:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000438139a pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590022784:0@lo:503: 00000040:00080000:3.0:1788271639.793842:0:7412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788271639.793903:0:7412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:3.0:1788271639.793976:0:7412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788271639.794853:0:7429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:0.0:1788271639.795058:0:7412:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788271639.795087:0:7412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788271639.795111:0:7412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: 00000000027fa5e3/0x99288105fd38e3b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e3ba expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.795123:0:7412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: 00000000027fa5e3/0x99288105fd38e3b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e3ba expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271639.795178:0:7412:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788271639.795181:0:7412:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f6eb0cef800 10000000:01000000:0.0:1788271639.795184:0:7412:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f6eb0cef800 10000000:01000000:0.0:1788271639.795189:0:7412:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788271639.795196:0:7412:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f6eb0cef800 from 1 10000000:01000000:0.0:1788271639.795199:0:7412:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788271639.795232:0:7412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: 00000000ca65fb9e/0x99288105fd38e3c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.795239:0:7412:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: 00000000ca65fb9e/0x99288105fd38e3c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.795250:0:7412:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: 00000000ca65fb9e/0x99288105fd38e3c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271639.795282:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004b0d37ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590022912:0@lo:101: 00000100:00100000:0.0:1788271639.795339:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271639.795376:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590022912 00000100:00100000:0.0:1788271639.795382:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590022912 00000100:00100000:0.0:1788271639.795415:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788271639.795422:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021b080f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+14:7412:x1875138590022912:12345-0@lo:101: 00010000:00010000:0.0:1788271639.795433:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271639.795454:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b2ca70bd/0x99288105fd38e3c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e3c1 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.795476:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b2ca70bd/0x99288105fd38e3c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e3c1 expref: 15 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.795487:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b2ca70bd/0x99288105fd38e3c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e3c1 expref: 15 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.795496:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b2ca70bd, rc 0) 00000100:00100000:0.0:1788271639.795525:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021b080f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:7412:x1875138590022912:12345-0@lo:101: Request processed in 103us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271639.795531:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788271639.795559:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 000000006bda5024 going to sleep for 11 seconds 00000100:00100000:0.0:1788271639.795577:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004b0d37ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590022912:0@lo:101: 00010000:00010000:0.0:1788271639.795588:0:7412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: 00000000ca65fb9e/0x99288105fd38e3c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e3c8 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.795596:0:7412:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: 00000000ca65fb9e/0x99288105fd38e3c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e3c8 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271639.795728:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004b0d37ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590023040:0@lo:501: 00000100:00100000:0.0:1788271639.795752:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271639.795773:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590023040 00000100:00100000:0.0:1788271639.795777:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590023040 00000100:00100000:0.0:1788271639.795794:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788271639.795799:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010a02ebb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:7412:x1875138590023040:12345-0@lo:501: 00000100:00100000:0.0:1788271639.795877:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010a02ebb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:7412:x1875138590023040:12345-0@lo:501: Request processed in 78us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271639.795883:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788271639.795903:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 000000006bda5024 going to sleep for 11 seconds 00000100:00100000:0.0:1788271639.795913:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004b0d37ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590023040:0@lo:501: 00000100:00100000:0.0:1788271639.795936:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004b0d37ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590023168:0@lo:503: 00000100:00100000:0.0:1788271639.795968:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271639.795989:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590023168 00000100:00100000:0.0:1788271639.795992:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590023168 00000100:00100000:0.0:1788271639.796007:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788271639.796011:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082ba11fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:7412:x1875138590023168:12345-0@lo:503: 00000100:00100000:0.0:1788271639.796073:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082ba11fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:7412:x1875138590023168:12345-0@lo:503: Request processed in 61us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271639.796079:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788271639.796111:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 000000000df41d4d going to sleep for 11 seconds 00000100:00100000:0.0:1788271639.796123:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004b0d37ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590023168:0@lo:503: 00000040:00080000:0.0:1788271639.796391:0:7412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788271639.796455:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004b0d37ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590023296:0@lo:502: 00000100:00100000:0.0:1788271639.796494:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271639.796516:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590023296 00000100:00100000:0.0:1788271639.796519:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590023296 00000100:00100000:0.0:1788271639.796549:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788271639.796555:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f466fc04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:7412:x1875138590023296:12345-0@lo:502: 00000100:00100000:0.0:1788271639.796650:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f466fc04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:7412:x1875138590023296:12345-0@lo:502: Request processed in 95us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271639.796656:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788271639.796686:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b74e5982 going to sleep for 11 seconds 00000100:00100000:0.0:1788271639.796697:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004b0d37ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590023296:0@lo:502: 00000040:00080000:0.0:1788271639.796856:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788271639.796880:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788271639.796892:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788271639.796905:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788271639.796919:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788271639.796932:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788271639.796945:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788271639.796958:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788271639.796969:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788271639.796983:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788271639.796997:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788271639.797009:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788271639.797022:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788271639.797034:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788271639.797046:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788271639.797059:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788271639.797073:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788271639.797096:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788271639.797110:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788271639.797122:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788271639.797144:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788271639.797157:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788271639.797170:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788271639.797182:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788271639.797194:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788271639.797207:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788271639.797219:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788271639.797230:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1788271639.797248:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004b0d37ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590023424:0@lo:502: 00000100:00100000:0.0:1788271639.797283:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271639.797314:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b74e5982 going to sleep for 11 seconds 00000100:00100000:3.0:1788271639.797463:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590023424 00000100:00100000:3.0:1788271639.797469:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590023424 00000100:00100000:3.0:1788271639.797493:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788271639.797499:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048a641d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:7412:x1875138590023424:12345-0@lo:502: 00000100:00100000:3.0:1788271639.797582:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048a641d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:7412:x1875138590023424:12345-0@lo:502: Request processed in 83us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271639.797589:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788271639.798101:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004b0d37ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590023424:0@lo:502: 00000040:00080000:0.0:1788271639.798143:0:7412:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1788271639.798150:0:7412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1788271639.798539:0:7430:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788271639.798553:0:7430:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000008efd0743) 00000020:00000080:2.0:1788271639.798570:0:7430:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788271639.798667:0:7430:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009b983222 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788271639.798671:0:7430:0:(tgt_mount.c:187:server_put_mount()) put mount 000000009b983222 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788271639.798673:0:7430:0:(obd_mount.c:710:lustre_put_lsi()) put 000000009b983222 3 00010000:00080000:2.0:1788271639.798844:0:7430:0:(ldlm_lib.c:102:import_set_conn()) imp 000000005d0a4989@lustre-MDT0000-lwp-MDT0001: add connection 192.168.201.103@tcp at head 00010000:00010000:2.0:1788271639.800429:0:7430:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:2.0:1788271639.800793:0:7430:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788271639.800833:0:7430:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788271639.800843:0:7430:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x99288105fd38e3d6 00000100:00080000:2.0:1788271639.800852:0:7430:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788271639.800856:0:7430:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000005d0a4989 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788271639.800886:0:7430:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b0d3641c x1875138590023552/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788271639.800909:0:7430:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788271639.801195:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b0d3641c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3605:1875138590023552:0@lo:38: 00000100:00100000:3.0:1788271639.801272:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271639.801365:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590023552 00000100:00100000:1.0:1788271639.801379:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590023552 00000100:00100000:1.0:1788271639.801413:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788271639.801420:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000438139a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3605:x1875138590023552:12345-0@lo:38: 00010000:00080000:1.0:1788271639.801454:0:6483:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:1.0:1788271639.801488:0:6483:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x99288105fd38e3dd 00000004:00100000:1.0:1788271639.801506:0:6483:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788271639.801537:0:6483:0:(import.c:65:import_set_state_nolock()) 000000007fe83bb1 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788271639.801587:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000438139a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3605:x1875138590023552:12345-0@lo:38: Request processed in 166us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271639.801593:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788271639.801726:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b0d3641c x1875138590023552/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788271649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271639.801736:0:3605:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788271639.801743:0:3605:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788271639.801750:0:3605:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788271639.801754:0:3605:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788271639.801756:0:3605:0:(import.c:65:import_set_state_nolock()) 000000005d0a4989 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788271639.801761:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b0d3641c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3605:1875138590023552:0@lo:38: 00000040:00080000:3.0:1788271639.802090:0:7430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1788271639.802254:0:7412:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1788271639.802284:0:7412:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788271639.802304:0:7412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: 00000000ca65fb9e/0x99288105fd38e3c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e3c8 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271639.802314:0:7412:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: 00000000ca65fb9e/0x99288105fd38e3c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e3c8 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788271639.802361:0:7412:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788271639.802364:0:7412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788271639.802365:0:7412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788271639.802367:0:7412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788271639.802368:0:7412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788271639.802369:0:7412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788271639.802371:0:7412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788271639.802373:0:7412:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788271639.802374:0:7412:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788271639.802375:0:7412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788271639.802377:0:7412:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788271639.802381:0:7412:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:1.0:1788271639.802383:0:7412:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788271639.802385:0:7412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788271639.802390:0:7412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788271639.802391:0:7412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788271639.802392:0:7412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788271639.802393:0:7412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788271639.802394:0:7412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788271639.802394:0:7412:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788271639.802395:0:7412:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788271639.802396:0:7412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788271639.802397:0:7412:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788271639.802415:0:7412:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788271639.802427:0:7412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dd29ac57 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590023680:0@lo:253: 00000100:00100000:1.0:1788271639.802480:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271639.802504:0:7412:0:(client.c:2715:ptlrpc_set_wait()) set 000000007ba5d326 going to sleep for 11 seconds 00000100:00100000:3.0:1788271639.802558:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590023680 00000100:00100000:3.0:1788271639.802564:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590023680 00000100:00100000:3.0:1788271639.802607:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788271639.802614:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000097976b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:7412:x1875138590023680:12345-0@lo:253: 20000000:01000000:3.0:1788271639.802664:0:6476:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788271639.802677:0:6476:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1788271639.804298:0:6462:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788271639.804365:0:6476:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788271639.804384:0:6476:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788271639.804701:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000097976b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:7412:x1875138590023680:12345-0@lo:253: Request processed in 2084us (2217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271639.804714:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788271639.804782:0:7412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dd29ac57 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:7412:1875138590023680:0@lo:253: 10000000:01000000:3.0:1788271639.804794:0:7412:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788271639.804797:0:7412:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788271639.804799:0:7412:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788271639.804800:0:7412:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788271639.804801:0:7412:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788271639.804803:0:7412:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788271639.804804:0:7412:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788271639.804805:0:7412:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788271639.804807:0:7412:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788271639.804808:0:7412:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788271639.804809:0:7412:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788271639.804811:0:7412:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788271639.804824:0:7412:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1788271639.807601:0:6499:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788271639.807614:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788271639.807661:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000058ac21f9/0x99288105fd38e3e4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271639.807680:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b5b8ac9b/0x99288105fd38e304 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e2fd expref: 14 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271639.807688:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000da52b1b3/0x99288105fd38e3a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e39e expref: 14 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271639.807694:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000058ac21f9/0x99288105fd38e3e4 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271639.807743:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000da52b1b3/0x99288105fd38e3a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e39e expref: 14 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271639.807758:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000da52b1b3/0x99288105fd38e3a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e39e expref: 14 pid: 6476 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271639.807794:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a234eefd pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6499:1875138590023808:0@lo:104: 00000100:00100000:1.0:1788271639.807867:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788271639.807938:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b5b8ac9b/0x99288105fd38e304 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e2fd expref: 14 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271639.807946:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b5b8ac9b/0x99288105fd38e304 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e2fd expref: 14 pid: 6478 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271639.807954:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000016b87b3d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6499:1875138590023936:0@lo:104: 00000100:00100000:1.0:1788271639.807977:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271639.807992:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set 000000006db01e1c going to sleep for 11 seconds 00000100:00100000:1.0:1788271639.808026:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590023808 00000100:00100000:1.0:1788271639.808035:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590023808 00000100:00100000:1.0:1788271639.808076:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590023936 00000100:00100000:1.0:1788271639.808079:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590023936 00000100:00100000:1.0:1788271639.808091:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788271639.808099:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a2d28e0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+4:6499:x1875138590023808:12345-0@lo:104: 00010000:00010000:1.0:1788271639.808110:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: 000000002e3869ec/0x99288105fd38e39e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e3a5 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271639.808178:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788271639.808184:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a2d28e0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+4:6499:x1875138590023808:12345-0@lo:104: Request processed in 85us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271639.808190:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788271639.808208:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788271639.808212:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024357a49 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+3:6499:x1875138590023936:12345-0@lo:104: 00010000:00010000:1.0:1788271639.808219:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: 0000000097d8520e/0x99288105fd38e2fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e304 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271639.808261:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788271639.808265:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024357a49 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+3:6499:x1875138590023936:12345-0@lo:104: Request processed in 54us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271639.808271:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788271639.808311:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a234eefd pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6499:1875138590023808:0@lo:104: 00000100:00100000:1.0:1788271639.808319:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000016b87b3d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6499:1875138590023936:0@lo:104: 00010000:00010000:1.0:1788271639.808336:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000058ac21f9/0x99288105fd38e3e4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.808470:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788271639.808476:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: 000000002e3869ec/0x99288105fd38e39e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e3a5 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.808484:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002e3869ec already unused, calling callback (000000008f234c73) 10000000:00010000:0.0:1788271639.808487:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: 000000002e3869ec/0x99288105fd38e39e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e3a5 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.808495:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: 000000002e3869ec/0x99288105fd38e39e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e3a5 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788271639.808502:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: 000000002e3869ec/0x99288105fd38e39e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e3a5 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271639.808508:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788271639.808540:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: 000000002e3869ec/0x99288105fd38e39e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e3a5 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.808555:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788271639.808576:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: 000000002e3869ec/0x99288105fd38e39e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e3a5 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.808583:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: 000000002e3869ec/0x99288105fd38e39e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e3a5 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.808599:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271639.808601:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: 0000000097d8520e/0x99288105fd38e2fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e304 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.808607:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000097d8520e already unused, calling callback (000000008f234c73) 10000000:00010000:0.0:1788271639.808609:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: 0000000097d8520e/0x99288105fd38e2fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e304 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.808614:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: 0000000097d8520e/0x99288105fd38e2fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e304 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788271639.808644:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: 0000000097d8520e/0x99288105fd38e2fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e304 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271639.808649:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788271639.808663:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: 0000000097d8520e/0x99288105fd38e2fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e304 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.808669:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788271639.808682:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: 0000000097d8520e/0x99288105fd38e2fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e304 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.808688:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: 0000000097d8520e/0x99288105fd38e2fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e304 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.808709:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271639.808711:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271639.808712:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271639.808725:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004b0d37ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590024064:0@lo:103: 00000100:00100000:0.0:1788271639.808760:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271639.808803:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590024064 00000100:00100000:0.0:1788271639.808809:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590024064 00010000:00010000:0.0:1788271639.808828:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000da52b1b3/0x99288105fd38e3a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e39e expref: 15 pid: 6476 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271639.808850:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788271639.808857:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008500d6d2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:3607:x1875138590024064:12345-0@lo:103: 00010000:00010000:0.0:1788271639.808868:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271639.808872:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000da52b1b3/0x99288105fd38e3a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e39e expref: 15 pid: 6476 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.808882:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000da52b1b3/0x99288105fd38e3a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e39e expref: 15 pid: 6476 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.808894:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000da52b1b3/0x99288105fd38e3a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e39e expref: 15 pid: 6476 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271639.808905:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271639.808930:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008500d6d2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+14:3607:x1875138590024064:12345-0@lo:103: Request processed in 75us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271639.808937:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788271639.808966:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004b0d37ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590024064:0@lo:103: 00010000:00010000:2.0:1788271639.809115:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271639.809685:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bba02fec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590024192:0@lo:103: 00000100:00100000:0.0:1788271639.809718:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271639.809805:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590024192 00000100:00100000:1.0:1788271639.809810:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590024192 00010000:00010000:1.0:1788271639.809826:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b5b8ac9b/0x99288105fd38e304 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e2fd expref: 14 pid: 6478 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271639.809852:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788271639.809857:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000093f5b5f3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+14:3608:x1875138590024192:12345-0@lo:103: 00010000:00010000:1.0:1788271639.809865:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271639.809869:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b5b8ac9b/0x99288105fd38e304 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e2fd expref: 14 pid: 6478 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271639.809877:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b5b8ac9b/0x99288105fd38e304 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e2fd expref: 14 pid: 6478 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271639.809887:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b5b8ac9b/0x99288105fd38e304 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e2fd expref: 14 pid: 6478 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271639.809899:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000058ac21f9/0x99288105fd38e3e4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271639.809916:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000058ac21f9/0x99288105fd38e3e4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788271639.809928:0:6469:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002812273s 00010000:00010000:1.0:1788271639.809932:0:6469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000058ac21f9/0x99288105fd38e3e4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271639.809938:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000058ac21f9/0x99288105fd38e3e4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271639.809944:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000058ac21f9/0x99288105fd38e3e4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271639.809949:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000058ac21f9/0x99288105fd38e3e4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271639.809954:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000058ac21f9 already unused, calling callback (00000000c2bcd1c8) 00010000:00010000:1.0:1788271639.809958:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000058ac21f9/0x99288105fd38e3e4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271639.809964:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000058ac21f9/0x99288105fd38e3e4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271639.809976:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000058ac21f9/0x99288105fd38e3e4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271639.809984:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271639.810008:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000093f5b5f3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+13:3608:x1875138590024192:12345-0@lo:103: Request processed in 151us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271639.810014:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788271639.810058:0:6499:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000058ac21f9/0x99288105fd38e3e4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271639.810065:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000058ac21f9/0x99288105fd38e3e4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271639.810070:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000058ac21f9/0x99288105fd38e3e4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271639.810128:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bba02fec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590024192:0@lo:103: 40000000:00080000:2.0:1788271639.811187:0:7431:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00080000:10000000:3.0:1788271639.812671:0:7412:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:3.0:1788271639.813209:0:7412:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788271639.813419:0:7412:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1788271639.813600:0:7412:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788271639.815079:0:7412:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788271639.815262:0:7412:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1788271639.817302:0:7412:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1788271639.817557:0:7412:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1788271639.818744:0:7412:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:3.0:1788271639.818945:0:7412:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1788271639.819145:0:7412:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:3.0:1788271639.819328:0:7412:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:0.0:1788271639.823213:0:7412:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:0.0:1788271639.823469:0:7436:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:0.0:1788271639.823529:0:7436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bba02fec pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7436:1875138590024320:0@lo:700: 00000100:00100000:0.0:1788271639.823604:0:7436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271639.823667:0:7436:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fbaf1637 going to sleep for 11 seconds 00000040:01000000:1.0:1788271639.823733:0:7412:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1788271639.823890:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590024320 00000100:00100000:2.0:1788271639.823899:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590024320 00000100:00100000:2.0:1788271639.823946:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788271639.823954:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b0d37ca pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7436:x1875138590024320:12345-0@lo:700: 00000100:00100000:1.0:1788271639.824288:0:7437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000004c95c90 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7437:1875138590024448:0@lo:1000: 00000100:00100000:1.0:1788271639.824327:0:7437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271639.824362:0:7437:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bbce46cc going to sleep for 11 seconds 00000100:00100000:2.0:1788271639.824405:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590024448 00000100:00100000:2.0:1788271639.824415:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590024448 00000100:00100000:2.0:1788271639.824454:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788271639.824461:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016b87b3d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7437:x1875138590024448:12345-0@lo:1000: 00000100:00100000:2.0:1788271639.824534:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016b87b3d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7437:x1875138590024448:12345-0@lo:1000: Request processed in 74us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271639.824542:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788271639.824584:0:7437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000004c95c90 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7437:1875138590024448:0@lo:1000: 00000040:01000000:2.0:1788271639.824613:0:7437:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:2.0:1788271639.824659:0:7437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005737bad9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7437:1875138590024576:0@lo:700: 00000100:00100000:2.0:1788271639.824683:0:7437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271639.824823:0:7437:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fd584c51 going to sleep for 11 seconds 00000100:00100000:1.0:1788271639.824860:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590024576 00000100:00100000:1.0:1788271639.824864:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590024576 00000100:00100000:1.0:1788271639.824894:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788271639.824899:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096515628 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7437:x1875138590024576:12345-0@lo:700: 00000100:00100000:1.0:1788271639.824936:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096515628 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7437:x1875138590024576:12345-0@lo:700: Request processed in 36us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271639.824942:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:0.0:1788271639.825381:0:7412:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1788271639.825496:0:7412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788271639.825807:0:7437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005737bad9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7437:1875138590024576:0@lo:700: 00000100:00100000:2.0:1788271639.825846:0:7437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005737bad9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7437:1875138590024704:0@lo:900: 00000100:00100000:2.0:1788271639.825878:0:7437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271639.825901:0:7437:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fd584c51 going to sleep for 11 seconds 00000100:00100000:1.0:1788271639.825952:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590024704 00000100:00100000:1.0:1788271639.825957:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590024704 00000100:00100000:1.0:1788271639.825990:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788271639.825997:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0727182 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7437:x1875138590024704:12345-0@lo:900: 00000100:00100000:1.0:1788271639.826032:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0727182 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7437:x1875138590024704:12345-0@lo:900: Request processed in 36us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271639.826038:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788271639.826092:0:7437:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005737bad9 x1875138590024704/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788271655 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271639.826103:0:7437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005737bad9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7437:1875138590024704:0@lo:900: 00000100:00100000:2.0:1788271639.826183:0:7437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005737bad9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7437:1875138590024832:0@lo:1000: 00000100:00100000:2.0:1788271639.826214:0:7437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271639.826235:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590024832 00000100:00100000:2.0:1788271639.826239:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590024832 00000100:00100000:2.0:1788271639.826260:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788271639.826265:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011a19a27 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7437:x1875138590024832:12345-0@lo:1000: 00000100:00100000:2.0:1788271639.826306:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011a19a27 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7437:x1875138590024832:12345-0@lo:1000: Request processed in 41us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271639.826316:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788271639.826332:0:7437:0:(client.c:2715:ptlrpc_set_wait()) set 000000009adc9a8d going to sleep for 11 seconds 00000100:00100000:2.0:1788271639.826341:0:7437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005737bad9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7437:1875138590024832:0@lo:1000: 00000004:00080000:2.0:1788271639.826372:0:7437:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000fd584c51 with version 0 00000020:00100000:2.0:1788271639.826384:0:7437:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788271639.826388:0:7437:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000005737bad9 x1875138590025088/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788271639.826398:0:7437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005737bad9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7437:1875138590025088:0@lo:1000: 00000100:00100000:2.0:1788271639.826416:0:7437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271639.826431:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590025088 00000100:00100000:2.0:1788271639.826433:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590025088 00000100:00100000:2.0:1788271639.826462:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788271639.826466:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0d3641c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7437:x1875138590025088:12345-0@lo:1000: 00000004:00000080:0.0:1788271639.827132:0:7412:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788271639.827141:0:7412:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1788271639.827286:0:7412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788271639.828610:0:7412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000020:00080000:3.0:1788271639.828822:0:7435:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1788271639.828827:0:7435:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:00080000:0.0:1788271639.829349:0:7412:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788271639.829383:0:7412:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000100:00100000:3.0:1788271639.829706:0:7437:0:(client.c:2715:ptlrpc_set_wait()) set 000000008b7e891e going to sleep for 11 seconds 00000040:00080000:0.0:1788271639.829856:0:7412:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788271639.830073:0:7412:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1788271639.830883:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788271639.831022:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788271639.831155:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788271639.831291:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788271639.831449:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788271639.831846:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788271639.831993:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788271639.832122:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788271639.832296:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788271639.832497:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788271639.832663:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788271639.832979:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788271639.833117:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788271639.833248:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788271639.833361:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788271639.837883:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788271639.838297:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788271639.838427:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788271639.838570:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00000001:00080000:2.0:1788271639.839854:0:6462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 40000000:02000000:1.0:1788271639.839933:0:6490:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:3.0:1788271639.840868:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0d3641c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7437:x1875138590025088:12345-0@lo:1000: Request processed in 14397us (14447us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788271639.840889:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:2.0:1788271639.840997:0:7437:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1788271639.841003:0:7437:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788271639.841018:0:7437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005737bad9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7437:1875138590025088:0@lo:1000: 00000100:00100000:2.0:1788271639.841112:0:7437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005737bad9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7437:1875138590025216:0@lo:1000: 00000100:00100000:2.0:1788271639.841149:0:7437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271639.841205:0:7437:0:(client.c:2715:ptlrpc_set_wait()) set 000000009adc9a8d going to sleep for 11 seconds 00100000:10000000:0.0:1788271639.841737:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788271639.841902:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788271639.842029:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788271639.842173:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788271639.842301:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788271639.842415:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788271639.842560:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788271639.842731:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788271639.842878:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788271639.843052:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788271639.843188:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788271639.843326:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00000100:00100000:3.0:1788271639.844806:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590025216 00000100:00100000:3.0:1788271639.844821:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590025216 00000100:00100000:3.0:1788271639.844885:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788271639.844894:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006fff530 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7437:x1875138590025216:12345-0@lo:1000: 00000100:00100000:3.0:1788271639.845020:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006fff530 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7437:x1875138590025216:12345-0@lo:1000: Request processed in 127us (3871us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271639.845028:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788271639.845189:0:7437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005737bad9 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7437:1875138590025216:0@lo:1000: 00000040:00080000:2.0:1788271639.845221:0:7437:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1788271639.845262:0:7437:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000008b7e891e with version 1 00000004:00080000:2.0:1788271639.845278:0:7426:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000f24ebc09 version 1 rpc_version 1 00000020:00100000:2.0:1788271639.845299:0:7426:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788271639.845315:0:7426:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000005737bad9 x1875138590025472/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788271639.845335:0:7426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005737bad9 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7426:1875138590025472:0@lo:1000: 00000100:00100000:2.0:1788271639.845370:0:7426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271639.845396:0:7426:0:(client.c:2715:ptlrpc_set_wait()) set 000000008a39cd1c going to sleep for 11 seconds 00000040:00080000:2.0:1788271639.847452:0:7437:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788271639.847538:0:7437:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1788271639.848839:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590025472 00000100:00100000:3.0:1788271639.848851:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590025472 00000100:00100000:3.0:1788271639.848915:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788271639.848924:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a27e267 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7426:x1875138590025472:12345-0@lo:1000: 00100000:10000000:0.0:1788271639.849285:0:7412:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788271639.850831:0:7412:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1788271639.852841:0:6462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:3.0:1788271639.853019:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a27e267 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7426:x1875138590025472:12345-0@lo:1000: Request processed in 4092us (7643us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788271639.853034:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788271639.853923:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b0d37ca pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7436:x1875138590024320:12345-0@lo:700: Request processed in 29968us (30316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271639.853944:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788271639.855876:0:7436:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000bba02fec x1875138590024320/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788271655 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271639.855896:0:7436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bba02fec pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7436:1875138590024320:0@lo:700: 40000000:02000000:0.0:1788271639.855911:0:7436:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000004:00080000:2.0:1788271639.859065:0:7426:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1788271639.859075:0:7426:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788271639.859096:0:7426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005737bad9 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7426:1875138590025472:0@lo:1000: 00000001:00080000:0.0:1788271639.863583:0:7412:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788271639.863875:0:7412:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa349c545f988 00100000:10000000:0.0:1788271639.863884:0:7412:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1788271639.864468:0:7412:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788271639.864503:0:7412:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.103@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788271639.864528:0:7412:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788271639.864546:0:7412:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1788271639.865464:0:7412:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788271639.869671:0:7412:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:0.0:1788271639.894449:0:7436:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788271639.906245:0:7436:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788271639.906328:0:7436:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788271639.906333:0:7436:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:0.0:1788271639.965705:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271640.991737:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271642.016422:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271643.040067:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271644.061736:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788271644.481486:0:7682:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg103-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788271645.085829:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271645.215497:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a2f52b92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875138590025728:0@lo:400: 00000100:00100000:1.0:1788271645.215573:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271645.215692:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000776c3bdd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875138590025984:0@lo:400: 00000100:00100000:3.0:1788271645.215751:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a234eefd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590025600:0@lo:400: 00000100:00100000:1.0:1788271645.215838:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788271645.215844:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000358e1916 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590025856:0@lo:400: 00000100:00100000:2.0:1788271645.216138:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271645.216211:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788271645.216217:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8551b1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590026112:0@lo:41: 00000100:00100000:2.0:1788271645.216243:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000004:0.0:1788271645.217002:0:7734:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788271645.217209:0:7734:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788271645.217409:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590025728 00000100:00100000:0.0:1788271645.217417:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590025728 00000100:00100000:0.0:1788271645.217461:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590025984 00000100:00100000:0.0:1788271645.217464:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590025984 00000100:00100000:0.0:1788271645.217479:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788271645.217486:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf1ca1fa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875138590025728:12345-0@lo:400: 00000100:00100000:0.0:1788271645.217548:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf1ca1fa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875138590025728:12345-0@lo:400: Request processed in 63us (1975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271645.217561:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788271645.217578:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788271645.217583:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005737bad9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875138590025984:12345-0@lo:400: 00000100:00100000:0.0:1788271645.217640:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005737bad9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875138590025984:12345-0@lo:400: Request processed in 36us (1482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271645.217646:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788271645.217681:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000776c3bdd x1875138590025984/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271645.217695:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000776c3bdd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875138590025984:0@lo:400: 00000100:00100000:3.0:1788271645.218330:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271645.218428:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590026112 00000100:00100000:3.0:1788271645.218435:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590026112 00000100:00100000:3.0:1788271645.218469:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788271645.218476:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7b5641f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590026112:12345-0@lo:41: 00000004:00000024:3.0:1788271645.218503:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1788271645.218545:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7b5641f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590026112:12345-0@lo:41: Request processed in 70us (2302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271645.218552:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788271645.218586:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8551b1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590026112:0@lo:41: 00000100:00100000:0.0:1788271645.220056:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788271645.220149:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000a2f52b92 x1875138590025728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271645.220164:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a2f52b92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875138590025728:0@lo:400: 00000100:00100000:2.0:1788271645.220843:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590025600 00000100:00100000:2.0:1788271645.220851:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590025600 00000100:00100000:2.0:1788271645.220900:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788271645.220909:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069c3657b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+13:3609:x1875138590025600:12345-0@lo:400: 00000100:00100000:2.0:1788271645.220977:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069c3657b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+13:3609:x1875138590025600:12345-0@lo:400: Request processed in 69us (2647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271645.220984:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788271645.221880:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a234eefd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590025600:0@lo:400: 00000100:00100000:3.0:1788271645.239212:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590025856 00000100:00100000:3.0:1788271645.239227:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590025856 00000100:00100000:1.0:1788271645.242902:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788271645.242915:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bba02fec pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590025856:12345-0@lo:400: 00000100:00100000:1.0:1788271645.243016:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bba02fec pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590025856:12345-0@lo:400: Request processed in 104us (22966us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271645.243024:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788271645.243071:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000358e1916 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590025856:0@lo:400: 00010000:00010000:0.0:1788271646.111568:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271647.133766:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788271647.986606:0:7835:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788271647.986863:0:7835:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788271648.157804:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271649.187500:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788271649.307597:0:7884:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe5f06d580 20000000:00000080:3.0:1788271649.307616:0:7884:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f6eb4b87000 uarg=0000000000000000 20000000:01000000:3.0:1788271649.307678:0:7884:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788271649.307685:0:7884:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788271649.307690:0:7884:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788271649.307762:0:7884:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1788271649.307773:0:7884:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1788271649.310187:0:7884:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788271649.311816:0:7884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788271649.311869:0:7884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1788271649.311889:0:7884:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1788271649.311911:0:7884:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788271649.311931:0:7884:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000630daea6/0x99288105fd38e3eb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271649.311951:0:7884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000fa65908e/0x99288105fd38e2cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e2c5 expref: 12 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271649.311969:0:7884:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000f9783ea/0x99288105fd38e3ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e3b3 expref: 12 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271649.311975:0:7884:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000630daea6/0x99288105fd38e3eb lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271649.312016:0:7884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000f9783ea/0x99288105fd38e3ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e3b3 expref: 12 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271649.312030:0:7884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000f9783ea/0x99288105fd38e3ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e3b3 expref: 12 pid: 6476 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271649.312044:0:7884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001899e2d8 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7884:1875138590026240:0@lo:104: 00000100:00100000:3.0:1788271649.312113:0:7884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788271649.312310:0:7884:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000fa65908e/0x99288105fd38e2cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e2c5 expref: 12 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271649.312318:0:7884:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000fa65908e/0x99288105fd38e2cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e2c5 expref: 12 pid: 6477 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271649.312326:0:7884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e9c6795b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7884:1875138590026368:0@lo:104: 00000100:00100000:3.0:1788271649.312346:0:7884:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c39abdd4 going to sleep for 11 seconds 00000100:00100000:1.0:1788271649.312706:0:6466:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788271649.312726:0:6466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271649.312756:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590026240 00000100:00100000:1.0:1788271649.312764:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590026240 00000100:00100000:2.0:1788271649.312776:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590026368 00000100:00100000:2.0:1788271649.312783:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590026368 00000100:00100000:1.0:1788271649.312805:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788271649.312814:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b4391b09 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+4:7884:x1875138590026240:12345-0@lo:104: 00010000:00010000:1.0:1788271649.312827:0:6466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: 00000000027fa5e3/0x99288105fd38e3b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e3ba expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271649.312893:0:6466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788271649.312898:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b4391b09 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+4:7884:x1875138590026240:12345-0@lo:104: Request processed in 87us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271649.312905:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788271649.312942:0:7884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001899e2d8 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7884:1875138590026240:0@lo:104: 00000100:00100000:1.0:1788271649.312948:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788271649.312955:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000358e1916 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+3:7884:x1875138590026368:12345-0@lo:104: 00010000:00010000:1.0:1788271649.312968:0:6466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: 00000000615a00c8/0x99288105fd38e2c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e2cc expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271649.313015:0:6466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788271649.313029:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000358e1916 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+3:7884:x1875138590026368:12345-0@lo:104: Request processed in 75us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271649.313037:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1788271649.313055:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788271649.313060:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: 00000000027fa5e3/0x99288105fd38e3b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e3ba expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271649.313067:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000027fa5e3 already unused, calling callback (000000008f234c73) 10000000:00010000:1.0:1788271649.313070:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: 00000000027fa5e3/0x99288105fd38e3b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e3ba expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271649.313077:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: 00000000027fa5e3/0x99288105fd38e3b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e3ba expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788271649.313084:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: 00000000027fa5e3/0x99288105fd38e3b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e3ba expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271649.313088:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788271649.313125:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: 00000000027fa5e3/0x99288105fd38e3b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e3ba expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271649.313132:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788271649.313152:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: 00000000027fa5e3/0x99288105fd38e3b3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e3ba expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271649.313158:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: 00000000027fa5e3/0x99288105fd38e3b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e3ba expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271649.313176:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271649.313179:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: 00000000615a00c8/0x99288105fd38e2c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e2cc expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271649.313185:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000615a00c8 already unused, calling callback (000000008f234c73) 10000000:00010000:1.0:1788271649.313187:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: 00000000615a00c8/0x99288105fd38e2c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e2cc expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271649.313187:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271649.313196:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: 00000000615a00c8/0x99288105fd38e2c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e2cc expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788271649.313202:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: 00000000615a00c8/0x99288105fd38e2c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e2cc expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271649.313207:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1788271649.313213:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a2d28e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590026496:0@lo:103: 00010000:00010000:1.0:1788271649.313221:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: 00000000615a00c8/0x99288105fd38e2c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e2cc expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271649.313228:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788271649.313234:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: 00000000615a00c8/0x99288105fd38e2c5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e2cc expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271649.313240:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: 00000000615a00c8/0x99288105fd38e2c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e2cc expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271649.313251:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788271649.313254:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271649.313256:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271649.313258:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271649.313270:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000024357a49 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590026624:0@lo:103: 00000100:00100000:1.0:1788271649.313316:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271649.313360:0:7884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e9c6795b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7884:1875138590026368:0@lo:104: 00010000:00010000:3.0:1788271649.313382:0:7884:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000630daea6/0x99288105fd38e3eb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271649.313438:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590026496 00000100:00100000:0.0:1788271649.313442:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590026496 00010000:00010000:0.0:1788271649.313467:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000f9783ea/0x99288105fd38e3ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e3b3 expref: 13 pid: 6476 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271649.313496:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590026624 00000100:00100000:0.0:1788271649.313500:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590026624 00010000:00010000:0.0:1788271649.313509:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000fa65908e/0x99288105fd38e2cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e2c5 expref: 14 pid: 6477 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271649.313533:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788271649.313540:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad07309b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+14:3606:x1875138590026496:12345-0@lo:103: 00010000:00010000:0.0:1788271649.313550:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271649.313554:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000f9783ea/0x99288105fd38e3ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e3b3 expref: 14 pid: 6476 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271649.313564:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000f9783ea/0x99288105fd38e3ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e3b3 expref: 14 pid: 6476 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271649.313576:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000f9783ea/0x99288105fd38e3ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e3b3 expref: 14 pid: 6476 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271649.313587:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271649.313648:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad07309b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+13:3606:x1875138590026496:12345-0@lo:103: Request processed in 109us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271649.313654:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788271649.313667:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788271649.313673:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d42bd7b8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:3607:x1875138590026624:12345-0@lo:103: 00010000:00010000:0.0:1788271649.313679:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271649.313693:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000fa65908e/0x99288105fd38e2cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e2c5 expref: 12 pid: 6477 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271649.313712:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000fa65908e/0x99288105fd38e2cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e2c5 expref: 12 pid: 6477 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271649.313721:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fa65908e/0x99288105fd38e2cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e2c5 expref: 12 pid: 6477 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271649.313731:0:6468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000630daea6/0x99288105fd38e3eb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271649.313737:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000630daea6/0x99288105fd38e3eb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271649.313748:0:6468:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000630daea6/0x99288105fd38e3eb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271649.313755:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000630daea6/0x99288105fd38e3eb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271649.313760:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000630daea6/0x99288105fd38e3eb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271649.313765:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000630daea6/0x99288105fd38e3eb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271649.313771:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000630daea6 already unused, calling callback (00000000c2bcd1c8) 00010000:00010000:0.0:1788271649.313774:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000630daea6/0x99288105fd38e3eb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271649.313780:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000630daea6/0x99288105fd38e3eb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271649.313800:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000630daea6/0x99288105fd38e3eb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271649.313809:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271649.313835:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d42bd7b8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+11:3607:x1875138590026624:12345-0@lo:103: Request processed in 162us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271649.313841:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788271649.314075:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000024357a49 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590026624:0@lo:103: 00000100:00100000:3.0:1788271649.314260:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a2d28e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590026496:0@lo:103: 00010000:00010000:3.0:1788271649.314299:0:7884:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000630daea6/0x99288105fd38e3eb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271649.314306:0:7884:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000630daea6/0x99288105fd38e3eb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271649.314312:0:7884:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000630daea6/0x99288105fd38e3eb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7884 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271649.317633:0:6480:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788271649.317640:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f6eb0cef800 from 4 10000000:01000000:1.0:1788271649.317644:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788271649.317694:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: 000000005733a7b9/0x99288105fd38e3f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271649.317707:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: 000000005733a7b9/0x99288105fd38e3f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271649.317717:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: 000000005733a7b9/0x99288105fd38e3f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271649.317738:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000024357a49 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590026752:0@lo:101: 00000100:00100000:1.0:1788271649.317802:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271649.317849:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set 00000000741a3d10 going to sleep for 11 seconds 00000100:00100000:0.0:1788271649.318260:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590026752 00000100:00100000:0.0:1788271649.318269:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590026752 00000100:00100000:0.0:1788271649.318338:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788271649.318347:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000790ab15b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+11:6480:x1875138590026752:12345-0@lo:101: 00010000:00010000:0.0:1788271649.318362:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271649.318375:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fa1e1404/0x99288105fd38e3f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e3f2 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271649.318397:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fa1e1404/0x99288105fd38e3f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e3f2 expref: 12 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271649.318407:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fa1e1404/0x99288105fd38e3f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e3f2 expref: 12 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271649.318417:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fa1e1404, rc 0) 00000100:00100000:0.0:1788271649.318462:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000790ab15b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:6480:x1875138590026752:12345-0@lo:101: Request processed in 116us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271649.318468:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788271649.320975:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000024357a49 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590026752:0@lo:101: 00010000:00010000:1.0:1788271649.321017:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: 000000005733a7b9/0x99288105fd38e3f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e3f9 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271649.321029:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: 000000005733a7b9/0x99288105fd38e3f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e3f9 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271649.321105:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000024357a49 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590026880:0@lo:256: 00000100:00100000:1.0:1788271649.321170:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271649.321215:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set 00000000741a3d10 going to sleep for 11 seconds 00000100:00100000:2.0:1788271649.322868:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590026880 00000100:00100000:2.0:1788271649.322899:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590026880 00000100:00100000:2.0:1788271649.322967:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788271649.322976:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5849b3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:6480:x1875138590026880:12345-0@lo:256: 20000000:01000000:2.0:1788271649.323006:0:6478:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788271649.323079:0:6478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788271649.323083:0:6478:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788271649.323206:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5849b3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:6480:x1875138590026880:12345-0@lo:256: Request processed in 230us (2034us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271649.323214:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788271649.323473:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000024357a49 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590026880:0@lo:256: 10000000:01000000:1.0:1788271649.323525:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788271649.323532:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: 000000005733a7b9/0x99288105fd38e3f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e3f9 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271649.323540:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: 000000005733a7b9/0x99288105fd38e3f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e3f9 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271649.323547:0:6480:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788271649.323548:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f6eb0cef800 from 1 10000000:01000000:1.0:1788271649.323550:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788271649.323574:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: 00000000d9748023/0x99288105fd38e400 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271649.323578:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: 00000000d9748023/0x99288105fd38e400 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271649.323584:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: 00000000d9748023/0x99288105fd38e400 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271649.323595:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000024357a49 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590027008:0@lo:101: 00000100:00100000:1.0:1788271649.323637:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271649.323666:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set 00000000741a3d10 going to sleep for 11 seconds 00000100:00100000:2.0:1788271649.323757:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590027008 00000100:00100000:2.0:1788271649.323763:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590027008 00000100:00100000:2.0:1788271649.323798:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788271649.323804:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ab351fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+12:6480:x1875138590027008:12345-0@lo:101: 00010000:00010000:2.0:1788271649.323813:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271649.323826:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b5b8ac9b/0x99288105fd38e407 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e400 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271649.323845:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b5b8ac9b/0x99288105fd38e407 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e400 expref: 13 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271649.323854:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b5b8ac9b/0x99288105fd38e407 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e400 expref: 13 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271649.323862:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b5b8ac9b, rc 0) 00000100:00100000:2.0:1788271649.323896:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ab351fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+13:6480:x1875138590027008:12345-0@lo:101: Request processed in 92us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271649.323901:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788271649.324087:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000024357a49 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590027008:0@lo:101: 00010000:00010000:3.0:1788271649.324099:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: 00000000d9748023/0x99288105fd38e400 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e407 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271649.324106:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: 00000000d9748023/0x99288105fd38e400 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e407 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271649.324162:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e9c6795b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590027136:0@lo:501: 00000100:00100000:3.0:1788271649.324187:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271649.324243:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c39abdd4 going to sleep for 11 seconds 00000100:00100000:0.0:1788271649.324285:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590027136 00000100:00100000:0.0:1788271649.324290:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590027136 00000100:00100000:0.0:1788271649.324324:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788271649.324338:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000380160d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+13:6480:x1875138590027136:12345-0@lo:501: 00000100:00100000:0.0:1788271649.324511:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000380160d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+13:6480:x1875138590027136:12345-0@lo:501: Request processed in 174us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271649.324519:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788271649.324601:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e9c6795b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590027136:0@lo:501: 00000100:00100000:3.0:1788271649.324764:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e9c6795b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590027264:0@lo:503: 00000100:00100000:3.0:1788271649.324801:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271649.324859:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c39abdd4 going to sleep for 11 seconds 00000100:00100000:1.0:1788271649.324886:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590027264 00000100:00100000:1.0:1788271649.324890:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590027264 00000100:00100000:1.0:1788271649.324957:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788271649.324966:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df41730d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+13:6480:x1875138590027264:12345-0@lo:503: 00000100:00100000:1.0:1788271649.325071:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df41730d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+13:6480:x1875138590027264:12345-0@lo:503: Request processed in 107us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271649.325080:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788271649.325144:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e9c6795b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590027264:0@lo:503: 00000100:00100000:3.0:1788271649.326125:0:7885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e9c6795b pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:7885:1875138590027392:0@lo:502: 00000100:00100000:3.0:1788271649.326174:0:7885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271649.330264:0:7885:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dbaa40a4 going to sleep for 11 seconds 00000100:00100000:0.0:1788271649.330540:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590027392 00000100:00100000:0.0:1788271649.330549:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590027392 00000100:00100000:0.0:1788271649.330595:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788271649.330604:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff8bafdf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+13:7885:x1875138590027392:12345-0@lo:502: 00000100:00100000:0.0:1788271649.330795:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff8bafdf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+13:7885:x1875138590027392:12345-0@lo:502: Request processed in 191us (4620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271649.330803:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788271649.341037:0:7885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e9c6795b pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:7885:1875138590027392:0@lo:502: 00000020:01000000:2.0:1788271649.341085:0:7885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788271649.341102:0:7885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271649.341105:0:7885:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788271649.341112:0:7885:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f6eb0cef800 00000020:00000080:2.0:1788271649.341115:0:7885:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788271649.341169:0:7885:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c62d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:7885:1875138590027520:0@lo:502: 00000100:00100000:2.0:1788271649.341246:0:7885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271649.341297:0:7885:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb3ded300 going to sleep for 11 seconds 00000100:00100000:0.0:1788271649.341351:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590027520 00000100:00100000:0.0:1788271649.341358:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590027520 00000100:00100000:0.0:1788271649.341412:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788271649.341422:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+13:7885:x1875138590027520:12345-0@lo:502: 00000100:00100000:0.0:1788271649.341553:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+13:7885:x1875138590027520:12345-0@lo:502: Request processed in 132us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271649.341561:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788271649.341740:0:7885:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c62d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:7885:1875138590027520:0@lo:502: 00000020:01000000:2.0:1788271649.341759:0:7885:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788271649.341764:0:7885:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271649.341766:0:7885:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788271649.341769:0:7885:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788271649.341919:0:6480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788271649.341939:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788271649.341948:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e92d32600/0x99288105fd38e400 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e407 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271649.341960:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6e92d32600/0x99288105fd38e400 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e407 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271649.341970:0:6480:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788271649.341972:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f6e91513000 from 21 10000000:01000000:0.0:1788271649.341981:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788271649.342007:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e40e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271649.342015:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e40e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271649.342024:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e40e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271649.342037:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590027648:0@lo:101: 00000100:00100000:0.0:1788271649.342066:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271649.342095:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e856bbcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271649.342139:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590027648 00000100:00100000:2.0:1788271649.342144:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590027648 00000100:00100000:2.0:1788271649.342176:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788271649.342182:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+13:6480:x1875138590027648:12345-0@lo:101: 00010000:00010000:2.0:1788271649.342190:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271649.342202:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6e813a0a00/0x99288105fd38e415 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e40e expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271649.342223:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6e813a0a00/0x99288105fd38e415 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e40e expref: 14 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271649.342232:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6e813a0a00/0x99288105fd38e415 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e40e expref: 14 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271649.342240:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e813a0a00, rc 0) 00000100:00100000:2.0:1788271649.342284:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+14:6480:x1875138590027648:12345-0@lo:101: Request processed in 102us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271649.342291:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788271649.342329:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590027648:0@lo:101: 00010000:00010000:2.0:1788271649.342340:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e40e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e415 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271649.342349:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e40e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e415 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271649.342396:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590027776:0@lo:501: 00000100:00100000:2.0:1788271649.342420:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271649.342432:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb3dedd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788271649.342443:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590027776 00000100:00100000:2.0:1788271649.342446:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590027776 00000100:00100000:2.0:1788271649.342467:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788271649.342473:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+14:6480:x1875138590027776:12345-0@lo:501: 00000100:00100000:2.0:1788271649.342570:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+14:6480:x1875138590027776:12345-0@lo:501: Request processed in 97us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271649.342577:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788271649.342602:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590027776:0@lo:501: 00000100:00100000:2.0:1788271649.342647:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590027904:0@lo:503: 00000100:00100000:2.0:1788271649.342677:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271649.342694:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb3dedd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788271649.342703:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590027904 00000100:00100000:2.0:1788271649.342707:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590027904 00000100:00100000:2.0:1788271649.342722:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788271649.342727:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+14:6480:x1875138590027904:12345-0@lo:503: 00000100:00100000:2.0:1788271649.342787:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+14:6480:x1875138590027904:12345-0@lo:503: Request processed in 60us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271649.342801:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788271649.342830:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590027904:0@lo:503: 00000100:00100000:2.0:1788271649.342984:0:7887:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c62d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:7887:1875138590028032:0@lo:502: 00000100:00100000:2.0:1788271649.343015:0:7887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271649.343033:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590028032 00000100:00100000:2.0:1788271649.343036:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590028032 00000100:00100000:2.0:1788271649.343056:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788271649.343060:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+14:7887:x1875138590028032:12345-0@lo:502: 00000100:00100000:2.0:1788271649.343119:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+14:7887:x1875138590028032:12345-0@lo:502: Request processed in 57us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271649.343125:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788271649.343147:0:7887:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb3ded6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271649.343158:0:7887:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c62d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:7887:1875138590028032:0@lo:502: 00000100:00100000:2.0:1788271649.343188:0:7887:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c62d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:7887:1875138590028160:0@lo:502: 00000100:00100000:2.0:1788271649.343215:0:7887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271649.343230:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590028160 00000100:00100000:2.0:1788271649.343233:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590028160 00000100:00100000:2.0:1788271649.343250:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788271649.343255:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+14:7887:x1875138590028160:12345-0@lo:502: 00000100:00100000:2.0:1788271649.343318:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+14:7887:x1875138590028160:12345-0@lo:502: Request processed in 61us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271649.343324:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788271649.343348:0:7887:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb35cf780 going to sleep for 11 seconds 00000100:00100000:2.0:1788271649.343358:0:7887:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c62d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:7887:1875138590028160:0@lo:502: 00000040:00080000:2.0:1788271649.343375:0:7887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1788271649.343412:0:6480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1788271649.343425:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788271649.343431:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e40e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e415 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271649.343439:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e40e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e415 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271649.343446:0:6480:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788271649.343448:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f6e91513000 from 4 10000000:01000000:2.0:1788271649.343450:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788271649.343466:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e813a1600/0x99288105fd38e41c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271649.343473:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6e813a1600/0x99288105fd38e41c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271649.343479:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6e813a1600/0x99288105fd38e41c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271649.343488:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590028288:0@lo:101: 00000100:00100000:2.0:1788271649.343508:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271649.343519:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb35cf780 going to sleep for 11 seconds 00000100:00100000:2.0:1788271649.343529:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590028288 00000100:00100000:2.0:1788271649.343532:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590028288 00000100:00100000:2.0:1788271649.343548:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788271649.343553:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+14:6480:x1875138590028288:12345-0@lo:101: 00010000:00010000:2.0:1788271649.343559:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271649.343567:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6e813a1400/0x99288105fd38e423 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e41c expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271649.343593:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6e813a1400/0x99288105fd38e423 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e41c expref: 15 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271649.343601:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6e813a1400/0x99288105fd38e423 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e41c expref: 15 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271649.343608:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e813a1400, rc 0) 00000100:00100000:2.0:1788271649.343662:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:6480:x1875138590028288:12345-0@lo:101: Request processed in 108us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271649.343667:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788271649.343694:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590028288:0@lo:101: 00010000:00010000:2.0:1788271649.343704:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6e813a1600/0x99288105fd38e41c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e423 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271649.343712:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6e813a1600/0x99288105fd38e41c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e423 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271649.343752:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590028416:0@lo:256: 00000100:00100000:2.0:1788271649.343778:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271649.343797:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb35cf780 going to sleep for 11 seconds 00000100:00100000:2.0:1788271649.343807:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590028416 00000100:00100000:2.0:1788271649.343810:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590028416 00000100:00100000:2.0:1788271649.343830:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788271649.343836:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:6480:x1875138590028416:12345-0@lo:256: 20000000:01000000:2.0:1788271649.343847:0:6478:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788271649.343863:0:6478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788271649.343866:0:6478:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788271649.343934:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:6480:x1875138590028416:12345-0@lo:256: Request processed in 97us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271649.343940:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788271649.343967:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590028416:0@lo:256: 10000000:01000000:2.0:1788271649.344003:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788271649.344008:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e813a1600/0x99288105fd38e41c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e423 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271649.344015:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6e813a1600/0x99288105fd38e41c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e423 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271649.344023:0:6480:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788271649.344024:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1788271649.344026:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788271649.344040:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e813a0200/0x99288105fd38e42a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271649.344047:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6e813a0200/0x99288105fd38e42a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271649.344054:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6e813a0200/0x99288105fd38e42a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271649.344064:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590028544:0@lo:101: 00000100:00100000:2.0:1788271649.344086:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271649.344098:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb35cf780 going to sleep for 11 seconds 00000100:00100000:2.0:1788271649.344107:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590028544 00000100:00100000:2.0:1788271649.344111:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590028544 00000100:00100000:2.0:1788271649.344132:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788271649.344136:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:6480:x1875138590028544:12345-0@lo:101: 00010000:00010000:2.0:1788271649.344147:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271649.344156:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6e813a0600/0x99288105fd38e431 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e42a expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271649.344168:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6e813a0600/0x99288105fd38e431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e42a expref: 16 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271649.344177:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6e813a0600/0x99288105fd38e431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e42a expref: 16 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271649.344183:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e813a0600, rc 0) 00000100:00100000:2.0:1788271649.344211:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:6480:x1875138590028544:12345-0@lo:101: Request processed in 74us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271649.344217:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788271649.344244:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590028544:0@lo:101: 00010000:00010000:2.0:1788271649.344254:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6e813a0200/0x99288105fd38e42a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e431 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271649.344261:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6e813a0200/0x99288105fd38e42a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e431 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271649.344314:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590028672:0@lo:501: 00000100:00100000:2.0:1788271649.344337:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271649.344350:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb35cf780 going to sleep for 11 seconds 00000100:00100000:2.0:1788271649.344359:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590028672 00000100:00100000:2.0:1788271649.344362:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590028672 00000100:00100000:2.0:1788271649.344382:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788271649.344387:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:6480:x1875138590028672:12345-0@lo:501: 00000100:00100000:2.0:1788271649.344478:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:6480:x1875138590028672:12345-0@lo:501: Request processed in 90us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271649.344483:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788271649.344511:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590028672:0@lo:501: 00000100:00100000:2.0:1788271649.344534:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590028800:0@lo:503: 00000100:00100000:2.0:1788271649.344566:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271649.344578:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb3dedb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788271649.344588:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590028800 00000100:00100000:2.0:1788271649.344591:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590028800 00000100:00100000:2.0:1788271649.344608:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788271649.344614:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:6480:x1875138590028800:12345-0@lo:503: 00000100:00100000:2.0:1788271649.344702:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:6480:x1875138590028800:12345-0@lo:503: Request processed in 87us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271649.344708:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788271649.344744:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590028800:0@lo:503: 00000100:00100000:0.0:1788271649.355801:0:7888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:7888:1875138590028928:0@lo:502: 00000100:00100000:0.0:1788271649.355889:0:7888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271649.355940:0:7888:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e856bbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788271649.356003:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590028928 00000100:00100000:2.0:1788271649.356010:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590028928 00000100:00100000:2.0:1788271649.356074:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788271649.356084:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:7888:x1875138590028928:12345-0@lo:502: 00000100:00100000:2.0:1788271649.356201:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:7888:x1875138590028928:12345-0@lo:502: Request processed in 118us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271649.356209:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788271649.356352:0:7888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:7888:1875138590028928:0@lo:502: 00000020:01000000:0.0:1788271649.356380:0:7888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788271649.356391:0:7888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271649.356393:0:7888:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1788271649.356398:0:7888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788271649.356402:0:7888:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.103@tcp to nid 0x20000c0a8c967 (192.168.201.103@tcp) 00000020:00000080:0.0:1788271649.356425:0:7888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788271649.356439:0:7888:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8f6ea6bf3370) 00000020:00000080:0.0:1788271649.356458:0:7888:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:0.0:1788271649.356464:0:7888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788271649.356554:0:7888:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1788271649.356559:0:7888:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788271649.356566:0:7888:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x99288105fd38e43f 00010000:00080000:0.0:1788271649.356595:0:7888:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f6eb4c7d800@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.103@tcp at head 00010000:00010000:2.0:1788271649.363573:0:7888:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:2.0:1788271649.368470:0:7888:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788271649.368486:0:7888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788271649.368527:0:7888:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788271649.368550:0:7888:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x99288105fd38e446 00000100:00080000:2.0:1788271649.368560:0:7888:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788271649.368566:0:7888:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8f6eb4c7d800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788271649.368601:0:7888:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6eb0c62d80 x1875138590029056/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788271649.368767:0:7888:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:2.0:1788271649.368807:0:7888:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1788271649.369147:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788271649.369162:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0ccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875138590029440:0@lo:400: 00000100:00100000:1.0:1788271649.369227:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271649.369329:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0ccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875138590029184:0@lo:400: 00000100:00100000:3.0:1788271649.369361:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271649.369392:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788271649.369398:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0ccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590029312:0@lo:400: 00000100:00100000:3.0:1788271649.369422:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271649.369456:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590029312 00000100:00100000:3.0:1788271649.369463:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590029312 00000100:00100000:3.0:1788271649.369503:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788271649.369512:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e8580bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590029312:12345-0@lo:400: 00000100:00100000:3.0:1788271649.369562:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e8580bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590029312:12345-0@lo:400: Request processed in 51us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271649.369569:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788271649.369607:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0ccdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590029312:0@lo:400: 00000100:00100000:0.0:1788271649.369718:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3605:1875138590029056:0@lo:38: 00000100:00100000:0.0:1788271649.369749:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271649.369883:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590029440 00000100:00100000:0.0:1788271649.369888:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590029440 00000100:00100000:0.0:1788271649.369915:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590029184 00000100:00100000:0.0:1788271649.369919:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590029184 00000100:00100000:0.0:1788271649.369933:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788271649.369939:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0ccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875138590029440:12345-0@lo:400: 00000100:00100000:0.0:1788271649.369977:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0ccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875138590029440:12345-0@lo:400: Request processed in 38us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271649.369983:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788271649.369995:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788271649.370000:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e8580b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875138590029184:12345-0@lo:400: 00000100:00100000:0.0:1788271649.370092:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e8580b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875138590029184:12345-0@lo:400: Request processed in 92us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271649.370098:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788271649.370130:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f6eb0ccf800 x1875138590029440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271649.370141:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0ccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875138590029440:0@lo:400: 00010000:00080000:0.0:1788271649.370162:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f6eb0ccd500 x1875138590029184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271649.370172:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0ccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875138590029184:0@lo:400: 00000100:00100000:3.0:1788271649.371395:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590029056 00000100:00100000:3.0:1788271649.371403:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590029056 00000100:00100000:3.0:1788271649.371435:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788271649.371444:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3605:x1875138590029056:12345-0@lo:38: 00010000:00080000:3.0:1788271649.371470:0:6489:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:3.0:1788271649.371507:0:6489:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x99288105fd38e44d 00000004:00100000:3.0:1788271649.371880:0:6489:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788271649.371886:0:6489:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1788271649.376703:0:7893:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8f6e85809500 x1875138590029568/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271649.376718:0:7893:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9836c6c0 going to sleep for 0 seconds 00000020:01000000:2.0:1788271649.377758:0:7888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788271649.377767:0:7888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271649.377769:0:7888:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788271649.377774:0:7888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788271649.377778:0:7888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271649.377779:0:7888:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788271649.377782:0:7888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788271649.377784:0:7888:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788271649.377817:0:7888:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c61f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:7888:1875138590029696:0@lo:502: 00000100:00100000:2.0:1788271649.378052:0:7888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271649.378123:0:7888:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84cca3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271649.378223:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590029696 00000100:00100000:0.0:1788271649.378229:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590029696 00000100:00100000:0.0:1788271649.378307:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788271649.378317:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:7888:x1875138590029696:12345-0@lo:502: 00000100:00100000:0.0:1788271649.378453:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:7888:x1875138590029696:12345-0@lo:502: Request processed in 138us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271649.378461:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788271649.378578:0:7888:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c61f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:7888:1875138590029696:0@lo:502: 00000020:01000000:2.0:1788271649.378604:0:7888:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788271649.378608:0:7888:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271649.378609:0:7888:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788271649.378612:0:7888:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1788271649.378679:0:6480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1788271649.378709:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788271649.378719:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e813a0200/0x99288105fd38e42a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e431 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271649.378729:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6e813a0200/0x99288105fd38e42a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e431 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271649.378742:0:6480:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788271649.378745:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f6e91513000 from 1 10000000:01000000:2.0:1788271649.378748:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788271649.378774:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21000/0x99288105fd38e454 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271649.378781:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21000/0x99288105fd38e454 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271649.378790:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21000/0x99288105fd38e454 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271649.378800:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590029824:0@lo:101: 00000100:00100000:2.0:1788271649.378825:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271649.378856:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84cca3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271649.380237:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590029824 00000100:00100000:0.0:1788271649.380245:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590029824 00000100:00100000:0.0:1788271649.380328:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788271649.380337:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:6480:x1875138590029824:12345-0@lo:101: 00010000:00010000:0.0:1788271649.380349:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271649.380363:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4079800/0x99288105fd38e45b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e454 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271649.380398:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4079800/0x99288105fd38e45b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e454 expref: 17 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271649.380410:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4079800/0x99288105fd38e45b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e454 expref: 17 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271649.380419:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4079800, rc 0) 00000100:00100000:0.0:1788271649.380470:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:6480:x1875138590029824:12345-0@lo:101: Request processed in 135us (1644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271649.380476:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788271649.380484:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590029824:0@lo:101: 00010000:00010000:3.0:1788271649.380777:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21000/0x99288105fd38e454 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e45b expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271649.380788:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21000/0x99288105fd38e454 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e45b expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271649.380859:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85808380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590029952:0@lo:501: 00000100:00100000:3.0:1788271649.380888:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271649.380915:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9014b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271649.380927:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590029952 00000100:00100000:3.0:1788271649.380931:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590029952 00000100:00100000:3.0:1788271649.380950:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788271649.380956:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:6480:x1875138590029952:12345-0@lo:501: 00000100:00100000:3.0:1788271649.381067:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:6480:x1875138590029952:12345-0@lo:501: Request processed in 110us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271649.381073:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788271649.381101:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85808380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590029952:0@lo:501: 00000100:00100000:3.0:1788271649.381126:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85808380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590030080:0@lo:503: 00000100:00100000:3.0:1788271649.381160:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271649.381172:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9014b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271649.381181:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590030080 00000100:00100000:3.0:1788271649.381184:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590030080 00000100:00100000:3.0:1788271649.381199:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788271649.381204:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:6480:x1875138590030080:12345-0@lo:503: 00000100:00100000:3.0:1788271649.381268:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:6480:x1875138590030080:12345-0@lo:503: Request processed in 63us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271649.381286:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788271649.381324:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85808380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590030080:0@lo:503: 00000100:00100000:3.0:1788271649.381968:0:7895:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85808380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:7895:1875138590030208:0@lo:502: 00000100:00100000:3.0:1788271649.382010:0:7895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271649.382087:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590030208 00000100:00100000:3.0:1788271649.382092:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590030208 00000100:00100000:3.0:1788271649.382118:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788271649.382125:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:7895:x1875138590030208:12345-0@lo:502: 00000100:00100000:3.0:1788271649.382199:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:7895:x1875138590030208:12345-0@lo:502: Request processed in 73us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271649.382205:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788271649.382241:0:7895:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9014b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271649.382255:0:7895:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85808380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:7895:1875138590030208:0@lo:502: 00000020:01000000:3.0:1788271649.382287:0:7895:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788271649.382297:0:7895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271649.382299:0:7895:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788271649.382307:0:7895:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f6e91513000 00000020:00000080:3.0:1788271649.382309:0:7895:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788271649.382329:0:7895:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85808380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:7895:1875138590030336:0@lo:502: 00000100:00100000:3.0:1788271649.382361:0:7895:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271649.382375:0:7895:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9014b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271649.382665:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590030336 00000100:00100000:3.0:1788271649.382670:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590030336 00000100:00100000:3.0:1788271649.382697:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788271649.382705:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:7895:x1875138590030336:12345-0@lo:502: 00000100:00100000:3.0:1788271649.382769:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:7895:x1875138590030336:12345-0@lo:502: Request processed in 64us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271649.382776:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788271649.382815:0:7895:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85808380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:7895:1875138590030336:0@lo:502: 00000020:01000000:3.0:1788271649.382832:0:7895:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788271649.382835:0:7895:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271649.382837:0:7895:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788271649.382841:0:7895:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788271649.382887:0:6480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788271649.382903:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788271649.382911:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21000/0x99288105fd38e454 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e45b expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271649.382919:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21000/0x99288105fd38e454 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e45b expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271649.382927:0:6480:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788271649.382929:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f6e85beb370 from 1 10000000:01000000:3.0:1788271649.382932:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788271649.382953:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfc00/0x99288105fd38e462 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271649.382961:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfc00/0x99288105fd38e462 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271649.382970:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfc00/0x99288105fd38e462 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271649.382982:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85808380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590030464:0@lo:101: 00000100:00100000:3.0:1788271649.383006:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271649.383310:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590030464 00000100:00100000:1.0:1788271649.383314:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590030464 00000100:00100000:1.0:1788271649.383339:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788271649.383346:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:6480:x1875138590030464:12345-0@lo:101: 00010000:00010000:1.0:1788271649.383354:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271649.383366:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6e92d32800/0x99288105fd38e469 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e462 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271649.383490:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6e92d32800/0x99288105fd38e469 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e462 expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271649.383504:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6e92d32800/0x99288105fd38e469 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e462 expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271649.383512:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e92d32800, rc 0) 00000100:00100000:1.0:1788271649.384980:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+18:6480:x1875138590030464:12345-0@lo:101: Request processed in 1628us (1966us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271649.384990:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788271649.385540:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9014b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271649.385569:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85808380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590030464:0@lo:101: 00010000:00010000:3.0:1788271649.385592:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfc00/0x99288105fd38e462 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e469 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271649.385641:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfc00/0x99288105fd38e462 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e469 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271649.385721:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85808380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590030592:0@lo:501: 00000100:00100000:3.0:1788271649.385757:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271649.385780:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9014b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271649.385803:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590030592 00000100:00100000:3.0:1788271649.385808:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590030592 00000100:00100000:3.0:1788271649.385836:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788271649.385845:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+18:6480:x1875138590030592:12345-0@lo:501: 00000100:00100000:3.0:1788271649.385922:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+18:6480:x1875138590030592:12345-0@lo:501: Request processed in 78us (165us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788271649.385929:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788271649.385956:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85808380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590030592:0@lo:501: 10000000:01000000:3.0:1788271649.385981:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788271649.385987:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfc00/0x99288105fd38e462 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e469 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271649.385995:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfc00/0x99288105fd38e462 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e469 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788271649.390701:0:6489:0:(import.c:65:import_set_state_nolock()) ffff8f6eb3d38000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788271649.390787:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3605:x1875138590029056:12345-0@lo:38: Request processed in 19342us (21035us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271649.390798:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788271649.391013:0:3605:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788271649.391023:0:3605:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788271649.391031:0:3605:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788271649.391037:0:3605:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788271649.391039:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6eb4c7d800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788271649.391061:0:3605:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000004b831822): req@ffff8f6e85809500 x1875138590029568/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271649.391098:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3605:1875138590029056:0@lo:38: 00000100:00100000:1.0:1788271649.391199:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788271649.391211:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0ccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590030720:0@lo:41: 00000100:00100000:1.0:1788271649.391252:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271649.391362:0:7893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271649.391386:0:7893:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9836c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271649.391425:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590030720 00000100:00100000:1.0:1788271649.391436:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590030720 00000100:00100000:1.0:1788271649.391461:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590029568 00000100:00100000:1.0:1788271649.391463:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590029568 00000100:00100000:1.0:1788271649.391474:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788271649.391482:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0ccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3606:x1875138590030720:12345-0@lo:41: 00000004:00000024:1.0:1788271649.391504:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788271649.391548:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0ccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3606:x1875138590030720:12345-0@lo:41: Request processed in 66us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271649.391554:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788271649.391568:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788271649.391573:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e85808380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7893:x1875138590029568:12345-0@lo:1000: 00000100:00100000:1.0:1788271649.391645:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e85808380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7893:x1875138590029568:12345-0@lo:1000: Request processed in 71us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271649.391651:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788271649.391721:0:7893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85809500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7893:1875138590029568:0@lo:1000: 00000040:01000000:3.0:1788271649.391753:0:7893:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788271649.391784:0:7893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85809500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7893:1875138590030848:0@lo:1000: 00000100:00100000:3.0:1788271649.391819:0:7893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271649.391842:0:7893:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9014b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271649.391867:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0ccea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590030720:0@lo:41: 00000100:00100000:0.0:1788271649.391990:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590030848 00000100:00100000:0.0:1788271649.391994:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590030848 00000100:00100000:0.0:1788271649.392014:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788271649.392020:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e8580b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7893:x1875138590030848:12345-0@lo:1000: 00000100:00100000:0.0:1788271649.392122:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e8580b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7893:x1875138590030848:12345-0@lo:1000: Request processed in 101us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271649.392129:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788271649.392824:0:7893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85809500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7893:1875138590030848:0@lo:1000: 00000100:00100000:3.0:1788271649.392870:0:7893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85809500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7893:1875138590030976:0@lo:700: 00000100:00100000:3.0:1788271649.392900:0:7893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271649.392926:0:7893:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9014b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271649.392969:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590030976 00000100:00100000:1.0:1788271649.392973:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590030976 00000100:00100000:1.0:1788271649.393009:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788271649.393017:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e85809880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7893:x1875138590030976:12345-0@lo:700: 00000100:00100000:1.0:1788271649.393059:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e85809880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7893:x1875138590030976:12345-0@lo:700: Request processed in 44us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271649.393065:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788271649.393208:0:7893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85809500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7893:1875138590030976:0@lo:700: 00000100:00100000:3.0:1788271649.393307:0:7893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85809500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7893:1875138590031104:0@lo:1000: 00000100:00100000:3.0:1788271649.393332:0:7893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271649.393491:0:7893:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9014bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788271649.397803:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590031104 00000100:00100000:1.0:1788271649.397815:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590031104 00000100:00100000:1.0:1788271649.397878:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788271649.397888:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e85808700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7893:x1875138590031104:12345-0@lo:1000: 00000100:00100000:1.0:1788271649.398024:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e85808700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7893:x1875138590031104:12345-0@lo:1000: Request processed in 137us (4691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271649.398032:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788271649.398139:0:7893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85809500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7893:1875138590031104:0@lo:1000: 00000004:00080000:2.0:1788271649.398205:0:7893:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8f6e9014b3c0 with version 0 00000020:00100000:2.0:1788271649.398228:0:7893:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788271649.398234:0:7893:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8f6eb0c62680 x1875138590031360/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788271649.398254:0:7893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c62680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7893:1875138590031360:0@lo:1000: 00000100:00100000:2.0:1788271649.398301:0:7893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271649.398330:0:7893:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84ccac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788271649.398366:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590031360 00000100:00100000:3.0:1788271649.398369:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590031360 00000100:00100000:3.0:1788271649.398392:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788271649.398397:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7893:x1875138590031360:12345-0@lo:1000: 00000001:00080000:2.0:1788271649.407107:0:7414:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:2.0:1788271649.407122:0:7414:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788271649.407293:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7893:x1875138590031360:12345-0@lo:1000: Request processed in 8890us (8986us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788271649.407306:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:2.0:1788271649.407401:0:7893:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1788271649.407407:0:7893:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788271649.407435:0:7893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c62680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7893:1875138590031360:0@lo:1000: 00000100:00100000:2.0:1788271649.407520:0:7893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c62680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7893:1875138590031488:0@lo:1000: 00000100:00100000:2.0:1788271649.407556:0:7893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271649.407585:0:7893:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84ccae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788271649.407646:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590031488 00000100:00100000:1.0:1788271649.407653:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590031488 00000100:00100000:1.0:1788271649.407702:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788271649.407712:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7893:x1875138590031488:12345-0@lo:1000: 00000100:00100000:1.0:1788271649.407788:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7893:x1875138590031488:12345-0@lo:1000: Request processed in 77us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271649.407794:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788271649.408005:0:7893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c62680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7893:1875138590031488:0@lo:1000: 00000040:00080000:2.0:1788271649.408021:0:7893:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1788271649.408048:0:7893:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff8f6e84ccac00 with version 1 00000004:00080000:3.0:1788271649.410800:0:7890:0:(osp_trans.c:1336:osp_get_next_request()) ou ffff8f6eb35cf780 version 1 rpc_version 1 00000020:00100000:3.0:1788271649.410847:0:7890:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788271649.410859:0:7890:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8f6e85808a80 x1875138590031744/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788271649.410881:0:7890:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85808a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7890:1875138590031744:0@lo:1000: 00000100:00100000:3.0:1788271649.410945:0:7890:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271649.410982:0:7890:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9014b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271649.411048:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590031744 00000100:00100000:1.0:1788271649.411056:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590031744 00000100:00100000:1.0:1788271649.411111:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788271649.411120:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e8580a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7890:x1875138590031744:12345-0@lo:1000: 00000040:00080000:2.0:1788271649.413966:0:7893:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788271649.414057:0:7893:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788271649.414062:0:7893:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:3.0:1788271649.428113:0:7414:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:1.0:1788271649.428288:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e8580a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7890:x1875138590031744:12345-0@lo:1000: Request processed in 17165us (17339us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788271649.428300:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:3.0:1788271649.428384:0:7890:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1788271649.428389:0:7890:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788271649.428404:0:7890:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85808a80 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7890:1875138590031744:0@lo:1000: 00010000:00010000:3.0:1788271650.211796:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271650.334127:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590031872:0@lo:41: 00000100:00100000:0.0:1788271650.334234:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271650.334389:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590031872 00000100:00100000:2.0:1788271650.334400:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590031872 00000100:00100000:2.0:1788271650.334464:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788271650.334474:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590031872:12345-0@lo:41: 00000004:00000024:2.0:1788271650.334529:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1788271650.334589:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590031872:12345-0@lo:41: Request processed in 116us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271650.334597:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788271650.334676:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590031872:0@lo:41: 00010000:00010000:1.0:1788271651.230505:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271652.253850:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271653.278734:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271654.301974:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271654.431694:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788271654.431720:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590032000:0@lo:41: 00000100:00100000:3.0:1788271654.431748:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590032128:0@lo:400: 00000100:00100000:2.0:1788271654.431957:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e8580ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875138590032512:0@lo:400: 00000100:00100000:3.0:1788271654.432248:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271654.432295:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590032640:0@lo:400: 00000100:00100000:3.0:1788271654.432324:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271654.432352:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788271654.432360:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875138590032256:0@lo:400: 00000100:00100000:3.0:1788271654.432386:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271654.432422:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590032128 00000100:00100000:3.0:1788271654.432430:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590032128 00000100:00100000:3.0:1788271654.432477:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788271654.432487:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+18:3606:x1875138590032128:12345-0@lo:400: 00000100:00100000:3.0:1788271654.432536:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+18:3606:x1875138590032128:12345-0@lo:400: Request processed in 50us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271654.432543:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788271654.432575:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590032640 00000100:00100000:3.0:1788271654.432579:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590032640 00000100:00100000:3.0:1788271654.432603:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788271654.432611:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e85809180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590032640:12345-0@lo:400: 00000100:00100000:3.0:1788271654.432674:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e85809180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590032640:12345-0@lo:400: Request processed in 64us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271654.432679:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788271654.432698:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590032256 00000100:00100000:3.0:1788271654.432701:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590032256 00000100:00100000:1.0:1788271654.432716:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271654.432738:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788271654.432753:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e85808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875138590032256:12345-0@lo:400: 00000100:00100000:3.0:1788271654.432798:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e85808000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875138590032256:12345-0@lo:400: Request processed in 45us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271654.432806:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788271654.432826:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590032000 00000100:00100000:3.0:1788271654.432829:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590032000 00000100:00100000:1.0:1788271654.432834:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590032384:0@lo:400: 00000100:00100000:1.0:1788271654.432862:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271654.432973:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590032384 00000100:00100000:3.0:1788271654.432977:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590032384 00000100:00100000:3.0:1788271654.432995:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788271654.433002:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590032000:12345-0@lo:41: 00000004:00000024:3.0:1788271654.433025:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788271654.433075:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590032000:12345-0@lo:41: Request processed in 73us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271654.433081:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788271654.433092:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788271654.433098:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0ccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590032384:12345-0@lo:400: 00000100:00100000:3.0:1788271654.433124:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0ccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590032384:12345-0@lo:400: Request processed in 27us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271654.433129:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1788271654.433176:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f6e85809500 x1875138590032256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271654.433203:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875138590032256:0@lo:400: 00000100:00100000:3.0:1788271654.433218:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590032128:0@lo:400: 00000100:00100000:1.0:1788271654.433229:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590032384:0@lo:400: 00000100:00100000:3.0:1788271654.433234:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590032640:0@lo:400: 00000100:00100000:1.0:1788271654.433253:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590032000:0@lo:41: 00000100:00100000:2.0:1788271654.434873:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271654.435222:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590032512 00000100:00100000:1.0:1788271654.435234:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590032512 00000100:00100000:1.0:1788271654.435282:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788271654.435291:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875138590032512:12345-0@lo:400: 00000100:00100000:1.0:1788271654.435339:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875138590032512:12345-0@lo:400: Request processed in 50us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271654.435346:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788271654.436993:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f6e8580ad80 x1875138590032512/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271654.437025:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e8580ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875138590032512:0@lo:400: 00010000:00010000:1.0:1788271655.331848:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271655.458574:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590032768:0@lo:41: 00000100:00100000:3.0:1788271655.458670:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271655.458938:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590032768 00000100:00100000:1.0:1788271655.458948:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590032768 00000100:00100000:1.0:1788271655.459020:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788271655.459031:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e8580ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590032768:12345-0@lo:41: 00000004:00000024:1.0:1788271655.459070:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1788271655.459343:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e8580ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590032768:12345-0@lo:41: Request processed in 313us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271655.459351:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788271655.459490:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590032768:0@lo:41: 00010000:00010000:3.0:1788271656.349959:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271657.374186:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271658.398418:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788271658.623354:0:8389:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788271658.623369:0:8389:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788271658.623371:0:8389:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788271658.623508:0:8389:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f6eb4b8b800 00000020:01000004:3.0:1788271658.623524:0:8389:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788271658.623537:0:8389:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788271658.624651:0:8389:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8f6e85be99b8) 00000020:00000080:3.0:1788271658.624676:0:8389:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788271658.687096:0:8389:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788271658.687164:0:8389:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:3.0:1788271658.743584:0:8389:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788271658.743852:0:8389:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788271658.743864:0:8389:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788271658.743879:0:8389:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x99288105fd38e477 00000020:01000004:3.0:1788271658.743886:0:8389:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788271658.743908:0:8389:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.103@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788271658.743911:0:8389:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788271658.743917:0:8389:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788271658.743921:0:8389:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788271658.743939:0:8389:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8f6ebc990000) 00000020:00000080:3.0:1788271658.743952:0:8389:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:3.0:1788271658.746320:0:8389:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788271658.746516:0:8389:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788271658.746522:0:8389:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788271658.748050:0:8389:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788271658.748059:0:8389:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788271658.749344:0:8389:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788271658.749355:0:8389:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788271658.755220:0:8389:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788271658.755408:0:8389:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788271658.755414:0:8389:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788271658.759207:0:8389:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788271658.759233:0:8389:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788271658.805567:0:8389:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788271658.805869:0:8389:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788271658.805876:0:8389:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788271658.807167:0:8389:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788271658.807176:0:8389:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788271658.814297:0:8389:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788271658.814320:0:8389:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788271658.816911:0:8389:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788271658.817131:0:8389:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788271658.817139:0:8389:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788271658.817932:0:8389:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788271658.817939:0:8389:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788271658.912444:0:8389:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788271658.912668:0:8389:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788271658.912689:0:8389:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788271658.917451:0:8389:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788271658.917475:0:8389:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788271658.917894:0:8389:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788271658.917924:0:8389:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1788271658.917932:0:8389:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.103@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788271658.943462:0:8389:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.103@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788271658.943518:0:8389:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.103@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1788271658.943523:0:8389:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788271658.943525:0:8389:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788271658.943527:0:8389:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788271658.943528:0:8389:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788271658.943529:0:8389:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788271658.943531:0:8389:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788271658.943597:0:8389:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788271658.943599:0:8389:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788271658.943600:0:8389:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788271658.943602:0:8389:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788271658.943603:0:8389:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788271658.943607:0:8389:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1788271658.943609:0:8389:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788271658.943610:0:8389:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788271658.943611:0:8389:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788271658.943612:0:8389:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788271658.943613:0:8389:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788271658.943614:0:8389:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788271658.943615:0:8389:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788271658.943616:0:8389:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788271658.943729:0:8389:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788271658.943730:0:8389:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788271658.943731:0:8389:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788271658.943761:0:8389:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788271658.943781:0:8389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0cce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:8389:1875138590032896:0@lo:253: 00000100:00100000:1.0:1788271658.943855:0:8389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271658.944146:0:8389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9172ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1788271658.944194:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590032896 00000100:00100000:0.0:1788271658.944202:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590032896 00000100:00100000:0.0:1788271658.945498:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788271658.945516:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+18:8389:x1875138590032896:12345-0@lo:253: 20000000:01000000:0.0:1788271658.945587:0:6477:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788271658.945596:0:6477:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788271658.945602:0:6477:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788271658.945605:0:6477:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788271658.945887:0:6477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788271658.946039:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788271658.946055:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788271658.946072:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788271658.946078:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788271658.946090:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788271658.946116:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788271658.946206:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788271658.946223:0:6477:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.103@tcp 20000000:01000000:0.0:1788271658.946225:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.103@tcp (null) (null) (null) 00000040:00080000:0.0:1788271658.946241:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788271658.946247:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788271658.946261:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788271658.946266:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.103@tcp (null) (null) 00000040:00080000:0.0:1788271658.946278:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788271658.946285:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788271658.946298:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788271658.946313:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788271658.946470:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:0.0:1788271658.946482:0:6477:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.103@tcp 20000000:01000000:0.0:1788271658.946484:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.103@tcp (null) (null) (null) 00000040:00080000:0.0:1788271658.946497:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:0.0:1788271658.946503:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788271658.946516:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:0.0:1788271658.946522:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.201.103@tcp (null) (null) 00000040:00080000:0.0:1788271658.946535:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:0.0:1788271658.946541:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788271658.946554:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:0.0:1788271658.946582:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1788271658.947264:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1788271658.947280:0:6477:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.103@tcp 20000000:01000000:0.0:1788271658.947282:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.103@tcp (null) (null) (null) 00000040:00080000:0.0:1788271658.947296:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1788271658.947301:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788271658.947315:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1788271658.947320:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.103@tcp (null) (null) 00000040:00080000:0.0:1788271658.947332:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1788271658.947338:0:6477:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788271658.947349:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1788271658.947380:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:0.0:1788271658.947395:0:6477:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788271658.947398:0:6477:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788271658.947403:0:6477:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788271658.947456:0:6477:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1788271658.947459:0:6477:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788271658.948175:0:8408:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:2.0:1788271658.948203:0:8408:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:2.0:1788271658.948220:0:8408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:0.0:1788271658.948499:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:0.0:1788271658.948523:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:0.0:1788271658.948611:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:0.0:1788271658.948831:0:6477:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788271658.948834:0:6477:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788271658.949267:0:8409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1788271658.949582:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1788271658.949605:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1788271658.949651:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1788271658.949663:0:6477:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788271658.949665:0:6477:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788271658.950201:0:8410:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:1.0:1788271658.950221:0:8410:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:1.0:1788271658.950234:0:8410:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1788271658.950449:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:0.0:1788271658.950470:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:0.0:1788271658.950484:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:0.0:1788271658.950493:0:6477:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788271658.950495:0:6477:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788271658.950833:0:8411:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:0.0:1788271658.950857:0:8411:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:0.0:1788271658.950873:0:8411:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1788271658.951004:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1788271658.951024:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1788271658.951039:0:6477:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:1.0:1788271658.951055:0:6477:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788271658.951074:0:6477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e485 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271658.951115:0:6477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6e813a0e00/0x99288105fd38e351 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e34a expref: 18 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271658.951124:0:6477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6eb4079400/0x99288105fd38e3c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e3c1 expref: 18 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271658.951131:0:6477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6e813a0a00/0x99288105fd38e415 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e40e expref: 18 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271658.951137:0:6477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6e813a0600/0x99288105fd38e431 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e42a expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271658.951144:0:6477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6e92d32800/0x99288105fd38e469 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e462 expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271658.951151:0:6477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e485 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271658.951190:0:6477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6e92d32800/0x99288105fd38e469 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e462 expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271658.951206:0:6477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f6e92d32800/0x99288105fd38e469 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e462 expref: 18 pid: 6478 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271658.951221:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0ccd880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6477:1875138590033024:0@lo:104: 00000100:00100000:1.0:1788271658.951287:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788271658.951344:0:6477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6e813a0600/0x99288105fd38e431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e42a expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271658.951422:0:6477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f6e813a0600/0x99288105fd38e431 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e42a expref: 18 pid: 6478 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271658.951439:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0ccea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6477:1875138590033152:0@lo:104: 00000100:00100000:1.0:1788271658.951461:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788271658.951559:0:6477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6e813a0a00/0x99288105fd38e415 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e40e expref: 18 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271658.951566:0:6477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f6e813a0a00/0x99288105fd38e415 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e40e expref: 18 pid: 6477 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271658.951574:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0ccf800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6477:1875138590033280:0@lo:104: 00000100:00100000:1.0:1788271658.951591:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788271658.952010:0:6477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6eb4079400/0x99288105fd38e3c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e3c1 expref: 18 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271658.952018:0:6477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f6eb4079400/0x99288105fd38e3c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e3c1 expref: 18 pid: 6476 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271658.952027:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cf480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6477:1875138590033408:0@lo:104: 00000100:00100000:1.0:1788271658.952051:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271658.952070:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590033024 00000100:00100000:3.0:1788271658.952077:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590033024 00000100:00100000:3.0:1788271658.952126:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590033152 00000100:00100000:3.0:1788271658.952129:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590033152 00000100:00100000:3.0:1788271658.952140:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590033280 00000100:00100000:3.0:1788271658.952143:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590033280 00000100:00100000:3.0:1788271658.952156:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788271658.952166:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0ccc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+5:6477:x1875138590033024:12345-0@lo:104: 00010000:00010000:3.0:1788271658.952180:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfc00/0x99288105fd38e462 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e469 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271658.952239:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788271658.952247:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0ccc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+5:6477:x1875138590033024:12345-0@lo:104: Request processed in 83us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271658.952254:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788271658.952271:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788271658.952278:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0ccd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+4:6477:x1875138590033152:12345-0@lo:104: 00010000:00010000:3.0:1788271658.952285:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6e813a0200/0x99288105fd38e42a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e431 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271658.952316:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788271658.952321:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0ccd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+4:6477:x1875138590033152:12345-0@lo:104: Request processed in 45us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271658.952327:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788271658.952338:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788271658.952344:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+3:6477:x1875138590033280:12345-0@lo:104: 00010000:00010000:3.0:1788271658.952350:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e40e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e415 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271658.952410:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788271658.952415:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+3:6477:x1875138590033280:12345-0@lo:104: Request processed in 72us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271658.952421:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788271658.952439:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788271658.952445:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfc00/0x99288105fd38e462 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e469 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271658.952452:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6ec21dfc00 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:3.0:1788271658.952456:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfc00/0x99288105fd38e462 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e469 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271658.952464:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfc00/0x99288105fd38e462 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e469 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788271658.952472:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfc00/0x99288105fd38e462 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e469 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271658.952478:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788271658.952505:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfc00/0x99288105fd38e462 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e469 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271658.952511:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788271658.952527:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfc00/0x99288105fd38e462 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e469 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271658.952534:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfc00/0x99288105fd38e462 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e469 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.952763:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788271658.952887:0:8412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271658.952894:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6e813a0200/0x99288105fd38e42a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e431 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.952901:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e813a0200 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:2.0:1788271658.952904:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6e813a0200/0x99288105fd38e42a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e431 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.952911:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6e813a0200/0x99288105fd38e42a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e431 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788271658.952917:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6e813a0200/0x99288105fd38e42a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e431 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271658.952923:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788271658.952941:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6e813a0200/0x99288105fd38e42a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e431 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.952946:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788271658.952952:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6e813a0200/0x99288105fd38e42a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e431 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.952958:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6e813a0200/0x99288105fd38e42a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e431 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.952992:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271658.952993:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271658.952995:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271658.953138:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271658.953144:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e40e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e415 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.953152:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4079600 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:2.0:1788271658.953155:0:8412:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e40e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e415 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.953161:0:8412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e40e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e415 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788271658.953167:0:8412:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e40e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e415 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271658.953173:0:8412:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788271658.953187:0:8412:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e40e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e415 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.953193:0:8412:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788271658.953206:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e40e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e415 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.953213:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e40e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e415 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.953221:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271658.953228:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271658.953230:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271658.953235:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271658.953236:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271658.953406:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271658.953408:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271658.953409:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271658.953437:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590033536:0@lo:103: 00000100:00100000:3.0:1788271658.953479:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271658.953520:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788271658.953526:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590033664:0@lo:103: 00000100:00100000:3.0:1788271658.953552:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271658.953579:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590033792:0@lo:103: 00000100:00100000:3.0:1788271658.953612:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271658.953666:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590033536 00000100:00100000:3.0:1788271658.953672:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590033536 00010000:00010000:3.0:1788271658.953697:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6e92d32800/0x99288105fd38e469 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e462 expref: 19 pid: 6478 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271658.953716:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590033664 00000100:00100000:3.0:1788271658.953719:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590033664 00010000:00010000:3.0:1788271658.953730:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6e813a0600/0x99288105fd38e431 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e42a expref: 20 pid: 6478 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271658.953739:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590033792 00000100:00100000:3.0:1788271658.953741:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590033792 00010000:00010000:3.0:1788271658.953749:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6e813a0a00/0x99288105fd38e415 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e40e expref: 21 pid: 6477 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271658.953760:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788271658.953766:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e85808a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:3608:x1875138590033536:12345-0@lo:103: 00010000:00010000:3.0:1788271658.953778:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271658.953789:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6e92d32800/0x99288105fd38e469 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e462 expref: 21 pid: 6478 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271658.953799:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6e92d32800/0x99288105fd38e469 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e462 expref: 21 pid: 6478 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271658.953815:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271658.953843:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e85808a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:3608:x1875138590033536:12345-0@lo:103: Request processed in 77us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271658.953850:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788271658.953865:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788271658.953871:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e85809500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:3608:x1875138590033664:12345-0@lo:103: 00010000:00010000:3.0:1788271658.953877:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271658.953881:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6e813a0600/0x99288105fd38e431 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e42a expref: 20 pid: 6478 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271658.953889:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6e813a0600/0x99288105fd38e431 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e42a expref: 20 pid: 6478 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271658.953898:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271658.953918:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e85809500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:3608:x1875138590033664:12345-0@lo:103: Request processed in 48us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271658.953924:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788271658.953936:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788271658.953943:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e85809f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+19:3606:x1875138590033792:12345-0@lo:103: 00010000:00010000:3.0:1788271658.953949:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271658.953953:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6e813a0a00/0x99288105fd38e415 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e40e expref: 19 pid: 6477 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271658.953971:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6e813a0a00/0x99288105fd38e415 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e40e expref: 19 pid: 6477 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271658.953980:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271658.954005:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e85809f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+19:3606:x1875138590033792:12345-0@lo:103: Request processed in 63us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271658.954011:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788271658.954042:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590033664:0@lo:103: 00000100:00100000:3.0:1788271658.954051:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590033536:0@lo:103: 00000100:00100000:3.0:1788271658.954077:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590033792:0@lo:103: 00010000:00010000:1.0:1788271658.954898:0:6477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6e813a0e00/0x99288105fd38e351 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e34a expref: 18 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271658.954912:0:6477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f6e813a0e00/0x99288105fd38e351 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e34a expref: 18 pid: 6476 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271658.954923:0:6477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cfb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6477:1875138590033920:0@lo:104: 00000100:00100000:1.0:1788271658.954956:0:6477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271658.955017:0:6477:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e890619c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788271658.955034:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6e92d32800/0x99288105fd38e469 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e462 expref: 18 pid: 6478 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271658.955055:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0ccd880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6477:1875138590033024:0@lo:104: 00010000:00010000:1.0:1788271658.955067:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6e813a0600/0x99288105fd38e431 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e42a expref: 17 pid: 6478 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271658.955074:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0ccea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6477:1875138590033152:0@lo:104: 00010000:00010000:1.0:1788271658.955083:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6e813a0a00/0x99288105fd38e415 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e40e expref: 16 pid: 6477 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271658.955090:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0ccf800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6477:1875138590033280:0@lo:104: 00000100:00100000:3.0:1788271658.955157:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590033408 00000100:00100000:3.0:1788271658.955163:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590033408 00000100:00100000:3.0:1788271658.955196:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590033920 00000100:00100000:3.0:1788271658.955198:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590033920 00000100:00100000:3.0:1788271658.955208:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788271658.955215:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+4:6477:x1875138590033408:12345-0@lo:104: 00010000:00010000:3.0:1788271658.955226:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078a00/0x99288105fd38e3c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e3c8 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271658.955282:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788271658.955287:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+4:6477:x1875138590033408:12345-0@lo:104: Request processed in 73us (3236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271658.955294:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788271658.955307:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788271658.955313:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+3:6477:x1875138590033920:12345-0@lo:104: 00010000:00010000:3.0:1788271658.955319:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e34a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e351 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271658.955365:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788271658.955370:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+3:6477:x1875138590033920:12345-0@lo:104: Request processed in 58us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271658.955376:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788271658.955421:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788271658.955429:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078a00/0x99288105fd38e3c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e3c8 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.955437:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4078a00 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:2.0:1788271658.955443:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078a00/0x99288105fd38e3c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e3c8 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.955453:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078a00/0x99288105fd38e3c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e3c8 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788271658.955460:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078a00/0x99288105fd38e3c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e3c8 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271658.955465:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788271658.955503:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078a00/0x99288105fd38e3c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e3c8 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.955510:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788271658.955528:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078a00/0x99288105fd38e3c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e3c8 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.955535:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078a00/0x99288105fd38e3c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e3c8 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.955557:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271658.955560:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e34a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e351 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.955570:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4078e00 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:2.0:1788271658.955574:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e34a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e351 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.955580:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e34a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e351 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788271658.955587:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e34a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e351 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271658.955592:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788271658.955607:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e34a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e351 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.955613:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788271658.955654:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e34a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e351 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.955662:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e34a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e351 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.955674:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271658.955676:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271658.955678:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271658.955702:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271658.955878:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590034048:0@lo:103: 00000100:00100000:3.0:1788271658.955909:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271658.955948:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788271658.955957:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590034176:0@lo:103: 00000100:00100000:3.0:1788271658.955982:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271658.956005:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590034048 00000100:00100000:3.0:1788271658.956010:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590034048 00010000:00010000:3.0:1788271658.956028:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6eb4079400/0x99288105fd38e3c8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e3c1 expref: 16 pid: 6476 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271658.956047:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590034176 00000100:00100000:3.0:1788271658.956050:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590034176 00010000:00010000:3.0:1788271658.956060:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6e813a0e00/0x99288105fd38e351 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e34a expref: 17 pid: 6476 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271658.956072:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788271658.956078:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e85808e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:3607:x1875138590034048:12345-0@lo:103: 00010000:00010000:3.0:1788271658.956087:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271658.956092:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6eb4079400/0x99288105fd38e3c8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e3c1 expref: 17 pid: 6476 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271658.956113:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6eb4079400/0x99288105fd38e3c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e3c1 expref: 17 pid: 6476 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271658.956141:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271658.956169:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e85808e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:3607:x1875138590034048:12345-0@lo:103: Request processed in 91us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271658.956176:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788271658.956188:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788271658.956194:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:3609:x1875138590034176:12345-0@lo:103: 00010000:00010000:3.0:1788271658.956201:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271658.956206:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6e813a0e00/0x99288105fd38e351 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e34a expref: 16 pid: 6476 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271658.956215:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6e813a0e00/0x99288105fd38e351 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e34a expref: 16 pid: 6476 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271658.956228:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e485 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271658.956237:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e485 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271658.956252:0:6470:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e485 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271658.956259:0:6470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e485 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271658.956266:0:6470:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e485 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271658.956272:0:6470:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e485 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271658.956283:0:6470:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e92d32c00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:3.0:1788271658.956288:0:6470:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e485 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271658.956295:0:6470:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e485 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271658.956303:0:6470:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e485 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271658.956313:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271658.956340:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:3609:x1875138590034176:12345-0@lo:103: Request processed in 146us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271658.956346:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788271658.956507:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590034176:0@lo:103: 00000100:00100000:3.0:1788271658.956533:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590034048:0@lo:103: 00010000:00010000:1.0:1788271658.957035:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4079400/0x99288105fd38e3c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e3c1 expref: 15 pid: 6476 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271658.957048:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cf480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6477:1875138590033408:0@lo:104: 00010000:00010000:1.0:1788271658.957058:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6e813a0e00/0x99288105fd38e351 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e34a expref: 14 pid: 6476 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271658.957067:0:6477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cfb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6477:1875138590033920:0@lo:104: 00010000:00010000:1.0:1788271658.957094:0:6477:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e485 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271658.957116:0:6477:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e485 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271658.957122:0:6477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e485 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271658.957129:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e485 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788271658.957152:0:6477:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788271658.959994:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+13:8389:x1875138590032896:12345-0@lo:253: Request processed in 14478us (16131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271658.960008:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788271658.960075:0:8389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0cce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:8389:1875138590032896:0@lo:253: 10000000:01000000:2.0:1788271658.960090:0:8389:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788271658.960093:0:8389:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788271658.960095:0:8389:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788271658.960115:0:8389:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788271658.960117:0:8389:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788271658.960118:0:8389:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788271658.960119:0:8389:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788271658.960121:0:8389:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788271658.960122:0:8389:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788271658.960124:0:8389:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788271658.960125:0:8389:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788271658.960145:0:8389:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f6eb4b8b800 from lustre-OST0000 10000000:01000000:2.0:1788271658.960176:0:8389:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788271658.960179:0:8389:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788271658.960186:0:8389:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f6e85beb370 local copy 10000000:01000000:2.0:1788271658.960190:0:8389:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788271658.960225:0:8389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21400/0x99288105fd38e48c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.960236:0:8389:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21400/0x99288105fd38e48c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.960245:0:8389:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21400/0x99288105fd38e48c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271658.960266:0:8389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c61180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:8389:1875138590034304:0@lo:101: 00000100:00100000:2.0:1788271658.960319:0:8389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271658.960748:0:8389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e90c11cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271658.960839:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590034304 00000100:00100000:1.0:1788271658.960846:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590034304 00000100:00100000:3.0:1788271658.960945:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788271658.960954:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+13:8389:x1875138590034304:12345-0@lo:101: 00010000:00010000:3.0:1788271658.960967:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271658.960980:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6ec21df800/0x99288105fd38e493 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e48c expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271658.961004:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6ec21df800/0x99288105fd38e493 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e48c expref: 14 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271658.961015:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6ec21df800/0x99288105fd38e493 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e48c expref: 14 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271658.961036:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6ec21df800, rc 0) 00000100:00100000:3.0:1788271658.961080:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+14:8389:x1875138590034304:12345-0@lo:101: Request processed in 127us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271658.961086:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788271658.961162:0:8389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c61180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:8389:1875138590034304:0@lo:101: 00010000:00010000:1.0:1788271658.961176:0:8389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21400/0x99288105fd38e48c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x99288105fd38e493 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271658.961185:0:8389:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21400/0x99288105fd38e48c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x99288105fd38e493 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271658.961280:0:8389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:8389:1875138590034432:0@lo:501: 00000100:00100000:1.0:1788271658.961308:0:8389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271658.961342:0:8389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e890619c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271658.961453:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590034432 00000100:00100000:3.0:1788271658.961459:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590034432 00000100:00100000:3.0:1788271658.961492:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788271658.961499:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+14:8389:x1875138590034432:12345-0@lo:501: 00000100:00100000:3.0:1788271658.961572:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+14:8389:x1875138590034432:12345-0@lo:501: Request processed in 73us (262us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788271658.961579:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788271658.961789:0:8389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:8389:1875138590034432:0@lo:501: 10000000:01000000:1.0:1788271658.961802:0:8389:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788271658.961821:0:8389:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788271658.961826:0:8389:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21400/0x99288105fd38e48c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x99288105fd38e493 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271658.961836:0:8389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21400/0x99288105fd38e48c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x99288105fd38e493 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271658.961842:0:8389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21400/0x99288105fd38e48c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x99288105fd38e493 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271658.961881:0:8389:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788271658.961913:0:8389:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f6eb4b8b800 10000000:01000000:1.0:1788271658.961920:0:8389:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788271658.961925:0:8389:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788271658.961927:0:8389:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788271658.961933:0:8389:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788271658.961936:0:8389:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788271658.961954:0:8389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33e00/0x99288105fd38e49a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271658.961962:0:8389:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33e00/0x99288105fd38e49a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271658.961969:0:8389:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33e00/0x99288105fd38e49a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271658.961981:0:8389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:8389:1875138590034560:0@lo:101: 00000100:00100000:1.0:1788271658.962008:0:8389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271658.962037:0:8389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e89061cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271658.962078:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590034560 00000100:00100000:0.0:1788271658.962088:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590034560 00000100:00100000:0.0:1788271658.962132:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788271658.962140:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+14:8389:x1875138590034560:12345-0@lo:101: 00010000:00010000:0.0:1788271658.962148:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271658.962158:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4079200/0x99288105fd38e4a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e49a expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271658.962174:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4079200/0x99288105fd38e4a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e49a expref: 15 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271658.962184:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4079200/0x99288105fd38e4a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e49a expref: 15 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271658.962191:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4079200, rc 0) 00000100:00100000:0.0:1788271658.962222:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:8389:x1875138590034560:12345-0@lo:101: Request processed in 84us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271658.962229:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00010000:3.0:1788271658.962286:0:8413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788271658.962293:0:8413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21400/0x99288105fd38e48c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x99288105fd38e493 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271658.962300:0:8413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e21400 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:3.0:1788271658.962304:0:8413:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21400/0x99288105fd38e48c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x99288105fd38e493 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271658.962313:0:8413:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21400/0x99288105fd38e48c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x99288105fd38e493 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788271658.962320:0:8413:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21400/0x99288105fd38e48c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x99288105fd38e493 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271658.962325:0:8413:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788271658.962344:0:8413:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21400/0x99288105fd38e48c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x99288105fd38e493 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271658.962372:0:8413:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788271658.962399:0:8413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21400/0x99288105fd38e48c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x99288105fd38e493 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271658.962406:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21400/0x99288105fd38e48c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x99288105fd38e493 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271658.962426:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788271658.962437:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590034688:0@lo:103: 00000100:00100000:3.0:1788271658.962464:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271658.962492:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590034688 00000100:00100000:3.0:1788271658.962495:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590034688 00000100:00100000:3.0:1788271658.962523:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788271658.962530:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e85809500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:3608:x1875138590034688:12345-0@lo:103: 00010000:00010000:3.0:1788271658.962880:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271658.962894:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6ec21df800/0x99288105fd38e493 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x99288105fd38e48c expref: 15 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271658.962905:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271658.962945:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e85809500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+14:3608:x1875138590034688:12345-0@lo:103: Request processed in 414us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271658.962950:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788271658.962969:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271658.962971:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271658.962972:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271658.963018:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590034688:0@lo:103: 00000100:00100000:1.0:1788271658.963100:0:8389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:8389:1875138590034560:0@lo:101: 00010000:00010000:1.0:1788271658.963124:0:8389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33e00/0x99288105fd38e49a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e4a1 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271658.963132:0:8389:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33e00/0x99288105fd38e49a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e4a1 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271658.963202:0:8389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:8389:1875138590034816:0@lo:501: 00000100:00100000:1.0:1788271658.963236:0:8389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271658.963267:0:8389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e89061cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271658.963312:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590034816 00000100:00100000:3.0:1788271658.963316:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590034816 00000100:00100000:3.0:1788271658.963346:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788271658.963370:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+14:8389:x1875138590034816:12345-0@lo:501: 00000100:00100000:3.0:1788271658.963491:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+14:8389:x1875138590034816:12345-0@lo:501: Request processed in 121us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271658.963498:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788271658.963733:0:8389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:8389:1875138590034816:0@lo:501: 00000100:00100000:1.0:1788271658.963759:0:8389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:8389:1875138590034944:0@lo:503: 00000100:00100000:1.0:1788271658.963802:0:8389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271658.963825:0:8389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e89061cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271658.963880:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590034944 00000100:00100000:0.0:1788271658.963885:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590034944 00000100:00100000:0.0:1788271658.963912:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788271658.963918:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+14:8389:x1875138590034944:12345-0@lo:503: 00000100:00100000:0.0:1788271658.963994:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+14:8389:x1875138590034944:12345-0@lo:503: Request processed in 75us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271658.964001:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788271658.964066:0:8389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:8389:1875138590034944:0@lo:503: 00000040:00080000:1.0:1788271658.964334:0:8389:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788271658.964702:0:8389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:8389:1875138590035072:0@lo:502: 00000100:00100000:1.0:1788271658.964744:0:8389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271658.964770:0:8389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e89061cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271658.964831:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590035072 00000100:00100000:3.0:1788271658.964835:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590035072 00000100:00100000:3.0:1788271658.964868:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788271658.964874:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+14:8389:x1875138590035072:12345-0@lo:502: 00000100:00100000:3.0:1788271658.964954:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+14:8389:x1875138590035072:12345-0@lo:502: Request processed in 79us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271658.964961:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788271658.965073:0:8389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:8389:1875138590035072:0@lo:502: 00000040:00080000:1.0:1788271658.965286:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788271658.965314:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788271658.965328:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788271658.965341:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788271658.965368:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788271658.965395:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788271658.965416:0:8389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:8389:1875138590035200:0@lo:502: 00000100:00100000:1.0:1788271658.965449:0:8389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271658.965471:0:8389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e89061cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271658.965653:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590035200 00000100:00100000:3.0:1788271658.965658:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590035200 00000100:00100000:3.0:1788271658.965686:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788271658.965692:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+14:8389:x1875138590035200:12345-0@lo:502: 00000100:00100000:3.0:1788271658.965765:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+14:8389:x1875138590035200:12345-0@lo:502: Request processed in 73us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271658.965772:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788271658.965901:0:8389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:8389:1875138590035200:0@lo:502: 00000040:00080000:1.0:1788271658.965936:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788271658.965943:0:8389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788271658.966856:0:8414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788271658.966865:0:8414:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788271658.966879:0:8414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271658.966881:0:8414:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788271658.966887:0:8414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788271658.966904:0:8414:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8f6eb3cd0000) 00000020:00000080:1.0:1788271658.966926:0:8414:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788271658.966932:0:8414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788271658.967007:0:8414:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f6eb4b8b800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788271658.967015:0:8414:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788271658.967022:0:8414:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x99288105fd38e4af 00010000:00010000:1.0:1788271658.973082:0:8414:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:1.0:1788271658.973500:0:8414:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1788271658.977918:0:8414:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788271658.978266:0:8414:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1788271658.982792:0:8414:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1788271658.982988:0:8414:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1788271658.989830:0:8414:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1788271658.992533:0:8414:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788271658.992708:0:8414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788271658.992716:0:8414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271658.992727:0:8414:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788271658.992732:0:8414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788271658.992737:0:8414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271658.992739:0:8414:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788271658.992742:0:8414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788271658.992744:0:8414:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788271658.992770:0:8414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788271658.992774:0:8414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271658.992775:0:8414:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788271658.992778:0:8414:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788271658.992937:0:8389:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1788271658.992964:0:8389:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788271658.992986:0:8389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33e00/0x99288105fd38e49a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e4a1 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.992997:0:8389:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33e00/0x99288105fd38e49a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e4a1 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271658.993016:0:8389:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f6eb4b8b800 from 1 10000000:01000000:2.0:1788271658.993019:0:8389:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788271658.993054:0:8389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20a00/0x99288105fd38e4b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.993061:0:8389:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20a00/0x99288105fd38e4b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.993072:0:8389:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20a00/0x99288105fd38e4b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271658.993094:0:8389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c62a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:8389:1875138590035328:0@lo:101: 00000100:00100000:2.0:1788271658.993513:0:8389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271658.993567:0:8389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e90c11cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271658.993728:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590035328 00000100:00100000:0.0:1788271658.993737:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590035328 00000100:00100000:0.0:1788271658.993783:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788271658.993792:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+14:8389:x1875138590035328:12345-0@lo:101: 00010000:00010000:0.0:1788271658.993806:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271658.993819:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4079000/0x99288105fd38e4bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e4b6 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271658.993842:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4079000/0x99288105fd38e4bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e4b6 expref: 15 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271658.993851:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4079000/0x99288105fd38e4bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e4b6 expref: 15 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271658.993859:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4079000, rc 0) 00000100:00100000:0.0:1788271658.993895:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:8389:x1875138590035328:12345-0@lo:101: Request processed in 104us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271658.993902:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788271658.994011:0:8389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c62a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:8389:1875138590035328:0@lo:101: 00010000:00010000:2.0:1788271658.994025:0:8389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20a00/0x99288105fd38e4b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e4bd expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271658.994034:0:8389:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20a00/0x99288105fd38e4b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e4bd expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271658.994160:0:8389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c62a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:8389:1875138590035456:0@lo:501: 00000100:00100000:2.0:1788271658.994186:0:8389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271658.994214:0:8389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e90c11cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271658.994590:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590035456 00000100:00100000:0.0:1788271658.994596:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590035456 00000100:00100000:0.0:1788271658.994692:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788271658.994700:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:8389:x1875138590035456:12345-0@lo:501: 00000100:00100000:0.0:1788271658.994843:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:8389:x1875138590035456:12345-0@lo:501: Request processed in 143us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271658.994852:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788271658.996192:0:8389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c62a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:8389:1875138590035456:0@lo:501: 00000100:00100000:3.0:1788271658.996263:0:8389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85809f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:8389:1875138590035584:0@lo:503: 00000100:00100000:3.0:1788271658.996321:0:8389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271658.997511:0:8389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc98d600 going to sleep for 11 seconds 00000100:00100000:2.0:1788271659.002178:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590035584 00000100:00100000:2.0:1788271659.002194:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590035584 00000100:00100000:2.0:1788271659.002267:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788271659.002277:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:8389:x1875138590035584:12345-0@lo:503: 00000100:00100000:2.0:1788271659.002595:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:8389:x1875138590035584:12345-0@lo:503: Request processed in 319us (6274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271659.002604:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788271659.002796:0:8389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85809f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:8389:1875138590035584:0@lo:503: 00000040:00080000:2.0:1788271659.003056:0:8389:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788271659.003170:0:8389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c61c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:8389:1875138590035712:0@lo:502: 00000100:00100000:2.0:1788271659.003213:0:8389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271659.003244:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590035712 00000100:00100000:2.0:1788271659.003248:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590035712 00000100:00100000:2.0:1788271659.003320:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788271659.003328:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:8389:x1875138590035712:12345-0@lo:502: 00000100:00100000:2.0:1788271659.003481:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:8389:x1875138590035712:12345-0@lo:502: Request processed in 153us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271659.003489:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788271659.004706:0:8389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84ef6000 going to sleep for 11 seconds 00000100:00100000:3.0:1788271659.004748:0:8389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c61c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:8389:1875138590035712:0@lo:502: 00000040:00080000:3.0:1788271659.004983:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788271659.005013:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788271659.005045:0:8389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85808e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:8389:1875138590035840:0@lo:502: 00000100:00100000:3.0:1788271659.005115:0:8389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271659.005144:0:8389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc98d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271659.005237:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590035840 00000100:00100000:0.0:1788271659.005243:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590035840 00000100:00100000:0.0:1788271659.005290:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788271659.005299:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:8389:x1875138590035840:12345-0@lo:502: 00000100:00100000:0.0:1788271659.005515:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:8389:x1875138590035840:12345-0@lo:502: Request processed in 215us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271659.005523:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788271659.005645:0:8389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85808e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:8389:1875138590035840:0@lo:502: 00000040:00080000:3.0:1788271659.005683:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788271659.005691:0:8389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788271659.006202:0:8418:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788271659.006211:0:8418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271659.006213:0:8418:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788271659.006220:0:8418:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f6eb4b8b800 00000020:00000080:0.0:1788271659.006223:0:8418:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788271659.006234:0:8418:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788271659.006237:0:8418:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271659.006238:0:8418:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788271659.006241:0:8418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788271659.006419:0:8389:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788271659.006445:0:8389:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788271659.006467:0:8389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20a00/0x99288105fd38e4b6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e4bd expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271659.006480:0:8389:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20a00/0x99288105fd38e4b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e4bd expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271659.006603:0:8389:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788271659.006607:0:8389:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f6eb4b8b800 10000000:01000000:3.0:1788271659.006610:0:8389:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f6eb4b8b800 10000000:01000000:3.0:1788271659.006614:0:8389:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788271659.006641:0:8389:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f6eb4b8b800 from 1 10000000:01000000:3.0:1788271659.006644:0:8389:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788271659.006671:0:8389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6ec21df800/0x99288105fd38e4c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271659.006680:0:8389:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6ec21df800/0x99288105fd38e4c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271659.006690:0:8389:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6ec21df800/0x99288105fd38e4c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271659.006713:0:8389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85808e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:8389:1875138590035968:0@lo:101: 00000100:00100000:3.0:1788271659.006756:0:8389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271659.006782:0:8389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc98d600 going to sleep for 11 seconds 00000100:00100000:2.0:1788271659.007091:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590035968 00000100:00100000:2.0:1788271659.007098:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590035968 00000100:00100000:2.0:1788271659.007184:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788271659.007194:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:8389:x1875138590035968:12345-0@lo:101: 00010000:00010000:2.0:1788271659.007209:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271659.007222:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4e21600/0x99288105fd38e4cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e4c4 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271659.007247:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4e21600/0x99288105fd38e4cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e4c4 expref: 16 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271659.007259:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4e21600/0x99288105fd38e4cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e4c4 expref: 16 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271659.007280:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e21600, rc 0) 00000100:00100000:2.0:1788271659.007328:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:8389:x1875138590035968:12345-0@lo:101: Request processed in 134us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271659.007335:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788271659.007411:0:8389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85808e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:8389:1875138590035968:0@lo:101: 00010000:00010000:3.0:1788271659.007427:0:8389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6ec21df800/0x99288105fd38e4c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e4cb expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271659.007437:0:8389:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6ec21df800/0x99288105fd38e4c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e4cb expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271659.007513:0:8389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85808e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:8389:1875138590036096:0@lo:501: 00000100:00100000:3.0:1788271659.007551:0:8389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271659.007936:0:8389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc98d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788271659.007975:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590036096 00000100:00100000:0.0:1788271659.007982:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590036096 00000100:00100000:1.0:1788271659.008021:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788271659.008030:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:8389:x1875138590036096:12345-0@lo:501: 00000100:00100000:1.0:1788271659.008161:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:8389:x1875138590036096:12345-0@lo:501: Request processed in 131us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271659.008168:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788271659.008238:0:8389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85808e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:8389:1875138590036096:0@lo:501: 00000100:00100000:3.0:1788271659.008267:0:8389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85808e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:8389:1875138590036224:0@lo:503: 00000100:00100000:3.0:1788271659.008309:0:8389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271659.008328:0:8389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc98d600 going to sleep for 11 seconds 00000100:00100000:1.0:1788271659.008428:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590036224 00000100:00100000:1.0:1788271659.008433:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590036224 00000100:00100000:1.0:1788271659.008451:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788271659.008457:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:8389:x1875138590036224:12345-0@lo:503: 00000100:00100000:1.0:1788271659.008615:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:8389:x1875138590036224:12345-0@lo:503: Request processed in 157us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271659.008643:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788271659.008719:0:8389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85808e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:8389:1875138590036224:0@lo:503: 00000040:00080000:3.0:1788271659.008969:0:8389:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788271659.009040:0:8389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85808e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:8389:1875138590036352:0@lo:502: 00000100:00100000:3.0:1788271659.009076:0:8389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271659.009183:0:8389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc98d600 going to sleep for 11 seconds 00000100:00100000:2.0:1788271659.009263:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590036352 00000100:00100000:2.0:1788271659.009268:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590036352 00000100:00100000:2.0:1788271659.009291:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788271659.009298:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:8389:x1875138590036352:12345-0@lo:502: 00000100:00100000:2.0:1788271659.009398:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:8389:x1875138590036352:12345-0@lo:502: Request processed in 99us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271659.009406:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788271659.009553:0:8389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85808e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:8389:1875138590036352:0@lo:502: 00000040:00080000:3.0:1788271659.009743:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788271659.009774:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788271659.009788:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788271659.009799:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788271659.009811:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788271659.009822:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788271659.009834:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788271659.009846:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788271659.009858:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788271659.009869:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788271659.009884:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788271659.009896:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788271659.009908:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788271659.009930:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788271659.009943:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788271659.009955:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788271659.009966:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788271659.009977:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788271659.009989:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788271659.010001:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788271659.010014:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788271659.010026:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788271659.010037:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788271659.010050:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788271659.010062:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788271659.010075:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788271659.010087:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788271659.010098:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1788271659.010125:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788271659.010150:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1788271659.010166:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1788271659.010179:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1788271659.010191:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1788271659.010202:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1788271659.010223:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1788271659.010237:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1788271659.010250:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:3.0:1788271659.010277:0:8389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85808e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:8389:1875138590036480:0@lo:502: 00000100:00100000:3.0:1788271659.010320:0:8389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271659.010350:0:8389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc98d600 going to sleep for 11 seconds 00000100:00100000:2.0:1788271659.010567:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590036480 00000100:00100000:2.0:1788271659.010573:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590036480 00000100:00100000:2.0:1788271659.010598:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788271659.010605:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:8389:x1875138590036480:12345-0@lo:502: 00000100:00100000:2.0:1788271659.010719:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:8389:x1875138590036480:12345-0@lo:502: Request processed in 113us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271659.010727:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788271659.010866:0:8389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85808e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:8389:1875138590036480:0@lo:502: 00000040:00080000:3.0:1788271659.010907:0:8389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1788271659.010917:0:8389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1788271659.011429:0:8419:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788271659.011445:0:8419:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8f6ebc994d28) 00000020:00000080:3.0:1788271659.011467:0:8419:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788271659.011573:0:8419:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f6eb4b8b800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788271659.011578:0:8419:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f6eb4b8b800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788271659.011580:0:8419:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f6eb4b8b800 3 00010000:00080000:3.0:1788271659.011607:0:8419:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f6d81dd2000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.103@tcp at head 00010000:00010000:3.0:1788271659.013759:0:8419:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:3.0:1788271659.013995:0:8419:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788271659.014042:0:8419:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788271659.014054:0:8419:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x99288105fd38e4d9 00000100:00080000:3.0:1788271659.014067:0:8419:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788271659.014072:0:8419:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8f6d81dd2000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788271659.014126:0:8419:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6e85808e00 x1875138590036608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788271659.014158:0:8419:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788271659.014251:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875138590036736:0@lo:400: 00000100:00100000:3.0:1788271659.014315:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271659.014350:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788271659.014365:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590036864:0@lo:400: 00000100:00100000:3.0:1788271659.014392:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271659.014435:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590036736 00000100:00100000:3.0:1788271659.014443:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590036736 00000100:00100000:3.0:1788271659.014484:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788271659.014493:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0ccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875138590036736:12345-0@lo:400: 00000100:00100000:3.0:1788271659.014545:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0ccea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875138590036736:12345-0@lo:400: Request processed in 52us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271659.014552:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788271659.014583:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f6e85809f80 x1875138590036736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271659.014598:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875138590036736:0@lo:400: 00000100:00100000:1.0:1788271659.016917:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590036864 00000100:00100000:1.0:1788271659.016930:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590036864 00000100:00100000:1.0:1788271659.016985:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788271659.016994:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0ccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590036864:12345-0@lo:400: 00000100:00100000:1.0:1788271659.017094:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0ccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590036864:12345-0@lo:400: Request processed in 100us (2700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271659.017115:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788271659.017167:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590036864:0@lo:400: 00000100:00100000:0.0:1788271659.017295:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3605:1875138590036608:0@lo:38: 00000100:00100000:0.0:1788271659.017342:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271659.017405:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875138590036992:0@lo:400: 00000100:00100000:0.0:1788271659.017430:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271659.017449:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788271659.017456:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0ccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590037120:0@lo:400: 00000100:00100000:0.0:1788271659.017481:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271659.017524:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590036608 00000100:00100000:0.0:1788271659.017528:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590036608 00000100:00100000:1.0:1788271659.017689:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590036992 00000100:00100000:1.0:1788271659.017693:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590036992 00000100:00100000:1.0:1788271659.017720:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788271659.017727:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875138590036992:12345-0@lo:400: 00000100:00100000:1.0:1788271659.017767:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875138590036992:12345-0@lo:400: Request processed in 40us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271659.017773:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788271659.017789:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590037120 00000100:00100000:1.0:1788271659.017792:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590037120 00000100:00100000:1.0:1788271659.017807:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788271659.017812:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590037120:12345-0@lo:400: 00000100:00100000:1.0:1788271659.017840:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590037120:12345-0@lo:400: Request processed in 27us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271659.017845:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788271659.017873:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0ccf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590037120:0@lo:400: 00010000:00080000:1.0:1788271659.017886:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f6eb0cce300 x1875138590036992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271659.017896:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875138590036992:0@lo:400: 00000100:00100000:0.0:1788271659.017985:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788271659.017990:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3605:x1875138590036608:12345-0@lo:38: 00010000:00080000:0.0:1788271659.018014:0:6483:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:0.0:1788271659.018049:0:6483:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x99288105fd38e4e0 00000004:00100000:0.0:1788271659.018064:0:6483:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788271659.018100:0:6483:0:(import.c:65:import_set_state_nolock()) ffff8f6eb4c7e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788271659.018156:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1875138590036608:12345-0@lo:38: Request processed in 165us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271659.018164:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788271659.018190:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f6e85808e00 x1875138590036608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788271669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271659.018198:0:3605:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788271659.018206:0:3605:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788271659.018216:0:3605:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788271659.018222:0:3605:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788271659.018224:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6d81dd2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788271659.018231:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3605:1875138590036608:0@lo:38: 00000020:01000004:0.0:1788271659.018611:0:8419:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788271659.018975:0:8419:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8f6eb3cd4d28) 00000020:00000080:1.0:1788271659.018995:0:8419:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1788271659.019095:0:8419:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f6eb4b8b800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788271659.019100:0:8419:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f6eb4b8b800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788271659.019121:0:8419:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f6eb4b8b800 3 00010000:00080000:1.0:1788271659.019149:0:8419:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f6d81d6b800@lustre-MDT0001-lwp-OST0000: add connection 192.168.201.103@tcp at head 00010000:00010000:1.0:1788271659.022035:0:8419:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:1.0:1788271659.022308:0:8419:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1788271659.022419:0:8419:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788271659.022433:0:8419:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x99288105fd38e4ee 00000100:00080000:1.0:1788271659.022444:0:8419:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788271659.022450:0:8419:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8f6d81d6b800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788271659.022488:0:8419:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d816cfb80 x1875138590037248/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788271659.022511:0:8419:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788271659.024502:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3605:1875138590037248:0@lo:38: 00000100:00100000:0.0:1788271659.024668:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271659.024747:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590037248 00000100:00100000:0.0:1788271659.024754:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590037248 00000100:00100000:0.0:1788271659.024788:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788271659.024796:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3605:x1875138590037248:12345-0@lo:38: 00010000:00080000:0.0:1788271659.024823:0:6484:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:0.0:1788271659.024867:0:6484:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x99288105fd38e4f5 00000004:00100000:0.0:1788271659.024883:0:6484:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788271659.024914:0:6484:0:(import.c:65:import_set_state_nolock()) ffff8f6eb4c7a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788271659.024962:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3605:x1875138590037248:12345-0@lo:38: Request processed in 165us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271659.024969:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788271659.025006:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f6d816cfb80 x1875138590037248/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788271669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271659.025016:0:3605:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788271659.025023:0:3605:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788271659.025030:0:3605:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788271659.025034:0:3605:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788271659.025037:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6d81d6b800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788271659.025042:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3605:1875138590037248:0@lo:38: 00000040:00080000:1.0:1788271659.025531:0:8419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1788271659.026705:0:8389:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1788271659.026739:0:8389:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788271659.026754:0:8389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6ec21df800/0x99288105fd38e4c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e4cb expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271659.026765:0:8389:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6ec21df800/0x99288105fd38e4c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e4cb expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788271659.026807:0:8389:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788271659.026810:0:8389:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788271659.026811:0:8389:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788271659.026812:0:8389:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788271659.026814:0:8389:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788271659.026815:0:8389:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788271659.026816:0:8389:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788271659.026818:0:8389:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788271659.026819:0:8389:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788271659.026821:0:8389:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788271659.026822:0:8389:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788271659.026827:0:8389:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1788271659.026833:0:8389:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788271659.026834:0:8389:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788271659.026835:0:8389:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788271659.026836:0:8389:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788271659.026837:0:8389:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788271659.026838:0:8389:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788271659.026839:0:8389:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788271659.026840:0:8389:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788271659.026841:0:8389:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788271659.026841:0:8389:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788271659.026842:0:8389:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788271659.026868:0:8389:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788271659.026886:0:8389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:8389:1875138590037376:0@lo:253: 00000100:00100000:1.0:1788271659.026943:0:8389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271659.026979:0:8389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc98d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271659.027044:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590037376 00000100:00100000:2.0:1788271659.027050:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590037376 00000100:00100000:2.0:1788271659.027098:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788271659.027117:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:8389:x1875138590037376:12345-0@lo:253: 20000000:01000000:2.0:1788271659.027143:0:6476:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788271659.027156:0:6476:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788271659.031985:0:6476:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788271659.032037:0:6476:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788271659.032377:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:8389:x1875138590037376:12345-0@lo:253: Request processed in 5255us (5427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271659.032390:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788271659.032532:0:8389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:8389:1875138590037376:0@lo:253: 10000000:01000000:3.0:1788271659.032611:0:8389:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788271659.032614:0:8389:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788271659.032616:0:8389:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788271659.032671:0:8389:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788271659.032673:0:8389:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788271659.032674:0:8389:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788271659.032676:0:8389:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788271659.032678:0:8389:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788271659.032679:0:8389:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788271659.032680:0:8389:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788271659.032682:0:8389:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788271659.032684:0:8389:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788271659.032699:0:8389:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1788271659.034322:0:6499:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788271659.034331:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788271659.034385:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e4fc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271659.034402:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6eb4078800/0x99288105fd38e3f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e3f2 expref: 15 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271659.034409:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6e813a1400/0x99288105fd38e423 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e41c expref: 15 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271659.034417:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e4fc lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271659.034458:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6e813a1400/0x99288105fd38e423 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e41c expref: 15 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271659.034474:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f6e813a1400/0x99288105fd38e423 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e41c expref: 15 pid: 6478 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271659.034505:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cc380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6499:1875138590037504:0@lo:104: 00000100:00100000:1.0:1788271659.034648:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788271659.034698:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6eb4078800/0x99288105fd38e3f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e3f2 expref: 15 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271659.034707:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f6eb4078800/0x99288105fd38e3f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e3f2 expref: 15 pid: 6476 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271659.034716:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cf100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6499:1875138590037632:0@lo:104: 00000100:00100000:1.0:1788271659.034735:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e8511ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788271659.034820:0:6467:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788271659.034838:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271659.034867:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590037504 00000100:00100000:2.0:1788271659.034875:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590037504 00000100:00100000:2.0:1788271659.034914:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590037632 00000100:00100000:2.0:1788271659.034916:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590037632 00000100:00100000:2.0:1788271659.034929:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788271659.034937:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+4:6499:x1875138590037504:12345-0@lo:104: 00010000:00010000:2.0:1788271659.034950:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6e813a1600/0x99288105fd38e41c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e423 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271659.034999:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788271659.035005:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+4:6499:x1875138590037504:12345-0@lo:104: Request processed in 69us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271659.035011:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788271659.035045:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788271659.035051:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0c61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+3:6499:x1875138590037632:12345-0@lo:104: 00010000:00010000:2.0:1788271659.035058:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33c00/0x99288105fd38e3f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e3f9 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271659.035087:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788271659.035092:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0c61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+3:6499:x1875138590037632:12345-0@lo:104: Request processed in 42us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271659.035098:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1788271659.035126:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788271659.035131:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6e813a1600/0x99288105fd38e41c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e423 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271659.035144:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e813a1600 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:2.0:1788271659.035148:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6e813a1600/0x99288105fd38e41c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e423 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271659.035156:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6e813a1600/0x99288105fd38e41c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e423 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788271659.035163:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6e813a1600/0x99288105fd38e41c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e423 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271659.035168:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788271659.035196:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6e813a1600/0x99288105fd38e41c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e423 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271659.035202:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788271659.035221:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6e813a1600/0x99288105fd38e41c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e423 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271659.035227:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6e813a1600/0x99288105fd38e41c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e423 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271659.035240:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271659.035243:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33c00/0x99288105fd38e3f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e3f9 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271659.035249:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e92d33c00 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:2.0:1788271659.035252:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33c00/0x99288105fd38e3f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e3f9 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271659.035268:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33c00/0x99288105fd38e3f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e3f9 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788271659.035274:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33c00/0x99288105fd38e3f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e3f9 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271659.035280:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788271659.035292:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33c00/0x99288105fd38e3f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e3f9 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271659.035298:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788271659.035303:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33c00/0x99288105fd38e3f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e3f9 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271659.035309:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33c00/0x99288105fd38e3f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e3f9 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271659.035322:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271659.035323:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271659.035325:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271659.035337:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590037760:0@lo:103: 00000100:00100000:2.0:1788271659.035363:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271659.035383:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788271659.035388:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590037888:0@lo:103: 00000100:00100000:2.0:1788271659.035405:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271659.035429:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590037760 00000100:00100000:2.0:1788271659.035433:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590037760 00010000:00010000:2.0:1788271659.035447:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6e813a1400/0x99288105fd38e423 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e41c expref: 16 pid: 6478 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271659.035475:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590037888 00000100:00100000:2.0:1788271659.035478:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590037888 00010000:00010000:2.0:1788271659.035488:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6eb4078800/0x99288105fd38e3f9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e3f2 expref: 17 pid: 6476 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271659.035498:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788271659.035504:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0c60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:3606:x1875138590037760:12345-0@lo:103: 00010000:00010000:2.0:1788271659.035514:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271659.035518:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6e813a1400/0x99288105fd38e423 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e41c expref: 17 pid: 6478 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271659.035527:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6e813a1400/0x99288105fd38e423 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e41c expref: 17 pid: 6478 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271659.036494:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271659.036653:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0c60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:3606:x1875138590037760:12345-0@lo:103: Request processed in 1146us (1287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271659.036661:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788271659.036678:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788271659.036685:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0c62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:3606:x1875138590037888:12345-0@lo:103: 00010000:00010000:2.0:1788271659.036696:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271659.036701:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6eb4078800/0x99288105fd38e3f9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e3f2 expref: 16 pid: 6476 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271659.036710:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6eb4078800/0x99288105fd38e3f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e3f2 expref: 16 pid: 6476 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271659.036723:0:6468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e4fc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271659.036738:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e4fc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788271659.036751:0:6468:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002812273s 00010000:00010000:2.0:1788271659.036755:0:6468:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e4fc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271659.036763:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e4fc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271659.036770:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e4fc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271659.036776:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e4fc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271659.036783:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e92d32c00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:2.0:1788271659.036787:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e4fc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271659.036795:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e4fc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271659.036804:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e4fc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271659.036813:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271659.036837:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0c62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:3606:x1875138590037888:12345-0@lo:103: Request processed in 153us (1430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271659.036844:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1788271659.036873:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271659.036901:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6e813a1400/0x99288105fd38e423 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e41c expref: 15 pid: 6478 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271659.036913:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cc380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6499:1875138590037504:0@lo:104: 00010000:00010000:2.0:1788271659.036924:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4078800/0x99288105fd38e3f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e3f2 expref: 14 pid: 6476 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271659.036931:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cf100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6499:1875138590037632:0@lo:104: 00010000:00010000:2.0:1788271659.036947:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e4fc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271659.036956:0:6499:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e4fc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271659.036961:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e4fc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271659.036966:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e4fc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1788271659.038458:0:8389:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1788271659.039077:0:8389:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788271659.039307:0:8389:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788271659.039520:0:8389:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788271659.039804:0:8389:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1788271659.040004:0:8389:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:1.0:1788271659.040162:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590037760:0@lo:103: 00000100:00100000:1.0:1788271659.040278:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590037888:0@lo:103: 00000001:00000004:3.0:1788271659.043064:0:8389:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788271659.051597:0:8389:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788271659.051607:0:8389:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788271659.051730:0:8389:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788271659.051768:0:8389:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.103@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788271659.051790:0:8389:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788271659.051809:0:8389:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1788271659.056699:0:8389:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788271659.056882:0:8389:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 10000000:01000000:0.0:1788271659.358947:0:6480:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788271659.358955:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f6eb0cef800 from 30 10000000:01000000:0.0:1788271659.358961:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788271659.359005:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078400/0x99288105fd38e503 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271659.359018:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078400/0x99288105fd38e503 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271659.359029:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078400/0x99288105fd38e503 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271659.359052:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590038016:0@lo:101: 00000100:00100000:0.0:1788271659.359129:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271659.359195:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e8a0d2840 going to sleep for 11 seconds 00000100:00100000:2.0:1788271659.359435:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590038016 00000100:00100000:2.0:1788271659.359444:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590038016 00000100:00100000:2.0:1788271659.359509:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788271659.359519:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+14:6480:x1875138590038016:12345-0@lo:101: 00010000:00010000:2.0:1788271659.359533:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271659.359545:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4e20400/0x99288105fd38e50a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e503 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271659.359566:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4e20400/0x99288105fd38e50a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e503 expref: 15 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271659.359584:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4e20400/0x99288105fd38e50a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e503 expref: 15 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271659.359592:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e20400, rc 0) 00000100:00100000:2.0:1788271659.359647:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:6480:x1875138590038016:12345-0@lo:101: Request processed in 130us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271659.359653:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788271659.359751:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590038016:0@lo:101: 00010000:00010000:0.0:1788271659.359766:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078400/0x99288105fd38e503 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e50a expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271659.359775:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078400/0x99288105fd38e503 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e50a expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271659.359843:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590038144:0@lo:501: 00000100:00100000:0.0:1788271659.359869:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271659.359897:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e8a0d2840 going to sleep for 11 seconds 00000100:00100000:2.0:1788271659.359999:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590038144 00000100:00100000:2.0:1788271659.360003:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590038144 00000100:00100000:2.0:1788271659.360033:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788271659.360040:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:6480:x1875138590038144:12345-0@lo:501: 00000100:00100000:2.0:1788271659.360164:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:6480:x1875138590038144:12345-0@lo:501: Request processed in 123us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271659.360171:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788271659.360242:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590038144:0@lo:501: 00000100:00100000:0.0:1788271659.360268:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590038272:0@lo:503: 00000100:00100000:0.0:1788271659.360306:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271659.360329:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e8a0d2840 going to sleep for 11 seconds 00000100:00100000:2.0:1788271659.360381:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590038272 00000100:00100000:2.0:1788271659.360385:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590038272 00000100:00100000:2.0:1788271659.360415:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788271659.360422:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:6480:x1875138590038272:12345-0@lo:503: 00000100:00100000:2.0:1788271659.360496:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:6480:x1875138590038272:12345-0@lo:503: Request processed in 74us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271659.360503:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788271659.360585:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590038272:0@lo:503: 00000100:00100000:0.0:1788271659.360957:0:8439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:8439:1875138590038400:0@lo:502: 00000100:00100000:0.0:1788271659.360992:0:8439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271659.361022:0:8439:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e8a0d2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271659.361070:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590038400 00000100:00100000:2.0:1788271659.361075:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590038400 00000100:00100000:2.0:1788271659.361113:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788271659.361120:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:8439:x1875138590038400:12345-0@lo:502: 00000100:00100000:2.0:1788271659.361192:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:8439:x1875138590038400:12345-0@lo:502: Request processed in 72us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271659.361205:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788271659.361462:0:8439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:8439:1875138590038400:0@lo:502: 00000100:00100000:0.0:1788271659.361506:0:8439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:8439:1875138590038528:0@lo:502: 00000100:00100000:0.0:1788271659.361538:0:8439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271659.362290:0:8439:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8161c840 going to sleep for 11 seconds 00000100:00100000:2.0:1788271659.369273:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590038528 00000100:00100000:2.0:1788271659.369290:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590038528 00000100:00100000:3.0:1788271659.370030:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788271659.370042:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:8439:x1875138590038528:12345-0@lo:502: 00000100:00100000:3.0:1788271659.370224:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:8439:x1875138590038528:12345-0@lo:502: Request processed in 183us (8684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271659.370232:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788271659.370393:0:8439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:8439:1875138590038528:0@lo:502: 00000040:00080000:0.0:1788271659.370430:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788271659.370604:0:6480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788271659.370653:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788271659.370664:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078400/0x99288105fd38e503 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e50a expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271659.370675:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078400/0x99288105fd38e503 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e50a expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271659.370684:0:6480:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788271659.370687:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f6eb0cef800 from 5 10000000:01000000:2.0:1788271659.370690:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788271659.370724:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20e00/0x99288105fd38e511 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271659.370732:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20e00/0x99288105fd38e511 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271659.370741:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20e00/0x99288105fd38e511 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271659.370760:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590038656:0@lo:101: 00000100:00100000:2.0:1788271659.370810:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271659.370841:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84ccab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788271659.371957:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590038656 00000100:00100000:0.0:1788271659.371968:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590038656 00000100:00100000:0.0:1788271659.372020:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788271659.372029:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:6480:x1875138590038656:12345-0@lo:101: 00010000:00010000:0.0:1788271659.372045:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271659.372065:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4078800/0x99288105fd38e518 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e511 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271659.372094:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4078800/0x99288105fd38e518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e511 expref: 16 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271659.372117:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4078800/0x99288105fd38e518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e511 expref: 16 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271659.372127:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4078800, rc 0) 00000100:00100000:0.0:1788271659.372186:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:6480:x1875138590038656:12345-0@lo:101: Request processed in 157us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271659.372192:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788271659.374154:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590038656:0@lo:101: 00010000:00010000:2.0:1788271659.374182:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20e00/0x99288105fd38e511 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e518 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271659.374207:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20e00/0x99288105fd38e511 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e518 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271659.374271:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590038784:0@lo:256: 00000100:00100000:2.0:1788271659.374323:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271659.374370:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84ccab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788271659.374431:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590038784 00000100:00100000:0.0:1788271659.374437:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590038784 00000100:00100000:0.0:1788271659.374489:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788271659.374498:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:6480:x1875138590038784:12345-0@lo:256: 20000000:01000000:0.0:1788271659.374517:0:6478:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788271659.374532:0:6478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788271659.374536:0:6478:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788271659.374651:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:6480:x1875138590038784:12345-0@lo:256: Request processed in 152us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271659.374659:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788271659.374747:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c61f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590038784:0@lo:256: 10000000:01000000:3.0:1788271659.374795:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788271659.374802:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20e00/0x99288105fd38e511 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e518 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271659.374810:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20e00/0x99288105fd38e511 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e518 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271659.374819:0:6480:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788271659.374822:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:3.0:1788271659.374825:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788271659.374849:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfc00/0x99288105fd38e51f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271659.374868:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfc00/0x99288105fd38e51f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271659.374878:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfc00/0x99288105fd38e51f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271659.374889:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0ccfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590038912:0@lo:101: 00000100:00100000:3.0:1788271659.374917:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271659.374947:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d81ee4180 going to sleep for 11 seconds 00000100:00100000:0.0:1788271659.375060:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590038912 00000100:00100000:0.0:1788271659.375070:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590038912 00000100:00100000:0.0:1788271659.375113:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788271659.375120:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:6480:x1875138590038912:12345-0@lo:101: 00010000:00010000:0.0:1788271659.375128:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271659.375140:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4079400/0x99288105fd38e526 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e51f expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271659.375159:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4079400/0x99288105fd38e526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e51f expref: 17 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271659.375168:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4079400/0x99288105fd38e526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e51f expref: 17 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271659.375177:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4079400, rc 0) 00000100:00100000:0.0:1788271659.375204:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:6480:x1875138590038912:12345-0@lo:101: Request processed in 85us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271659.375210:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788271659.375274:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0ccfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590038912:0@lo:101: 00010000:00010000:3.0:1788271659.375284:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfc00/0x99288105fd38e51f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e526 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271659.375293:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfc00/0x99288105fd38e51f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e526 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271659.375346:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0ccfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590039040:0@lo:501: 00000100:00100000:3.0:1788271659.375372:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271659.375395:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d81ee4180 going to sleep for 11 seconds 00000100:00100000:2.0:1788271659.375458:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590039040 00000100:00100000:2.0:1788271659.375463:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590039040 00000100:00100000:2.0:1788271659.375494:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788271659.375501:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:6480:x1875138590039040:12345-0@lo:501: 00000100:00100000:2.0:1788271659.375661:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:6480:x1875138590039040:12345-0@lo:501: Request processed in 159us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271659.375668:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788271659.375696:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0ccfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590039040:0@lo:501: 00000100:00100000:2.0:1788271659.375721:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590039168:0@lo:503: 00000100:00100000:2.0:1788271659.375760:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271659.375772:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84ccab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788271659.375782:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590039168 00000100:00100000:2.0:1788271659.375785:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590039168 00000100:00100000:3.0:1788271659.375900:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788271659.375908:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:6480:x1875138590039168:12345-0@lo:503: 00000100:00100000:3.0:1788271659.375986:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:6480:x1875138590039168:12345-0@lo:503: Request processed in 79us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271659.375993:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788271659.376048:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590039168:0@lo:503: 00000100:00100000:3.0:1788271659.376281:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0ccfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:8441:1875138590039296:0@lo:502: 00000100:00100000:3.0:1788271659.376318:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271659.376336:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590039296 00000100:00100000:3.0:1788271659.376340:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590039296 00000100:00100000:3.0:1788271659.376358:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788271659.376364:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:8441:x1875138590039296:12345-0@lo:502: 00000100:00100000:3.0:1788271659.376435:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:8441:x1875138590039296:12345-0@lo:502: Request processed in 70us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271659.376441:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788271659.376479:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d81ee4900 going to sleep for 11 seconds 00000100:00100000:3.0:1788271659.376491:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0ccfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:8441:1875138590039296:0@lo:502: 00000020:01000000:3.0:1788271659.376510:0:8441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788271659.376518:0:8441:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788271659.376533:0:8441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271659.376536:0:8441:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788271659.376540:0:8441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788271659.376544:0:8441:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.103@tcp to nid 0x20000c0a8c967 (192.168.201.103@tcp) 00000020:01000000:3.0:1788271659.376564:0:8441:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788271659.376567:0:8441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788271659.376580:0:8441:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8f6ebc9919b8) 00000020:00000080:3.0:1788271659.376600:0:8441:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1788271659.376605:0:8441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788271659.376711:0:8441:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788271659.376718:0:8441:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788271659.376725:0:8441:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x99288105fd38e534 00010000:00080000:3.0:1788271659.376752:0:8441:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f6eb63e7000@lustre-OST0000-osc-MDT0001: add connection 192.168.201.103@tcp at head 00010000:00010000:3.0:1788271659.376999:0:8441:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1788271659.406993:0:8441:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788271659.407049:0:8441:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1788271659.409534:0:8441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788271659.409966:0:8441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788271659.410122:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788271659.413259:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788271659.416229:0:8444:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788271659.416241:0:8444:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788271659.417919:0:8441:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788271659.419358:0:8441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788271659.419444:0:8441:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788271659.419483:0:8441:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x99288105fd38e53b 00000100:00080000:0.0:1788271659.419500:0:8441:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788271659.419522:0:8441:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8f6eb63e7000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:0.0:1788271659.419573:0:8441:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6eb3d2f480 x1875138590039424/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788271659.419614:0:8441:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1788271659.419860:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3605:1875138590039424:0@lo:8: 00000100:00100000:1.0:1788271659.419929:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271659.426597:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590039424 00000100:00100000:3.0:1788271659.426616:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590039424 00000100:00100000:3.0:1788271659.426722:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788271659.426734:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3605:x1875138590039424:12345-0@lo:8: 00010000:00080000:3.0:1788271659.426773:0:8396:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:3.0:1788271659.426807:0:8396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x99288105fd38e542 00002000:00100000:3.0:1788271659.426895:0:8396:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8f6eb63e4000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113940 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1788271659.426899:0:8396:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:3.0:1788271659.426903:0:8396:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788271659.426990:0:8396:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788271659.427357:0:8396:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1788271659.427398:0:8396:0:(import.c:65:import_set_state_nolock()) ffff8f6eb63e5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788271659.427517:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3605:x1875138590039424:12345-0@lo:8: Request processed in 785us (7587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271659.427524:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788271659.427598:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff8f6eb3d2f480 x1875138590039424/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788271669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271659.427613:0:3605:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788271659.427641:0:3605:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788271659.427650:0:3605:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788271659.427656:0:3605:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788271659.427660:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6eb63e7000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788271659.427697:0:3605:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788271659.427709:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3605:1875138590039424:0@lo:8: 00000004:00080000:1.0:1788271659.427753:0:8444:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000020:01000000:0.0:1788271659.427849:0:8441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788271659.427861:0:8441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271659.427864:0:8441:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788271659.427868:0:8441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000004:00080000:1.0:1788271659.427872:0:8444:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 220517251401ns, next at 0ns, rc = 0 00000020:00000080:0.0:1788271659.427875:0:8441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271659.427881:0:8441:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788271659.427888:0:8441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00080000:00080000:1.0:1788271659.427889:0:8444:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000020:00000080:0.0:1788271659.427890:0:8441:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788271659.427953:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:8441:1875138590039552:0@lo:502: 00000100:00100000:0.0:1788271659.428119:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271659.428164:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebcaf4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788271659.428262:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590039552 00000100:00100000:0.0:1788271659.428269:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590039552 00000100:00100000:0.0:1788271659.428311:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788271659.428320:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:8441:x1875138590039552:12345-0@lo:502: 00000100:00100000:0.0:1788271659.428600:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:8441:x1875138590039552:12345-0@lo:502: Request processed in 280us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271659.428723:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788271659.429066:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:8441:1875138590039552:0@lo:502: 00000100:00100000:3.0:1788271659.429075:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0ccfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8445:1875138590039680:0@lo:700: 00000020:01000000:1.0:1788271659.429127:0:8441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788271659.429136:0:8441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271659.429139:0:8441:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788271659.429145:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000100:00100000:3.0:1788271659.429158:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1788271659.429351:0:6480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:3.0:1788271659.429381:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788271659.429394:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfc00/0x99288105fd38e51f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e526 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271659.429408:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfc00/0x99288105fd38e51f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e526 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271659.429422:0:6480:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788271659.429425:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f6e91513000 from 30 10000000:01000000:3.0:1788271659.429429:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788271659.429458:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfe00/0x99288105fd38e549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271659.429478:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfe00/0x99288105fd38e549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271659.429490:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfe00/0x99288105fd38e549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271659.429502:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0ccc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590039808:0@lo:101: 00000100:00100000:3.0:1788271659.429550:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271659.429579:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ea686af00 going to sleep for 11 seconds 00000100:00100000:3.0:1788271659.429599:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ea686ab40 going to sleep for 11 seconds 00010000:00010000:3.0:1788271659.429735:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271659.429948:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590039808 00000100:00100000:1.0:1788271659.429957:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590039808 00000100:00100000:1.0:1788271659.430015:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788271659.430027:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:6480:x1875138590039808:12345-0@lo:101: 00010000:00010000:1.0:1788271659.430046:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271659.430064:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6e92d32800/0x99288105fd38e550 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e549 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271659.430106:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6e92d32800/0x99288105fd38e550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e549 expref: 18 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271659.430118:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6e92d32800/0x99288105fd38e550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e549 expref: 18 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271659.430129:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e92d32800, rc 0) 00000100:00100000:1.0:1788271659.430206:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+18:6480:x1875138590039808:12345-0@lo:101: Request processed in 181us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271659.430212:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788271659.430287:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0ccc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590039808:0@lo:101: 00010000:00010000:3.0:1788271659.430309:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfe00/0x99288105fd38e549 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e550 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271659.430322:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfe00/0x99288105fd38e549 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e550 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271659.430409:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0ccc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590039936:0@lo:501: 00000100:00100000:3.0:1788271659.430444:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271659.430471:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ea686af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788271659.430889:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590039680 00000100:00100000:0.0:1788271659.430897:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590039680 00000100:00100000:0.0:1788271659.431001:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788271659.431011:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0cce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8445:x1875138590039680:12345-0@lo:700: 00000100:00100000:0.0:1788271659.431054:0:8404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8404:1875138590040064:0@lo:700: 00000100:00100000:0.0:1788271659.431090:0:8404:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271659.431128:0:8404:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4d10300 going to sleep for 11 seconds 00000100:00100000:0.0:1788271659.431153:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590040064 00000100:00100000:0.0:1788271659.431157:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590040064 00000100:00080000:3.0:1788271659.431195:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788271659.431202:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788271659.431423:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788271659.431430:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8404:x1875138590040064:12345-0@lo:700: 00000100:00100000:0.0:1788271659.431594:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590039936 00000100:00100000:0.0:1788271659.431599:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590039936 00000100:00100000:0.0:1788271659.431649:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788271659.431656:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+18:6480:x1875138590039936:12345-0@lo:501: 00000100:00100000:0.0:1788271659.431824:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+18:6480:x1875138590039936:12345-0@lo:501: Request processed in 167us (1379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271659.431832:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788271659.431903:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0ccc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590039936:0@lo:501: 00000100:00100000:0.0:1788271659.431942:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590040192:0@lo:503: 00000100:00100000:0.0:1788271659.431994:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271659.432020:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4d10180 going to sleep for 11 seconds 00000100:00100000:0.0:1788271659.432035:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590040192 00000100:00100000:0.0:1788271659.432039:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590040192 00000100:00100000:0.0:1788271659.432062:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788271659.432069:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+18:6480:x1875138590040192:12345-0@lo:503: 00000100:00100000:0.0:1788271659.432172:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+18:6480:x1875138590040192:12345-0@lo:503: Request processed in 102us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271659.432179:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788271659.432234:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590040192:0@lo:503: 00000100:00100000:0.0:1788271659.432794:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:8447:1875138590040320:0@lo:502: 00000100:00100000:0.0:1788271659.432838:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271659.432873:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590040320 00000100:00100000:0.0:1788271659.432877:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590040320 00000100:00100000:0.0:1788271659.432905:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788271659.432912:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+18:8447:x1875138590040320:12345-0@lo:502: 00000100:00100000:0.0:1788271659.433008:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+18:8447:x1875138590040320:12345-0@lo:502: Request processed in 95us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271659.433016:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788271659.433052:0:8447:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4d10e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788271659.433064:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:8447:1875138590040320:0@lo:502: 00000100:00100000:0.0:1788271659.433120:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:8447:1875138590040448:0@lo:502: 00000100:00100000:0.0:1788271659.433156:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271659.433371:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590040448 00000100:00100000:0.0:1788271659.433377:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590040448 00000100:00100000:0.0:1788271659.433401:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788271659.433407:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+18:8447:x1875138590040448:12345-0@lo:502: 00000100:00100000:0.0:1788271659.433473:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+18:8447:x1875138590040448:12345-0@lo:502: Request processed in 65us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271659.433479:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788271659.433604:0:8447:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4d10e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788271659.433652:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:8447:1875138590040448:0@lo:502: 00000040:00080000:0.0:1788271659.433693:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788271659.433759:0:6480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788271659.433791:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788271659.433805:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfe00/0x99288105fd38e549 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e550 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271659.433817:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfe00/0x99288105fd38e549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e550 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271659.433835:0:6480:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788271659.433838:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f6e91513000 from 5 10000000:01000000:0.0:1788271659.433842:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788271659.433871:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e557 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271659.433881:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e557 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271659.433891:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e557 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271659.433905:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590040576:0@lo:101: 00000100:00100000:0.0:1788271659.433936:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271659.433949:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4d10e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788271659.433963:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590040576 00000100:00100000:0.0:1788271659.433967:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590040576 00000100:00100000:0.0:1788271659.433992:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788271659.433998:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+18:6480:x1875138590040576:12345-0@lo:101: 00010000:00010000:0.0:1788271659.434009:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271659.434313:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4078a00/0x99288105fd38e55e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e557 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271659.434350:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4078a00/0x99288105fd38e55e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e557 expref: 19 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271659.434362:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4078a00/0x99288105fd38e55e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e557 expref: 19 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271659.434385:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4078a00, rc 0) 00000100:00100000:0.0:1788271659.434422:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+19:6480:x1875138590040576:12345-0@lo:101: Request processed in 423us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271659.434434:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788271659.434475:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590040576:0@lo:101: 00010000:00010000:0.0:1788271659.434489:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e557 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e55e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271659.434498:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e557 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e55e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271659.434955:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590040704:0@lo:256: 00000100:00100000:0.0:1788271659.435021:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271659.435052:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4d10e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788271659.435080:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590040704 00000100:00100000:0.0:1788271659.435085:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590040704 00000100:00100000:0.0:1788271659.435129:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788271659.435137:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+19:6480:x1875138590040704:12345-0@lo:256: 20000000:01000000:0.0:1788271659.435154:0:6478:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788271659.435175:0:6478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788271659.435179:0:6478:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000004:00080000:3.0:1788271659.437039:0:7414:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1788271659.437483:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+19:6480:x1875138590040704:12345-0@lo:256: Request processed in 2337us (2453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271659.437498:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788271659.437821:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590040704:0@lo:256: 10000000:01000000:0.0:1788271659.437912:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788271659.437935:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e557 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e55e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271659.437949:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e55e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271659.437962:0:6480:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788271659.437966:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1788271659.437970:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788271659.438015:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e565 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271659.438025:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e565 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271659.438036:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e565 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271659.438062:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590040832:0@lo:101: 00000100:00100000:0.0:1788271659.438265:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271659.438304:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4d10e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788271659.438324:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590040832 00000100:00100000:0.0:1788271659.438332:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590040832 00000100:00100000:0.0:1788271659.438477:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788271659.438487:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+19:6480:x1875138590040832:12345-0@lo:101: 00010000:00010000:0.0:1788271659.438503:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271659.438519:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4079c00/0x99288105fd38e56c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e565 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271659.438615:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4079c00/0x99288105fd38e56c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e565 expref: 20 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271659.438716:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4079c00/0x99288105fd38e56c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e565 expref: 20 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271659.438726:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4079c00, rc 0) 00000100:00100000:0.0:1788271659.438764:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:6480:x1875138590040832:12345-0@lo:101: Request processed in 277us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271659.438770:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788271659.438835:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590040832:0@lo:101: 00010000:00010000:0.0:1788271659.438852:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e565 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e56c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271659.438862:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e565 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e56c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271659.438933:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590040960:0@lo:501: 00000100:00100000:0.0:1788271659.438962:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271659.438985:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4d10e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788271659.439000:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590040960 00000100:00100000:0.0:1788271659.439004:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590040960 00000100:00100000:0.0:1788271659.439031:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788271659.439038:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:6480:x1875138590040960:12345-0@lo:501: 00000100:00100000:0.0:1788271659.440527:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:6480:x1875138590040960:12345-0@lo:501: Request processed in 1480us (1556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271659.440726:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788271659.447084:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590040960:0@lo:501: 00000100:00100000:1.0:1788271659.447158:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590041088:0@lo:503: 00000100:00100000:1.0:1788271659.447241:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271659.447286:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e8a366300 going to sleep for 11 seconds 00000100:00100000:0.0:1788271659.448800:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590041088 00000100:00100000:0.0:1788271659.448819:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590041088 00000100:00100000:0.0:1788271659.448922:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788271659.448935:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:6480:x1875138590041088:12345-0@lo:503: 00000100:00100000:0.0:1788271659.449162:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:6480:x1875138590041088:12345-0@lo:503: Request processed in 230us (1920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271659.449171:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788271659.450946:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590041088:0@lo:503: 40000000:02000000:0.0:1788271659.451054:0:6490:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:1.0:1788271659.455910:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:8448:1875138590041216:0@lo:502: 00000100:00100000:1.0:1788271659.456004:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271659.456054:0:8448:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e89ab8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788271659.456685:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590041216 00000100:00100000:3.0:1788271659.456701:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590041216 00000100:00100000:3.0:1788271659.456787:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788271659.456801:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:8448:x1875138590041216:12345-0@lo:502: 00000100:00100000:3.0:1788271659.457027:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:8448:x1875138590041216:12345-0@lo:502: Request processed in 227us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271659.457039:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788271659.457061:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:8448:1875138590041216:0@lo:502: 00000020:01000000:1.0:1788271659.457119:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788271659.457132:0:8448:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788271659.457140:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271659.457142:0:8448:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788271659.457148:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788271659.457152:0:8448:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.103@tcp to nid 0x20000c0a8c967 (192.168.201.103@tcp) 00000020:01000000:1.0:1788271659.457174:0:8448:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788271659.457178:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788271659.457194:0:8448:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8f6eb3cd19b8) 00000020:00000080:1.0:1788271659.457217:0:8448:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:1.0:1788271659.457223:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788271659.457319:0:8448:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788271659.457325:0:8448:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788271659.457332:0:8448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x99288105fd38e57a 00010000:00080000:1.0:1788271659.457362:0:8448:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f6ebcbd5800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.103@tcp at head 00010000:00010000:1.0:1788271659.457581:0:8448:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:0.0:1788271659.459871:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8404:x1875138590040064:12345-0@lo:700: Request processed in 28433us (28771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271659.459886:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788271659.459955:0:8404:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6eb3d2e300 x1875138590040064/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788271675 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271659.459973:0:8404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2e300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8404:1875138590040064:0@lo:700: 40000000:02000000:0.0:1788271659.459989:0:8404:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000001:00100000:2.0:1788271659.476591:0:8391:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788271659.476792:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0cce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8445:x1875138590039680:12345-0@lo:700: Request processed in 45774us (47627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271659.476816:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788271659.477146:0:8445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6eb0ccfb80 x1875138590039680/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788271675 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271659.477168:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0ccfb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8445:1875138590039680:0@lo:700: 00000040:01000000:2.0:1788271659.479831:0:8448:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788271659.479851:0:8448:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788271659.480054:0:8448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788271659.480275:0:8448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788271659.480335:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788271659.480398:0:8448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788271659.481590:0:8450:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788271659.481595:0:8450:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788271659.484348:0:8448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788271659.484364:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788271659.484414:0:8448:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788271659.484443:0:8448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x99288105fd38e581 00000100:00080000:0.0:1788271659.484455:0:8448:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788271659.484461:0:8448:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f6ebcbd5800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:0.0:1788271659.484502:0:8448:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6eb3d2e300 x1875138590041344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788271659.484577:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3605:1875138590041344:0@lo:8: 00000100:00100000:2.0:1788271659.484680:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788271659.484765:0:8448:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788271659.484866:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788271659.484887:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271659.484889:0:8448:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788271659.484894:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788271659.484898:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271659.484899:0:8448:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788271659.484902:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788271659.484904:0:8448:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788271659.484928:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:8448:1875138590041472:0@lo:502: 00000100:00100000:0.0:1788271659.484974:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271659.485000:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590041472 00000100:00100000:0.0:1788271659.485006:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590041472 00000100:00100000:0.0:1788271659.485049:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788271659.485058:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:8448:x1875138590041472:12345-0@lo:502: 00000100:00100000:0.0:1788271659.485177:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:8448:x1875138590041472:12345-0@lo:502: Request processed in 120us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271659.485185:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788271659.485221:0:8448:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4d10cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271659.485239:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:8448:1875138590041472:0@lo:502: 00000020:01000000:0.0:1788271659.485262:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788271659.485265:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271659.485267:0:8448:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788271659.485270:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1788271659.485316:0:6480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1788271659.485334:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788271659.485343:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e565 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e56c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271659.485353:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e565 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e56c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271659.485373:0:6480:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788271659.485376:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f6e85beb370 from 1 10000000:01000000:0.0:1788271659.485379:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788271659.485402:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078000/0x99288105fd38e588 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271659.485410:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078000/0x99288105fd38e588 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271659.485419:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078000/0x99288105fd38e588 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271659.485432:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590041600:0@lo:101: 00000100:00100000:0.0:1788271659.485459:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271659.485473:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4d10cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271659.485486:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590041600 00000100:00100000:0.0:1788271659.485490:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590041600 00000100:00100000:0.0:1788271659.485512:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788271659.485518:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:6480:x1875138590041600:12345-0@lo:101: 00010000:00010000:0.0:1788271659.485526:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271659.485538:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4079e00/0x99288105fd38e58f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e588 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271659.485557:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4079e00/0x99288105fd38e58f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e588 expref: 21 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271659.485567:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4079e00/0x99288105fd38e58f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e588 expref: 21 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271659.485586:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4079e00, rc 0) 00000100:00100000:0.0:1788271659.485615:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:6480:x1875138590041600:12345-0@lo:101: Request processed in 97us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271659.485638:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788271659.485670:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590041600:0@lo:101: 00010000:00010000:0.0:1788271659.485680:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078000/0x99288105fd38e588 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e58f expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271659.485689:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078000/0x99288105fd38e588 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e58f expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271659.485729:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590041728:0@lo:501: 00000100:00100000:0.0:1788271659.485752:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271659.485764:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4d10cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271659.485776:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590041728 00000100:00100000:0.0:1788271659.485779:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590041728 00000100:00100000:0.0:1788271659.485800:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788271659.485806:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:6480:x1875138590041728:12345-0@lo:501: 00000100:00100000:0.0:1788271659.485867:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:6480:x1875138590041728:12345-0@lo:501: Request processed in 59us (113us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788271659.485874:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788271659.485898:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590041728:0@lo:501: 10000000:01000000:0.0:1788271659.485915:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788271659.485920:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078000/0x99288105fd38e588 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e58f expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271659.485940:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078000/0x99288105fd38e588 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e58f expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271659.487301:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590041344 00000100:00100000:2.0:1788271659.487312:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590041344 00000100:00100000:2.0:1788271659.487350:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788271659.487357:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3605:x1875138590041344:12345-0@lo:8: 00010000:00080000:2.0:1788271659.487389:0:8398:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:2.0:1788271659.487420:0:8398:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x99288105fd38e596 00002000:00100000:2.0:1788271659.487435:0:8398:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8f6d81dc1800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113940 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788271659.487440:0:8398:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788271659.487443:0:8398:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788271659.487527:0:8398:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788271659.487553:0:8398:0:(import.c:65:import_set_state_nolock()) ffff8f6d81dc3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788271659.487615:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0c62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3605:x1875138590041344:12345-0@lo:8: Request processed in 257us (2934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271659.487683:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788271659.487725:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6eb3d2e300 x1875138590041344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788271669 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271659.487736:0:3605:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788271659.487743:0:3605:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788271659.487750:0:3605:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788271659.487755:0:3605:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788271659.487758:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6ebcbd5800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788271659.487925:0:3605:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788271659.487942:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3605:1875138590041344:0@lo:8: 00000004:00080000:0.0:1788271659.488046:0:8450:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788271659.488833:0:8450:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 220578210216ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788271659.488845:0:8450:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1788271659.491728:0:8445:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788271659.491745:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590041856:0@lo:13: 00000100:00100000:2.0:1788271659.491770:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c61180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8445:1875138590041984:0@lo:7: 00000100:00100000:1.0:1788271659.495018:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271659.495375:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590041856 00000100:00100000:3.0:1788271659.495388:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590041856 00000100:00100000:3.0:1788271659.495451:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788271659.495464:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590041856:12345-0@lo:13: 00002000:00000024:3.0:1788271659.495496:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3924074496 avail 3692552192 00000100:00100000:3.0:1788271659.495565:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590041856:12345-0@lo:13: Request processed in 103us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271659.495573:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788271659.495662:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6eb0c61f80 x1875138590041856/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271675 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271659.495690:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590041856:0@lo:13: 00000100:00100000:3.0:1788271659.497592:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271659.497686:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590041984 00000100:00100000:0.0:1788271659.497702:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590041984 00000100:00100000:0.0:1788271659.497778:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788271659.497793:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8445:x1875138590041984:12345-0@lo:7: 00000100:00100000:3.0:1788271659.497834:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e83021a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788271659.499552:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788271659.499580:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0ccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590042112:0@lo:13: 00000100:00100000:3.0:1788271659.499705:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271659.499769:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590042112 00000100:00100000:3.0:1788271659.499779:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590042112 00000100:00100000:3.0:1788271659.499860:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788271659.499877:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3608:x1875138590042112:12345-0@lo:13: 00002000:00000024:3.0:1788271659.499918:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3924074496 avail 3692552192 00000100:00100000:3.0:1788271659.499992:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3608:x1875138590042112:12345-0@lo:13: Request processed in 119us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271659.500002:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788271659.500036:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788271659.500084:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6eb0ccd500 x1875138590042112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271675 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00002000:00080000:0.0:1788271659.500780:0:8396:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788271659.500789:0:8396:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788271659.500885:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8445:x1875138590041984:12345-0@lo:7: Request processed in 3094us (3298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271659.500895:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788271659.500959:0:8445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6eb0c61180 x1875138590041984/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788271675 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271659.500978:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c61180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8445:1875138590041984:0@lo:7: 00000004:00080000:1.0:1788271659.501005:0:8445:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788271659.501049:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816ce300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8445:1875138590042240:0@lo:5: 00000100:00100000:1.0:1788271659.501091:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271659.501157:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590042240 00000100:00100000:2.0:1788271659.501166:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590042240 00000100:00100000:3.0:1788271659.501207:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0ccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590042112:0@lo:13: 00000100:00100000:2.0:1788271659.501215:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788271659.501226:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8445:x1875138590042240:12345-0@lo:5: 00000004:00080000:3.0:1788271659.501238:0:8451:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00002000:00080000:2.0:1788271659.501262:0:8397:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1788271659.501270:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0ccd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8451:1875138590042368:0@lo:7: 00000100:00100000:3.0:1788271659.501317:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271659.501345:0:8451:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ea686ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788271659.501390:0:8396:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788271659.501397:0:8396:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788271659.501693:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590042368 00000100:00100000:0.0:1788271659.501699:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590042368 00000100:00100000:3.0:1788271659.502174:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788271659.502199:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0cce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8451:x1875138590042368:12345-0@lo:7: 00000100:00100000:2.0:1788271659.504713:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8445:x1875138590042240:12345-0@lo:5: Request processed in 3479us (3611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271659.504726:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00002000:00080000:3.0:1788271659.514195:0:8452:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1788271659.514207:0:8452:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788271659.514579:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0cce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8451:x1875138590042368:12345-0@lo:7: Request processed in 12139us (13018us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271659.514596:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788271659.514694:0:8451:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6eb0ccd500 x1875138590042368/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788271675 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271659.514712:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0ccd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8451:1875138590042368:0@lo:7: 00000004:00080000:2.0:1788271659.514728:0:8451:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788271659.514773:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c62a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8451:1875138590042496:0@lo:5: 00000100:00100000:2.0:1788271659.514844:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271659.520018:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e89ab8a80 going to sleep for 11 seconds 00010000:00080000:0.0:1788271659.520121:0:8445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d816ce300 x1875138590042240/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788271675 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271659.520139:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816ce300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8445:1875138590042240:0@lo:5: 00000004:00080000:0.0:1788271659.520158:0:8445:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788271659.520207:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8445:1875138590042624:0@lo:5: 00000100:00100000:0.0:1788271659.520581:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590042496 00000100:00100000:0.0:1788271659.520588:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590042496 00000100:00100000:0.0:1788271659.520688:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788271659.520698:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0c61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8451:x1875138590042496:12345-0@lo:5: 00002000:00080000:0.0:1788271659.520742:0:8396:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788271659.520746:0:8396:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000004:00080000:1.0:1788271659.521844:0:6462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788271659.526539:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271659.526586:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4d10f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788271659.526668:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590042624 00000100:00100000:2.0:1788271659.526678:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590042624 00000100:00100000:2.0:1788271659.526730:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788271659.526740:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8445:x1875138590042624:12345-0@lo:5: 00002000:00080000:2.0:1788271659.526784:0:8398:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000001:00080000:1.0:1788271659.531109:0:8391:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1788271659.531138:0:8391:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788271659.531390:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0c61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8451:x1875138590042496:12345-0@lo:5: Request processed in 10684us (16536us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788271659.531404:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788271659.531688:0:8451:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e830210c0 going to sleep for 11 seconds 00010000:00080000:0.0:1788271659.531721:0:8451:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6eb0c62a00 x1875138590042496/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788271675 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271659.531734:0:8451:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788271659.531741:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c62a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8451:1875138590042496:0@lo:5: 00000004:00080000:0.0:1788271659.531757:0:8451:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788271659.531820:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8451:1875138590042752:0@lo:700: 00000100:00100000:0.0:1788271659.531857:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271659.531886:0:8451:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4d10180 going to sleep for 11 seconds 00000100:00100000:1.0:1788271659.531941:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590042752 00000100:00100000:1.0:1788271659.531955:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590042752 00000100:00100000:1.0:1788271659.532033:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788271659.532047:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8451:x1875138590042752:12345-0@lo:700: 00000100:00100000:2.0:1788271659.533567:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8445:x1875138590042624:12345-0@lo:5: Request processed in 6822us (7029us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788271659.533580:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788271659.534519:0:8445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6eb3d2c380 x1875138590042624/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788271675 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271659.534546:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8445:1875138590042624:0@lo:5: 00000004:00080000:1.0:1788271659.534565:0:8445:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:1.0:1788271659.534722:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816ced80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8445:1875138590042880:0@lo:900: 00000100:00100000:1.0:1788271659.534793:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271659.534833:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e89ab8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788271659.535106:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590042880 00000100:00100000:2.0:1788271659.535134:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590042880 00000100:00100000:2.0:1788271659.535200:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788271659.535210:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8445:x1875138590042880:12345-0@lo:900: 00000100:00100000:2.0:1788271659.535308:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8445:x1875138590042880:12345-0@lo:900: Request processed in 98us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271659.535316:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788271659.535375:0:8445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d816ced80 x1875138590042880/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788271675 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271659.535389:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816ced80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8445:1875138590042880:0@lo:900: 00000001:00080000:2.0:1788271659.548312:0:8391:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:1.0:1788271659.548506:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8451:x1875138590042752:12345-0@lo:700: Request processed in 16457us (16644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271659.548521:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788271659.548616:0:8451:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6eb3d2d500 x1875138590042752/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788271675 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271659.548664:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8451:1875138590042752:0@lo:700: 00000100:00100000:2.0:1788271659.550017:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590043008:0@lo:41: 00000100:00100000:2.0:1788271659.550089:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271659.550274:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590043008 00000100:00100000:1.0:1788271659.550283:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590043008 00000100:00100000:1.0:1788271659.550342:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788271659.550352:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590043008:12345-0@lo:41: 00000004:00000024:1.0:1788271659.550382:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788271659.550423:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590043008:12345-0@lo:41: Request processed in 73us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271659.550440:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788271659.550528:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590043008:0@lo:41: 00000004:02000040:2.0:1788271659.551356:0:8451:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:2.0:1788271659.554872:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c62a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8451:1875138590043136:0@lo:5: 00000100:00100000:2.0:1788271659.554963:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271659.555008:0:8451:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e830210c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271659.558966:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590043136 00000100:00100000:0.0:1788271659.558988:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590043136 00000100:00100000:0.0:1788271659.559083:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788271659.559130:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4ec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8451:x1875138590043136:12345-0@lo:5: 00002000:00080000:1.0:1788271659.571155:0:8397:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788271659.571174:0:8397:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:1.0:1788271659.572682:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4ec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8451:x1875138590043136:12345-0@lo:5: Request processed in 13550us (17712us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788271659.572699:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788271659.572879:0:8451:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6eb0c62a00 x1875138590043136/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788271675 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271659.572910:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c62a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8451:1875138590043136:0@lo:5: 00000004:00080000:0.0:1788271659.572930:0:8451:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000020:00000004:0.0:1788271660.158396:0:8484:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788271660.158602:0:8484:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788271660.446097:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271660.574647:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788271660.574673:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590043264:0@lo:41: 00000100:00100000:3.0:1788271660.574744:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271660.574802:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590043264 00000100:00100000:1.0:1788271660.574810:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590043264 00000100:00100000:1.0:1788271660.574858:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788271660.574868:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0ccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590043264:12345-0@lo:41: 00000004:00000024:1.0:1788271660.574903:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788271660.574961:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0ccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590043264:12345-0@lo:41: Request processed in 94us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271660.574968:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788271660.575109:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590043264:0@lo:41: 00010000:00010000:3.0:1788271661.469865:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271662.495081:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271663.518559:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271664.544052:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271664.670530:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0ccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590043392:0@lo:400: 00000100:00100000:3.0:1788271664.670610:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271664.670671:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590043904:0@lo:400: 00000100:00100000:3.0:1788271664.670695:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271664.670712:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82238700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590044416:0@lo:400: 00000100:00100000:3.0:1788271664.670733:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271664.670754:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788271664.670760:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0ccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875138590043520:0@lo:400: 00000100:00100000:3.0:1788271664.670781:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271664.670797:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82238380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3608:1875138590044032:0@lo:400: 00000100:00100000:3.0:1788271664.670819:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271664.670844:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590043648:0@lo:400: 00000100:00100000:3.0:1788271664.670865:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271664.670880:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8223b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3606:1875138590044160:0@lo:400: 00000100:00100000:3.0:1788271664.670900:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271664.670913:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788271664.670917:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875138590043776:0@lo:400: 00000100:00100000:3.0:1788271664.670935:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271664.670944:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590044288:0@lo:400: 00000100:00100000:3.0:1788271664.670961:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271664.670991:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590043904 00000100:00100000:3.0:1788271664.670997:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590043904 00000100:00100000:3.0:1788271664.671044:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590043648 00000100:00100000:3.0:1788271664.671047:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590043648 00000100:00100000:3.0:1788271664.671063:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788271664.671070:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590043904:12345-0@lo:400: 00000100:00100000:3.0:1788271664.671121:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590043904:12345-0@lo:400: Request processed in 52us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271664.671135:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788271664.671152:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788271664.671158:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82238e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590043648:12345-0@lo:400: 00000100:00100000:3.0:1788271664.671187:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82238e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590043648:12345-0@lo:400: Request processed in 30us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271664.671193:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788271664.671472:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590043392 00000100:00100000:0.0:1788271664.671476:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590043392 00000100:00100000:0.0:1788271664.671503:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788271664.671510:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:3608:x1875138590043392:12345-0@lo:400: 00000100:00100000:0.0:1788271664.671542:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:3608:x1875138590043392:12345-0@lo:400: Request processed in 32us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271664.671548:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788271664.671574:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590044416 00000100:00100000:0.0:1788271664.671577:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590044416 00000100:00100000:0.0:1788271664.671612:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590044288 00000100:00100000:0.0:1788271664.671616:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590044288 00000100:00100000:0.0:1788271664.671653:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788271664.671659:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8223a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3608:x1875138590044416:12345-0@lo:400: 00000100:00100000:0.0:1788271664.671687:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8223a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3608:x1875138590044416:12345-0@lo:400: Request processed in 28us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271664.671693:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788271664.671702:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788271664.671708:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82239c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590044288:12345-0@lo:400: 00000100:00100000:0.0:1788271664.671730:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82239c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590044288:12345-0@lo:400: Request processed in 22us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271664.671745:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788271664.671760:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590043520 00000100:00100000:0.0:1788271664.671763:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590043520 00000100:00100000:0.0:1788271664.671777:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590044032 00000100:00100000:0.0:1788271664.671780:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590044032 00000100:00100000:0.0:1788271664.671790:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590044160 00000100:00100000:0.0:1788271664.671792:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590044160 00000100:00100000:0.0:1788271664.671803:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590043776 00000100:00100000:0.0:1788271664.671804:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590043776 00000100:00100000:0.0:1788271664.671814:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788271664.671820:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875138590043520:12345-0@lo:400: 00000100:00100000:0.0:1788271664.671847:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82238000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875138590043520:12345-0@lo:400: Request processed in 27us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271664.671853:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788271664.671862:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788271664.671868:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8223ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875138590044032:12345-0@lo:400: 00000100:00100000:0.0:1788271664.671889:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8223ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875138590044032:12345-0@lo:400: Request processed in 22us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271664.671894:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788271664.671903:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788271664.671909:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8223b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1875138590044160:12345-0@lo:400: 00000100:00100000:0.0:1788271664.671930:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8223b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1875138590044160:12345-0@lo:400: Request processed in 22us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271664.671935:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788271664.671945:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788271664.671950:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1875138590043776:12345-0@lo:400: 00000100:00100000:0.0:1788271664.671971:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82239180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1875138590043776:12345-0@lo:400: Request processed in 22us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271664.671983:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1788271664.672026:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788271664.672030:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788271664.672033:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788271664.672041:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788271664.672050:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590044672:0@lo:13: 00000100:00100000:0.0:1788271664.672076:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271664.672105:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590044672 00000100:00100000:0.0:1788271664.672108:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590044672 00000100:00100000:0.0:1788271664.672129:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788271664.672136:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590044672:12345-0@lo:13: 00002000:00000024:0.0:1788271664.672156:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788271664.672187:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590044672:12345-0@lo:13: Request processed in 52us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271664.672192:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788271664.672278:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590044544:0@lo:13: 00000100:00100000:0.0:1788271664.672304:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788271664.672343:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6eb3d2d500 x1875138590044672/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271680 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271664.672354:0:3607:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788271664.672374:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590044672:0@lo:13: 00000100:00100000:0.0:1788271664.672390:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590044544 00000100:00100000:0.0:1788271664.672393:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590044544 00000100:00100000:0.0:1788271664.672413:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788271664.672418:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3609:x1875138590044544:12345-0@lo:13: 00002000:00000024:0.0:1788271664.672427:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788271664.672460:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3609:x1875138590044544:12345-0@lo:13: Request processed in 42us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271664.672466:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788271664.672488:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6eb3d2df80 x1875138590044544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271680 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271664.672501:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590044544:0@lo:13: 00010000:00080000:3.0:1788271664.672744:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6e85808a80 x1875138590043776/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271664.672752:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875138590043776:0@lo:400: 00010000:00080000:3.0:1788271664.672758:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d82239880 x1875138590044288/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271664.672763:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590044288:0@lo:400: 00000100:00100000:3.0:1788271664.672770:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590043648:0@lo:400: 00010000:00080000:3.0:1788271664.672775:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d8223b100 x1875138590044160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271664.672780:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8223b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3606:1875138590044160:0@lo:400: 00010000:00080000:3.0:1788271664.672800:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6eb0ccc380 x1875138590043520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271664.672804:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0ccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875138590043520:0@lo:400: 00010000:00080000:3.0:1788271664.672809:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d82238380 x1875138590044032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271664.672814:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82238380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3608:1875138590044032:0@lo:400: 00000100:00100000:3.0:1788271664.672828:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0ccd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590043392:0@lo:400: 00000100:00100000:3.0:1788271664.672833:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590043904:0@lo:400: 00010000:00080000:3.0:1788271664.672838:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d82238700 x1875138590044416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271664.672843:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82238700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590044416:0@lo:400: 00000100:00100000:2.0:1788271664.673061:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590044800:0@lo:41: 00000100:00100000:2.0:1788271664.673090:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271664.673111:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590044800 00000100:00100000:3.0:1788271664.673116:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590044800 00000100:00100000:3.0:1788271664.673283:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788271664.673294:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4ec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590044800:12345-0@lo:41: 00000004:00000024:3.0:1788271664.673320:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788271664.673359:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4ec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590044800:12345-0@lo:41: Request processed in 69us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271664.673366:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788271664.673417:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590044800:0@lo:41: 00000001:00080000:2.0:1788271664.673837:0:8391:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:02000400:0.0:1788271665.096710:0:8774:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg103-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788271665.577115:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271665.701703:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788271665.701730:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82238700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590044928:0@lo:41: 00000100:00100000:0.0:1788271665.701801:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271665.701879:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590044928 00000100:00100000:0.0:1788271665.701887:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590044928 00000100:00100000:0.0:1788271665.701932:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788271665.701942:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590044928:12345-0@lo:41: 00000004:00000024:0.0:1788271665.701982:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788271665.702049:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590044928:12345-0@lo:41: Request processed in 108us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271665.702056:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788271665.702106:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82238700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590044928:0@lo:41: 00000020:00000004:2.0:1788271665.962767:0:8826:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788271665.963001:0:8826:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788271666.590282:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271667.614911:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271668.637973:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788271668.686376:0:8927:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788271668.686849:0:8927:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:1.0:1788271669.551969:0:8975:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788271669.551987:0:8975:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:3.0:1788271669.662908:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271669.790577:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788271669.790612:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82238380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590045056:0@lo:13: 00000100:00100000:3.0:1788271669.790720:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271669.790981:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ec9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875138590045312:0@lo:400: 00000100:00100000:2.0:1788271669.791021:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271669.791082:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3607:1875138590045824:0@lo:400: 00000100:00100000:2.0:1788271669.791109:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271669.791151:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788271669.791157:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590045184:0@lo:400: 00000100:00100000:3.0:1788271669.791533:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590045440:0@lo:400: 00000100:00100000:3.0:1788271669.791564:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271669.791583:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ecad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3608:1875138590045952:0@lo:400: 00000100:00100000:3.0:1788271669.791604:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271669.791640:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788271669.791646:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ec8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875138590045568:0@lo:400: 00000100:00100000:3.0:1788271669.791681:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271669.791692:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ec8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590046080:0@lo:400: 00000100:00100000:3.0:1788271669.791717:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271669.792574:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271669.792633:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4eca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590045696:0@lo:400: 00000100:00100000:2.0:1788271669.792661:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271669.792679:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ecb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590046208:0@lo:400: 00000100:00100000:3.0:1788271669.792924:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590045312 00000100:00100000:3.0:1788271669.792934:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590045312 00000100:00100000:3.0:1788271669.792983:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590045824 00000100:00100000:3.0:1788271669.792986:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590045824 00000100:00100000:3.0:1788271669.793009:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590045952 00000100:00100000:3.0:1788271669.793012:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590045952 00000100:00100000:3.0:1788271669.793022:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590045568 00000100:00100000:3.0:1788271669.793024:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590045568 00000100:00100000:3.0:1788271669.793038:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788271669.793047:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4ec9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875138590045312:12345-0@lo:400: 00000100:00100000:3.0:1788271669.793107:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4ec9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875138590045312:12345-0@lo:400: Request processed in 61us (2085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271669.793115:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788271669.793132:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788271669.793138:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875138590045824:12345-0@lo:400: 00000100:00100000:3.0:1788271669.793970:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4ec9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875138590045824:12345-0@lo:400: Request processed in 825us (2852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271669.793980:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788271669.793999:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788271669.794006:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8223aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875138590045952:12345-0@lo:400: 00000100:00100000:3.0:1788271669.794040:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8223aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875138590045952:12345-0@lo:400: Request processed in 36us (2435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271669.794047:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788271669.794056:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788271669.794063:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8223a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875138590045568:12345-0@lo:400: 00000100:00100000:3.0:1788271669.794099:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8223a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875138590045568:12345-0@lo:400: Request processed in 37us (2419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271669.794106:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788271669.794126:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271669.796980:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590045440 00000100:00100000:1.0:1788271669.797003:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590045440 00000100:00100000:1.0:1788271669.797058:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590045696 00000100:00100000:1.0:1788271669.797061:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590045696 00000100:00100000:1.0:1788271669.797083:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788271669.797096:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590045440:12345-0@lo:400: 00000100:00100000:1.0:1788271669.797228:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590045440:12345-0@lo:400: Request processed in 134us (5662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271669.797236:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788271669.797266:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788271669.797274:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590045696:12345-0@lo:400: 00000100:00100000:1.0:1788271669.797307:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590045696:12345-0@lo:400: Request processed in 35us (4646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271669.797312:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788271669.797341:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590045056 00000100:00100000:1.0:1788271669.797346:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590045056 00000100:00100000:1.0:1788271669.797384:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788271669.797390:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8223b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590045056:12345-0@lo:13: 00002000:00000024:1.0:1788271669.797418:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788271669.797464:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8223b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590045056:12345-0@lo:13: Request processed in 74us (6745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271669.797471:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788271669.797542:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788271669.797557:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590046464:0@lo:13: 00000100:00100000:1.0:1788271669.797597:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271669.797644:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590046464 00000100:00100000:1.0:1788271669.797648:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590046464 00000100:00100000:1.0:1788271669.797665:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788271669.797670:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590046464:12345-0@lo:13: 00002000:00000024:1.0:1788271669.797679:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788271669.797703:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590046464:12345-0@lo:13: Request processed in 33us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271669.797709:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788271669.797754:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d816cd180 x1875138590046464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271685 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271669.797782:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590046464:0@lo:13: 00010000:00080000:3.0:1788271669.800405:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6eb4ec9880 x1875138590045312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271669.800439:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ec9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875138590045312:0@lo:400: 00010000:00080000:3.0:1788271669.800457:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6eb4ec8000 x1875138590045824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271669.800468:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3607:1875138590045824:0@lo:400: 00000100:00100000:3.0:1788271669.800510:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590046336:0@lo:41: 00000100:00100000:3.0:1788271669.800590:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271669.800650:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4eca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590045696:0@lo:400: 00000100:00100000:3.0:1788271669.800697:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590046336 00000100:00100000:3.0:1788271669.800704:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590046336 00000100:00100000:3.0:1788271669.800763:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788271669.800785:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8223bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590046336:12345-0@lo:41: 00000004:00000024:3.0:1788271669.800831:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788271669.800886:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8223bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590046336:12345-0@lo:41: Request processed in 103us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271669.800894:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1788271669.800952:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6eb4ec8a80 x1875138590045568/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271669.800964:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ec8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875138590045568:0@lo:400: 00000100:00100000:3.0:1788271669.801000:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590045440:0@lo:400: 00010000:00080000:3.0:1788271669.801014:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6eb4ecad80 x1875138590045952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271669.801023:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ecad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3608:1875138590045952:0@lo:400: 00010000:00080000:3.0:1788271669.801038:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d82238380 x1875138590045056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271685 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271669.801047:0:3608:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1788271669.801067:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82238380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590045056:0@lo:13: 00000100:00100000:3.0:1788271669.801101:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590046336:0@lo:41: 00000100:00100000:1.0:1788271669.801454:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590046080 00000100:00100000:1.0:1788271669.801461:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590046080 00000100:00100000:1.0:1788271669.801508:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590046208 00000100:00100000:1.0:1788271669.801512:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590046208 00000100:00100000:1.0:1788271669.801540:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788271669.801549:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8223b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590046080:12345-0@lo:400: 00000100:00100000:1.0:1788271669.801603:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8223b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590046080:12345-0@lo:400: Request processed in 55us (9885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271669.801610:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788271669.801647:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788271669.801654:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82239f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590046208:12345-0@lo:400: 00000100:00100000:1.0:1788271669.801688:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82239f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590046208:12345-0@lo:400: Request processed in 35us (7561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271669.801695:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788271669.801734:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590045184 00000100:00100000:1.0:1788271669.801738:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590045184 00000100:00100000:1.0:1788271669.801901:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788271669.801911:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:3607:x1875138590045184:12345-0@lo:400: 00000100:00100000:1.0:1788271669.801957:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:3607:x1875138590045184:12345-0@lo:400: Request processed in 48us (9385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271669.801963:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:3.0:1788271669.802320:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6eb4ec8e00 x1875138590046080/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271669.802335:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ec8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590046080:0@lo:400: 00000100:00100000:3.0:1788271669.802367:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ecb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590045184:0@lo:400: 00010000:00080000:3.0:1788271669.802379:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6eb4ecb800 x1875138590046208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271685 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271669.802388:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ecb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590046208:0@lo:400: 00000100:00080000:3.0:1788271669.803039:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788271669.803049:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788271669.803052:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788271670.687010:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271670.813804:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788271670.813836:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590046592:0@lo:41: 00000100:00100000:0.0:1788271670.813941:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271670.814027:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590046592 00000100:00100000:0.0:1788271670.814037:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590046592 00000100:00100000:0.0:1788271670.814097:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788271670.814117:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590046592:12345-0@lo:41: 00000004:00000024:0.0:1788271670.814234:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788271670.814494:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590046592:12345-0@lo:41: Request processed in 378us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271670.814503:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788271670.819061:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590046592:0@lo:41: 00010000:00010000:1.0:1788271671.710110:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271672.739463:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271673.757909:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271674.781977:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271674.909875:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590046720:0@lo:13: 00000100:00100000:0.0:1788271674.909990:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271674.911226:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82238380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590046976:0@lo:13: 00000100:00100000:1.0:1788271674.911300:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271674.911379:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4eca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590046848:0@lo:400: 00000100:00100000:1.0:1788271674.911429:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271674.911568:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590046720 00000100:00100000:3.0:1788271674.911578:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590046720 00000100:00080000:1.0:1788271674.911692:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788271674.911878:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590046976 00000100:00100000:3.0:1788271674.911891:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590046976 00000100:00100000:3.0:1788271674.911929:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788271674.911938:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590046720:12345-0@lo:13: 00002000:00000024:3.0:1788271674.911977:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788271674.913463:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788271674.915658:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590046720:12345-0@lo:13: Request processed in 3704us (5652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271674.915679:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788271674.915733:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788271674.915755:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590046976:12345-0@lo:13: 00002000:00000024:3.0:1788271674.915802:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271674.915904:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590046976:12345-0@lo:13: Request processed in 162us (4603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271674.915910:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788271674.920290:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d82238380 x1875138590046976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271690 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271674.920328:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82238380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590046976:0@lo:13: 00000100:00100000:1.0:1788271674.922402:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788271674.922434:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590047104:0@lo:41: 00000100:00100000:1.0:1788271674.922531:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271674.923839:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590047104 00000100:00100000:0.0:1788271674.923856:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590047104 00000100:00100000:0.0:1788271674.923940:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788271674.923954:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590047104:12345-0@lo:41: 00000004:00000024:0.0:1788271674.924005:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788271674.924098:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590047104:12345-0@lo:41: Request processed in 147us (1567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271674.924107:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788271674.924138:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590046848 00000100:00100000:0.0:1788271674.924142:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590046848 00000100:00100000:0.0:1788271674.924171:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788271674.924178:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:3607:x1875138590046848:12345-0@lo:400: 00000100:00100000:0.0:1788271674.924217:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:3607:x1875138590046848:12345-0@lo:400: Request processed in 40us (12788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271674.924224:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788271674.924294:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590047104:0@lo:41: 00010000:00080000:0.0:1788271674.924337:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d816cd180 x1875138590046720/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271690 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271674.924354:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590046720:0@lo:13: 00000100:00100000:1.0:1788271674.924989:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4eca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590046848:0@lo:400: 00000100:00100000:2.0:1788271674.926652:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788271674.926679:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875138590047232:0@lo:400: 00000100:00100000:2.0:1788271674.926765:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271674.926846:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590047360:0@lo:400: 00000100:00100000:2.0:1788271674.926879:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271674.926916:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590047360 00000100:00100000:2.0:1788271674.926924:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590047360 00000100:00100000:2.0:1788271674.926976:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788271674.926987:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4eca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590047360:12345-0@lo:400: 00000100:00100000:2.0:1788271674.927050:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4eca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590047360:12345-0@lo:400: Request processed in 63us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271674.927059:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788271674.927102:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590047360:0@lo:400: 00000100:00100000:2.0:1788271674.927150:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875138590047488:0@lo:400: 00000100:00100000:2.0:1788271674.927175:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271674.927208:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590047232 00000100:00100000:2.0:1788271674.927212:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590047232 00000100:00100000:2.0:1788271674.927239:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590047488 00000100:00100000:2.0:1788271674.927242:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590047488 00000100:00100000:2.0:1788271674.927257:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788271674.927281:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875138590047232:12345-0@lo:400: 00000100:00100000:2.0:1788271674.927315:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875138590047232:12345-0@lo:400: Request processed in 36us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271674.927322:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788271674.927334:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788271674.927339:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4ecb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875138590047488:12345-0@lo:400: 00000100:00100000:2.0:1788271674.927370:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4ecb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875138590047488:12345-0@lo:400: Request processed in 31us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271674.927376:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1788271674.927407:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6eb4ecb480 x1875138590047232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271674.927419:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875138590047232:0@lo:400: 00010000:00080000:2.0:1788271674.927439:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6eb4ecbb80 x1875138590047488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271674.927448:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875138590047488:0@lo:400: 00000100:00100000:2.0:1788271674.927489:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788271674.927496:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3608:1875138590047616:0@lo:400: 00000100:00100000:2.0:1788271674.927520:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271674.927540:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590047616 00000100:00100000:2.0:1788271674.927543:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590047616 00000100:00100000:2.0:1788271674.927576:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788271674.927582:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4ecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875138590047616:12345-0@lo:400: 00000100:00100000:2.0:1788271674.927613:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4ecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875138590047616:12345-0@lo:400: Request processed in 31us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271674.927659:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1788271674.927684:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788271674.927721:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6eb4ecbb80 x1875138590047616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271674.927731:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3608:1875138590047616:0@lo:400: 00000100:00100000:2.0:1788271674.927762:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788271674.927768:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3607:1875138590047744:0@lo:400: 00000100:00100000:2.0:1788271674.927797:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271674.927817:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590047744 00000100:00100000:2.0:1788271674.927820:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590047744 00000100:00100000:2.0:1788271674.927963:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788271674.927969:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4ecb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875138590047744:12345-0@lo:400: 00000100:00100000:2.0:1788271674.928003:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4ecb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875138590047744:12345-0@lo:400: Request processed in 34us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271674.928009:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1788271674.928024:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788271674.928039:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6eb4ecbb80 x1875138590047744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271674.928048:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3607:1875138590047744:0@lo:400: 00010000:00010000:2.0:1788271675.813430:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271675.936240:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590047872:0@lo:41: 00000100:00100000:1.0:1788271675.936347:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271675.937773:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590047872 00000100:00100000:1.0:1788271675.937791:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590047872 00000100:00100000:1.0:1788271675.938700:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788271675.938721:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590047872:12345-0@lo:41: 00000004:00000024:1.0:1788271675.938777:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788271675.938976:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590047872:12345-0@lo:41: Request processed in 262us (2628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271675.938986:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788271675.942529:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590047872:0@lo:41: 00010000:00010000:1.0:1788271676.829784:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271677.854113:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271677.984301:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590048256:0@lo:400: 00000100:00100000:0.0:1788271677.984368:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271677.984413:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3606:1875138590048768:0@lo:400: 00000100:00100000:0.0:1788271677.984440:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271677.984466:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788271677.984472:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875138590048384:0@lo:400: 00000100:00100000:0.0:1788271677.984493:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271677.984511:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590048896:0@lo:400: 00000100:00100000:0.0:1788271677.984535:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271677.984568:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590048768 00000100:00100000:0.0:1788271677.984574:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590048768 00000100:00100000:3.0:1788271677.984705:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590048000:0@lo:400: 00000100:00100000:3.0:1788271677.984739:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271677.984763:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590048512:0@lo:400: 00000100:00100000:3.0:1788271677.984797:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271677.984813:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590049024:0@lo:400: 00000100:00100000:3.0:1788271677.984832:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271677.984850:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788271677.984855:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875138590048128:0@lo:400: 00000100:00100000:3.0:1788271677.984877:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271677.984885:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3608:1875138590048640:0@lo:400: 00000100:00100000:3.0:1788271677.984901:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271677.985022:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590048256 00000100:00100000:3.0:1788271677.985033:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590048256 00000100:00100000:3.0:1788271677.985056:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590048512 00000100:00100000:3.0:1788271677.985058:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590048512 00000100:00100000:3.0:1788271677.985072:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788271677.985078:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590048256:12345-0@lo:400: 00000100:00100000:3.0:1788271677.985128:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590048256:12345-0@lo:400: Request processed in 50us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271677.985135:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788271677.985150:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788271677.985156:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590048512:12345-0@lo:400: 00000100:00100000:3.0:1788271677.985182:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590048512:12345-0@lo:400: Request processed in 26us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271677.985188:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788271677.985204:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590048896 00000100:00100000:3.0:1788271677.985208:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590048896 00000100:00100000:3.0:1788271677.985232:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590049024 00000100:00100000:3.0:1788271677.985234:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590049024 00000100:00100000:3.0:1788271677.985251:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788271677.985257:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590048896:12345-0@lo:400: 00000100:00100000:3.0:1788271677.985284:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590048896:12345-0@lo:400: Request processed in 28us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271677.985289:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788271677.985299:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788271677.985304:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82238380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590049024:12345-0@lo:400: 00000100:00100000:3.0:1788271677.985328:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82238380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590049024:12345-0@lo:400: Request processed in 24us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271677.985333:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788271677.985348:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590048384 00000100:00100000:3.0:1788271677.985357:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590048384 00000100:00100000:3.0:1788271677.985372:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590048128 00000100:00100000:3.0:1788271677.985374:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590048128 00000100:00100000:3.0:1788271677.985383:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590048640 00000100:00100000:3.0:1788271677.985385:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590048640 00000100:00100000:3.0:1788271677.985399:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788271677.985405:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1875138590048768:12345-0@lo:400: 00000100:00100000:3.0:1788271677.985432:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1875138590048768:12345-0@lo:400: Request processed in 28us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271677.985437:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788271677.985449:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788271677.985455:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1875138590048384:12345-0@lo:400: 00000100:00100000:3.0:1788271677.985478:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1875138590048384:12345-0@lo:400: Request processed in 24us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271677.985483:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788271677.985493:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788271677.985499:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875138590048128:12345-0@lo:400: 00000100:00100000:3.0:1788271677.985524:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82238700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875138590048128:12345-0@lo:400: Request processed in 25us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271677.985529:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788271677.985540:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788271677.985546:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0c62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875138590048640:12345-0@lo:400: 00000100:00100000:3.0:1788271677.985569:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0c62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875138590048640:12345-0@lo:400: Request processed in 24us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271677.985574:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1788271677.985615:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d81f41c00 x1875138590048128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788271677.986020:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788271677.986026:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788271677.986028:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788271677.986149:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590048000 00000100:00100000:1.0:1788271677.986155:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590048000 00000100:00100000:1.0:1788271677.986189:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788271677.986196:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:3608:x1875138590048000:12345-0@lo:400: 00000100:00100000:1.0:1788271677.986243:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:3608:x1875138590048000:12345-0@lo:400: Request processed in 47us (1503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271677.986249:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788271677.986336:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875138590048128:0@lo:400: 00010000:00080000:3.0:1788271677.986353:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d81f41f80 x1875138590048640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271677.986361:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3608:1875138590048640:0@lo:400: 00000100:00100000:3.0:1788271677.986371:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590048000:0@lo:400: 00000100:00100000:3.0:1788271677.986380:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590048512:0@lo:400: 00010000:00080000:3.0:1788271677.986388:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d81f40380 x1875138590049024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271677.986396:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590049024:0@lo:400: 00010000:00080000:3.0:1788271677.986450:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d81f42680 x1875138590048384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271677.986459:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875138590048384:0@lo:400: 00010000:00080000:3.0:1788271677.986470:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d81f41500 x1875138590048896/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271677.986477:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590048896:0@lo:400: 00000100:00100000:3.0:1788271677.986489:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590048256:0@lo:400: 00010000:00080000:3.0:1788271677.986500:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d81f43b80 x1875138590048768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271677.986508:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3606:1875138590048768:0@lo:400: 00010000:00010000:0.0:1788271678.877775:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788271679.862448:0:9474:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788271679.862455:0:9474:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788271679.862462:0:9474:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788271679.862710:0:9474:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f6d820cc800 00000020:01000004:3.0:1788271679.862732:0:9474:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788271679.862760:0:9474:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788271679.862779:0:9474:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8f6ebc993370) 00000020:00000080:3.0:1788271679.862801:0:9474:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00010000:00010000:2.0:1788271679.912471:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788271679.950971:0:9474:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788271679.951112:0:9474:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:1.0:1788271680.012214:0:9474:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788271680.012509:0:9474:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788271680.012523:0:9474:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788271680.012534:0:9474:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x99288105fd38e5a4 00000020:01000004:1.0:1788271680.012540:0:9474:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788271680.012563:0:9474:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.103@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788271680.012567:0:9474:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788271680.012573:0:9474:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788271680.012603:0:9474:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1788271680.012607:0:9474:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.103@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000100:00100000:3.0:1788271680.031521:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788271680.031556:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590049152:0@lo:13: 00000100:00100000:3.0:1788271680.031687:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271680.031746:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788271680.031757:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590049280:0@lo:13: 00000100:00100000:3.0:1788271680.031779:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590049152 00000100:00100000:3.0:1788271680.031789:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590049152 00000100:00100000:0.0:1788271680.031789:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271680.031847:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590049280 00000100:00100000:3.0:1788271680.031850:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590049280 00000100:00100000:3.0:1788271680.031873:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788271680.031884:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0ccd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590049152:12345-0@lo:13: 00000100:00100000:0.0:1788271680.031919:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590049408:0@lo:41: 00002000:00000024:3.0:1788271680.031922:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788271680.031948:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271680.031968:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0ccd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590049152:12345-0@lo:13: Request processed in 86us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271680.031976:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788271680.031999:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788271680.032005:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590049280:12345-0@lo:13: 00002000:00000024:3.0:1788271680.032016:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271680.032053:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590049280:12345-0@lo:13: Request processed in 48us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271680.032059:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788271680.032073:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590049408 00000100:00100000:2.0:1788271680.032077:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590049408 00000100:00080000:3.0:1788271680.032080:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788271680.032108:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1788271680.032110:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6eb3d2f480 x1875138590049152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271696 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271680.032114:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590049408:12345-0@lo:41: 00000100:00100000:3.0:1788271680.032131:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590049152:0@lo:13: 00000004:00000024:2.0:1788271680.032141:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788271680.032181:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590049408:12345-0@lo:41: Request processed in 67us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271680.032199:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788271680.032343:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590049408:0@lo:41: 00010000:00080000:0.0:1788271680.032365:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d81f42300 x1875138590049280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271696 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271680.032375:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590049280:0@lo:13: 00000040:01000000:0.0:1788271680.069377:0:9474:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.103@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788271680.069436:0:9474:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.103@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1788271680.069441:0:9474:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788271680.069443:0:9474:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788271680.069445:0:9474:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788271680.069446:0:9474:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788271680.069447:0:9474:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788271680.069449:0:9474:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788271680.069451:0:9474:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788271680.069453:0:9474:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788271680.069454:0:9474:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788271680.069456:0:9474:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788271680.069458:0:9474:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788271680.069464:0:9474:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1788271680.069467:0:9474:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788271680.069468:0:9474:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788271680.069470:0:9474:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788271680.069471:0:9474:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788271680.069472:0:9474:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788271680.069474:0:9474:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788271680.069475:0:9474:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788271680.069476:0:9474:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788271680.069477:0:9474:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788271680.069478:0:9474:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788271680.069479:0:9474:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788271680.069538:0:9474:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788271680.069563:0:9474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:9474:1875138590049536:0@lo:253: 00000100:00100000:0.0:1788271680.069999:0:9474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271680.070120:0:9474:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb40410c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271680.071220:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590049536 00000100:00100000:1.0:1788271680.071237:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590049536 00000100:00100000:1.0:1788271680.071306:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788271680.071316:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:9474:x1875138590049536:12345-0@lo:253: 20000000:01000000:1.0:1788271680.071353:0:6476:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788271680.071358:0:6476:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1788271680.071364:0:6476:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1788271680.071368:0:6476:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788271680.074013:0:6476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788271680.082187:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:2.0:1788271680.082236:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1788271680.082284:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:2.0:1788271680.082293:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1788271680.082309:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:2.0:1788271680.082330:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:2.0:1788271680.082483:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:2.0:1788271680.082504:0:6476:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.103@tcp 20000000:01000000:2.0:1788271680.083175:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.103@tcp (null) (null) (null) 00000040:00080000:3.0:1788271680.089831:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:3.0:1788271680.089882:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788271680.089904:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:3.0:1788271680.089912:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.103@tcp (null) (null) 00000040:00080000:3.0:1788271680.089924:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:3.0:1788271680.089933:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788271680.089944:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:3.0:1788271680.089964:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:3.0:1788271680.090397:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:3.0:1788271680.090425:0:6476:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.103@tcp 20000000:01000000:3.0:1788271680.090428:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.103@tcp (null) (null) (null) 00000040:00080000:3.0:1788271680.090443:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:3.0:1788271680.090449:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788271680.090462:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:3.0:1788271680.090467:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.201.103@tcp (null) (null) 00000040:00080000:3.0:1788271680.090480:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:3.0:1788271680.090485:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788271680.090498:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:3.0:1788271680.090684:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:3.0:1788271680.092480:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:3.0:1788271680.093657:0:6476:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.103@tcp 20000000:01000000:3.0:1788271680.093663:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.103@tcp (null) (null) (null) 00000040:00080000:3.0:1788271680.093728:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:3.0:1788271680.093755:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788271680.093775:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:3.0:1788271680.093782:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.103@tcp (null) (null) 00000040:00080000:3.0:1788271680.093799:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:3.0:1788271680.093809:0:6476:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788271680.093823:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:3.0:1788271680.093958:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:3.0:1788271680.094086:0:6476:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788271680.094090:0:6476:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788271680.094096:0:6476:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788271680.094168:0:6476:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788271680.094171:0:6476:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788271680.095121:0:9480:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:1.0:1788271680.095181:0:9480:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:1.0:1788271680.095196:0:9480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:3.0:1788271680.095400:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:3.0:1788271680.095429:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:3.0:1788271680.095444:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:3.0:1788271680.095457:0:6476:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788271680.095459:0:6476:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788271680.098260:0:9481:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 26 1->4: lustre sys.timeout 20000000:01000000:1.0:1788271680.098326:0:9481:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 26 2->4: lustre sys.timeout 00000040:00080000:1.0:1788271680.098340:0:9481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788271680.098751:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788271680.098785:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:3.0:1788271680.098800:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:3.0:1788271680.098812:0:6476:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788271680.098815:0:6476:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788271680.099481:0:9482:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 27 1->4: lustre sys.timeout 20000000:01000000:3.0:1788271680.099505:0:9482:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 27 2->4: lustre sys.timeout 00000040:00080000:3.0:1788271680.099683:0:9482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:0.0:1788271680.099939:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:0.0:1788271680.100006:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:0.0:1788271680.100044:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:0.0:1788271680.100056:0:6476:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788271680.100059:0:6476:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788271680.100489:0:9483:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:2.0:1788271680.101027:0:9483:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:2.0:1788271680.101108:0:9483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:0.0:1788271680.101359:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:0.0:1788271680.101387:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:0.0:1788271680.101405:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:0.0:1788271680.101433:0:6476:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788271680.101436:0:6476:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788271680.109542:0:9484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:1.0:1788271680.109886:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:1.0:1788271680.109919:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:1.0:1788271680.109936:0:6476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 10000000:01000000:1.0:1788271680.109968:0:6476:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788271680.109991:0:6476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e5ab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.110009:0:6476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6eb4079200/0x99288105fd38e4a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e49a expref: 21 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.110017:0:6476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6eb4e21600/0x99288105fd38e4cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e4c4 expref: 21 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.110024:0:6476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6eb4e20400/0x99288105fd38e50a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e503 expref: 21 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.110030:0:6476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6eb4079400/0x99288105fd38e526 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e51f expref: 21 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.110035:0:6476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6e92d32800/0x99288105fd38e550 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e549 expref: 21 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.110041:0:6476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6eb4079c00/0x99288105fd38e56c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e565 expref: 21 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.110047:0:6476:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6eb4079e00/0x99288105fd38e58f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e588 expref: 21 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.110054:0:6476:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e5ab lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.110096:0:6476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6eb4079e00/0x99288105fd38e58f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e588 expref: 21 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.110110:0:6476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f6eb4079e00/0x99288105fd38e58f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e588 expref: 21 pid: 6476 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271680.110133:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816ced80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1875138590049664:0@lo:104: 00000100:00100000:1.0:1788271680.110193:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788271680.110257:0:6476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6eb4079c00/0x99288105fd38e56c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e565 expref: 21 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.110266:0:6476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f6eb4079c00/0x99288105fd38e56c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e565 expref: 21 pid: 6477 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271680.110275:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cf100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1875138590049792:0@lo:104: 00000100:00100000:1.0:1788271680.110295:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788271680.110324:0:6476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6e92d32800/0x99288105fd38e550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e549 expref: 21 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.110332:0:6476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f6e92d32800/0x99288105fd38e550 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e549 expref: 21 pid: 6476 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271680.110340:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cdf80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1875138590049920:0@lo:104: 00000100:00100000:1.0:1788271680.110363:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271680.110391:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590049664 00010000:00010000:1.0:1788271680.110392:0:6476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6eb4079400/0x99288105fd38e526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e51f expref: 21 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271680.110409:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590049664 00010000:00010000:1.0:1788271680.110411:0:6476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f6eb4079400/0x99288105fd38e526 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e51f expref: 21 pid: 6476 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271680.110424:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cf480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1875138590050048:0@lo:104: 00000100:00100000:1.0:1788271680.110456:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271680.110473:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590049792 00000100:00100000:3.0:1788271680.110479:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590049792 00010000:00010000:1.0:1788271680.110484:0:6476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6eb4e20400/0x99288105fd38e50a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e503 expref: 21 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271680.110494:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590049920 00000100:00100000:3.0:1788271680.110500:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590049920 00000100:00100000:3.0:1788271680.110516:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590050048 00000100:00100000:3.0:1788271680.110521:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590050048 00010000:00010000:1.0:1788271680.110521:0:6476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f6eb4e20400/0x99288105fd38e50a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e503 expref: 21 pid: 6478 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271680.110540:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1875138590050176:0@lo:104: 00000100:00100000:3.0:1788271680.110547:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788271680.110563:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+6:6476:x1875138590049664:12345-0@lo:104: 00010000:00010000:3.0:1788271680.110584:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078000/0x99288105fd38e588 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e58f expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271680.110584:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788271680.110673:0:6476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6eb4e21600/0x99288105fd38e4cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e4c4 expref: 21 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.110686:0:6476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f6eb4e21600/0x99288105fd38e4cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e4c4 expref: 21 pid: 6476 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271680.110699:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82339c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1875138590050304:0@lo:104: 00010000:00010000:3.0:1788271680.110729:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788271680.110747:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271680.110761:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+6:6476:x1875138590049664:12345-0@lo:104: Request processed in 201us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271680.110771:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:1.0:1788271680.110785:0:6476:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6eb4079200/0x99288105fd38e4a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e49a expref: 21 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.110797:0:6476:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f6eb4079200/0x99288105fd38e4a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e49a expref: 21 pid: 6477 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271680.110808:0:6476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8233aa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1875138590050432:0@lo:104: 00000100:00100000:3.0:1788271680.110810:0:6467:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788271680.110831:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590050176 00000100:00100000:3.0:1788271680.110836:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590050176 00000100:00100000:1.0:1788271680.110844:0:6476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271680.110857:0:6476:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e82fcbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788271680.110879:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816ced80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1875138590049664:0@lo:104: 00000100:00100000:3.0:1788271680.110922:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590050304 00000100:00100000:3.0:1788271680.110927:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590050304 00000100:00100000:3.0:1788271680.110937:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590050432 00000100:00100000:3.0:1788271680.110939:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590050432 00000100:00100000:3.0:1788271680.110950:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788271680.110956:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+8:6476:x1875138590049792:12345-0@lo:104: 00010000:00010000:3.0:1788271680.110965:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e565 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e56c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.111037:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788271680.111044:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+8:6476:x1875138590049792:12345-0@lo:104: Request processed in 87us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271680.111052:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788271680.111065:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788271680.111071:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+7:6476:x1875138590049920:12345-0@lo:104: 00010000:00010000:3.0:1788271680.111078:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfe00/0x99288105fd38e549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e550 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.111111:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788271680.111116:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+7:6476:x1875138590049920:12345-0@lo:104: Request processed in 46us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271680.111122:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788271680.111131:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788271680.111143:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+6:6476:x1875138590050048:12345-0@lo:104: 00010000:00010000:3.0:1788271680.111150:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfc00/0x99288105fd38e51f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e526 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.111182:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788271680.111186:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+6:6476:x1875138590050048:12345-0@lo:104: Request processed in 44us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271680.111192:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788271680.111202:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788271680.111206:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+5:6476:x1875138590050176:12345-0@lo:104: 00010000:00010000:0.0:1788271680.111278:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788271680.111287:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078000/0x99288105fd38e588 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e58f expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.111296:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4078000 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:0.0:1788271680.111300:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078000/0x99288105fd38e588 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e58f expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.111309:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078000/0x99288105fd38e588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e58f expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788271680.111316:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078000/0x99288105fd38e588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e58f expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271680.111322:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788271680.111333:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078400/0x99288105fd38e503 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e50a expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.111364:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078000/0x99288105fd38e588 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e58f expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.111369:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:0.0:1788271680.111381:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788271680.111385:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+5:6476:x1875138590050176:12345-0@lo:104: Request processed in 176us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271680.111394:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1788271680.111410:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078000/0x99288105fd38e588 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e58f expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271680.111413:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788271680.111427:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81714c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+4:6476:x1875138590050304:12345-0@lo:104: 00010000:00010000:0.0:1788271680.111431:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078000/0x99288105fd38e588 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e58f expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.111438:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6ec21df800/0x99288105fd38e4c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e4cb expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.111449:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788271680.111455:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e565 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e56c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.111468:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788271680.111480:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81714c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+4:6476:x1875138590050304:12345-0@lo:104: Request processed in 54us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271680.111502:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1788271680.111506:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4079600 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:0.0:1788271680.111513:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e565 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e56c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.111523:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e565 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e56c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788271680.111530:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e565 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e56c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271680.111542:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 10000000:01000000:0.0:1788271680.111543:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788271680.111559:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8233a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+3:6476:x1875138590050432:12345-0@lo:104: 00010000:00010000:0.0:1788271680.111566:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e565 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e56c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.111570:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33e00/0x99288105fd38e49a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e4a1 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.111587:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788271680.111599:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e565 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e56c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.111607:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e565 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e56c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.111617:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00010000:00010000:0.0:1788271680.111649:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00000100:00100000:3.0:1788271680.111650:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8233a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+3:6476:x1875138590050432:12345-0@lo:104: Request processed in 92us (806us total) trans 0 rc 0/0 00010000:00010000:0.0:1788271680.111658:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfe00/0x99288105fd38e549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e550 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271680.111666:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1788271680.111680:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6ec21dfe00 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:0.0:1788271680.111684:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfe00/0x99288105fd38e549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e550 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.111698:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788271680.111705:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfe00/0x99288105fd38e549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e550 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.111707:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfc00/0x99288105fd38e51f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e526 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.111750:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6ec21dfc00 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:0.0:1788271680.111750:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfe00/0x99288105fd38e549 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e550 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788271680.111761:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfc00/0x99288105fd38e51f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e526 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271680.111774:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788271680.111776:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfc00/0x99288105fd38e51f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e526 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788271680.111789:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfc00/0x99288105fd38e51f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e526 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271680.111796:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788271680.111802:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfe00/0x99288105fd38e549 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e550 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.111811:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788271680.111830:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfc00/0x99288105fd38e51f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e526 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.111833:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfe00/0x99288105fd38e549 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e550 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.111848:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfe00/0x99288105fd38e549 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e550 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.111860:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788271680.111863:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078400/0x99288105fd38e503 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e50a expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.111869:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4078400 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:0.0:1788271680.111872:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078400/0x99288105fd38e503 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e50a expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.111878:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078400/0x99288105fd38e503 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e50a expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788271680.111885:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078400/0x99288105fd38e503 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e50a expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271680.111897:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788271680.111920:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078400/0x99288105fd38e503 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e50a expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.111927:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788271680.111932:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078400/0x99288105fd38e503 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e50a expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.111939:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078400/0x99288105fd38e503 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e50a expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.111948:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788271680.111952:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6ec21df800/0x99288105fd38e4c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e4cb expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.111957:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6ec21df800 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:0.0:1788271680.111960:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6ec21df800/0x99288105fd38e4c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e4cb expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.111967:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6ec21df800/0x99288105fd38e4c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e4cb expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788271680.111974:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6ec21df800/0x99288105fd38e4c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e4cb expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271680.111980:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788271680.111992:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6ec21df800/0x99288105fd38e4c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e4cb expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.111998:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788271680.112009:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6ec21df800/0x99288105fd38e4c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e4cb expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.112015:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6ec21df800/0x99288105fd38e4c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e4cb expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.112025:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271680.112028:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33e00/0x99288105fd38e49a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e4a1 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.112033:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e92d33e00 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:0.0:1788271680.112036:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33e00/0x99288105fd38e49a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e4a1 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.112042:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33e00/0x99288105fd38e49a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e4a1 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788271680.112047:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33e00/0x99288105fd38e49a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e4a1 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271680.112051:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788271680.112063:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33e00/0x99288105fd38e49a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e4a1 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.112068:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788271680.112072:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33e00/0x99288105fd38e49a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e4a1 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.112077:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33e00/0x99288105fd38e49a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e4a1 expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.112086:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271680.112092:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271680.112095:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271680.112123:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590050688:0@lo:103: 00000100:00100000:0.0:1788271680.112174:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271680.112203:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590051328:0@lo:103: 00000100:00100000:0.0:1788271680.112222:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271680.112243:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788271680.112248:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590050560:0@lo:103: 00000100:00100000:0.0:1788271680.112267:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271680.112281:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590051200:0@lo:103: 00000100:00100000:0.0:1788271680.112299:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271680.112316:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590051072:0@lo:103: 00000100:00100000:0.0:1788271680.112336:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271680.112347:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788271680.112352:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590050816:0@lo:103: 00000100:00100000:0.0:1788271680.112370:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271680.112395:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590050688 00000100:00100000:0.0:1788271680.112402:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590050688 00010000:00010000:0.0:1788271680.112427:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6eb4079c00/0x99288105fd38e56c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e565 expref: 22 pid: 6477 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271680.112447:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590051328 00000100:00100000:0.0:1788271680.112450:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590051328 00010000:00010000:0.0:1788271680.112476:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6eb4079200/0x99288105fd38e4a1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e49a expref: 23 pid: 6477 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271680.112489:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590050560 00000100:00100000:0.0:1788271680.112492:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590050560 00010000:00010000:0.0:1788271680.112510:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6eb4079e00/0x99288105fd38e58f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e588 expref: 24 pid: 6476 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271680.112521:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590051200 00000100:00100000:0.0:1788271680.112523:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590051200 00010000:00010000:0.0:1788271680.112532:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6eb4e21600/0x99288105fd38e4cb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e4c4 expref: 25 pid: 6476 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271680.112540:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590051072 00000100:00100000:0.0:1788271680.112542:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590051072 00010000:00010000:0.0:1788271680.112551:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6eb4e20400/0x99288105fd38e50a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e503 expref: 26 pid: 6478 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271680.112559:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590050816 00000100:00100000:0.0:1788271680.112561:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590050816 00010000:00010000:0.0:1788271680.112570:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6e92d32800/0x99288105fd38e550 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e549 expref: 27 pid: 6476 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271680.112581:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788271680.112588:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+27:3609:x1875138590050688:12345-0@lo:103: 00010000:00010000:0.0:1788271680.112600:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271680.112605:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6eb4079c00/0x99288105fd38e56c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e565 expref: 27 pid: 6477 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.112614:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6eb4079c00/0x99288105fd38e56c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e565 expref: 27 pid: 6477 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.112655:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271680.112691:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+27:3609:x1875138590050688:12345-0@lo:103: Request processed in 103us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271680.112698:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788271680.112725:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788271680.112731:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+26:3609:x1875138590051328:12345-0@lo:103: 00010000:00010000:0.0:1788271680.112751:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271680.112756:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6eb4079200/0x99288105fd38e4a1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e49a expref: 26 pid: 6477 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.112765:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6eb4079200/0x99288105fd38e4a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e49a expref: 26 pid: 6477 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.112775:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271680.112797:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+26:3609:x1875138590051328:12345-0@lo:103: Request processed in 67us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271680.112803:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788271680.112814:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788271680.112820:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+25:3609:x1875138590050560:12345-0@lo:103: 00010000:00010000:0.0:1788271680.112826:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271680.112831:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6eb4079e00/0x99288105fd38e58f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e588 expref: 25 pid: 6476 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.112840:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6eb4079e00/0x99288105fd38e58f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e588 expref: 25 pid: 6476 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.112850:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4079e00/0x99288105fd38e58f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e588 expref: 25 pid: 6476 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.112859:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271680.112879:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3609:x1875138590050560:12345-0@lo:103: Request processed in 59us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271680.112885:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788271680.112905:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788271680.112912:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:3609:x1875138590051200:12345-0@lo:103: 00010000:00010000:0.0:1788271680.112920:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271680.112925:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6eb4e21600/0x99288105fd38e4cb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e4c4 expref: 23 pid: 6476 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.112934:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6eb4e21600/0x99288105fd38e4cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e4c4 expref: 23 pid: 6476 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.112955:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788271680.113050:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfc00/0x99288105fd38e51f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e526 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.113076:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfc00/0x99288105fd38e51f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e526 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.113099:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271680.113101:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271680.113104:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271680.113116:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271680.113141:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0ccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590050944:0@lo:103: 00000100:00100000:3.0:1788271680.113198:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271680.113260:0:6468:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788271680.113271:0:6468:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1788271680.113396:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4079c00/0x99288105fd38e56c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e565 expref: 23 pid: 6477 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271680.113420:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cf100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1875138590049792:0@lo:104: 00000100:00100000:1.0:1788271680.113435:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cdf80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1875138590049920:0@lo:104: 00000100:00100000:1.0:1788271680.113443:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cf480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1875138590050048:0@lo:104: 00000100:00100000:1.0:1788271680.113452:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cd180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1875138590050176:0@lo:104: 00000100:00100000:1.0:1788271680.113461:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82339c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1875138590050304:0@lo:104: 00010000:00010000:1.0:1788271680.113470:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4079200/0x99288105fd38e4a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e49a expref: 22 pid: 6477 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271680.113479:0:6476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8233aa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6476:1875138590050432:0@lo:104: 00010000:00010000:2.0:1788271680.113571:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271680.114286:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590050944 00000100:00100000:2.0:1788271680.114294:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590050944 00010000:00010000:2.0:1788271680.114326:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6eb4079400/0x99288105fd38e526 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e51f expref: 22 pid: 6476 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271680.114351:0:6468:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788271680.114361:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788271680.114368:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:3607:x1875138590051072:12345-0@lo:103: 00010000:00010000:2.0:1788271680.114378:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271680.114383:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6eb4e20400/0x99288105fd38e50a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e503 expref: 22 pid: 6478 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271680.114556:0:9485:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1788271680.114568:0:9485:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:1.0:1788271680.116364:0:6476:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e5ab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271680.118747:0:9485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788271680.118787:0:9485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:3607:x1875138590050816:12345-0@lo:103: 00010000:00010000:1.0:1788271680.118810:0:9485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271680.118821:0:9485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6e92d32800/0x99288105fd38e550 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e549 expref: 22 pid: 6476 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.118841:0:9485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6e92d32800/0x99288105fd38e550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e549 expref: 22 pid: 6476 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.118861:0:9485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6e92d32800/0x99288105fd38e550 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e549 expref: 22 pid: 6476 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.118879:0:9485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271680.118973:0:9485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:3607:x1875138590050816:12345-0@lo:103: Request processed in 213us (6601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271680.118996:0:9485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788271680.119028:0:9485:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1788271680.119038:0:9485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788271680.119046:0:9485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0c61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:3606:x1875138590050944:12345-0@lo:103: 00010000:00010000:1.0:1788271680.119055:0:9485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271680.119061:0:9485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6eb4079400/0x99288105fd38e526 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e51f expref: 20 pid: 6476 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.119069:0:9485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6eb4079400/0x99288105fd38e526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e51f expref: 20 pid: 6476 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.119080:0:9485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4079400/0x99288105fd38e526 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e51f expref: 20 pid: 6476 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.119089:0:9485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271680.119121:0:9485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0c61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4eab87b-0440-4f90-8c88-4ffaef16406f+19:3606:x1875138590050944:12345-0@lo:103: Request processed in 76us (5922us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271680.119127:0:9485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788271680.123090:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590050816:0@lo:103: 00000100:00100000:3.0:1788271680.123136:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0ccc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590050944:0@lo:103: 00010000:00010000:0.0:1788271680.123535:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4e21600/0x99288105fd38e4cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e4c4 expref: 18 pid: 6476 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.123555:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271680.123647:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:3609:x1875138590051200:12345-0@lo:103: Request processed in 10734us (11346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271680.123657:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788271680.123722:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590050560:0@lo:103: 00000100:00100000:0.0:1788271680.123731:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590051200:0@lo:103: 00000100:00100000:0.0:1788271680.123751:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590050688:0@lo:103: 00000100:00100000:0.0:1788271680.123760:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590051328:0@lo:103: 00010000:00010000:2.0:1788271680.124097:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6eb4e20400/0x99288105fd38e50a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e503 expref: 16 pid: 6478 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271680.124112:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4e20400/0x99288105fd38e50a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e503 expref: 16 pid: 6478 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271680.124137:0:6468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e5ab lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271680.124145:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e5ab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.124218:0:6468:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e5ab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.124227:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e5ab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.124233:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e5ab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.124240:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e5ab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.124246:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e92d32c00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:3.0:1788271680.124251:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e5ab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.124270:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e5ab lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.124296:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e5ab lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.124309:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271680.124358:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:3607:x1875138590051072:12345-0@lo:103: Request processed in 9990us (12021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271680.124368:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:1.0:1788271680.124438:0:6476:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e5ab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.124447:0:6476:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e5ab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.124454:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e5ab lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788271680.124470:0:6476:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788271680.124553:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590051072:0@lo:103: 00000100:00100000:1.0:1788271680.128196:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+14:9474:x1875138590049536:12345-0@lo:253: Request processed in 56873us (58190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271680.128222:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788271680.128358:0:9474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:9474:1875138590049536:0@lo:253: 10000000:01000000:0.0:1788271680.128374:0:9474:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788271680.128378:0:9474:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788271680.128379:0:9474:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788271680.128380:0:9474:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788271680.128388:0:9474:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1788271680.128389:0:9474:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788271680.128391:0:9474:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788271680.128392:0:9474:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788271680.128394:0:9474:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788271680.128395:0:9474:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788271680.128397:0:9474:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788271680.128417:0:9474:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f6d820cc800 from lustre-OST0001 10000000:01000000:0.0:1788271680.128446:0:9474:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788271680.128449:0:9474:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788271680.128457:0:9474:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f6e85beb370 local copy 10000000:01000000:0.0:1788271680.128461:0:9474:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788271680.128493:0:9474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079e00/0x99288105fd38e5b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.128505:0:9474:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079e00/0x99288105fd38e5b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.128515:0:9474:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079e00/0x99288105fd38e5b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271680.128533:0:9474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:9474:1875138590051456:0@lo:101: 00000100:00100000:0.0:1788271680.128571:0:9474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271680.128683:0:9474:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4041180 going to sleep for 11 seconds 00000100:00100000:2.0:1788271680.132416:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590051456 00000100:00100000:2.0:1788271680.132431:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590051456 00000100:00100000:3.0:1788271680.132581:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788271680.132594:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+14:9474:x1875138590051456:12345-0@lo:101: 00010000:00010000:3.0:1788271680.132611:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271680.132766:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6ec21dfc00/0x99288105fd38e5b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e5b2 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.132805:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6ec21dfc00/0x99288105fd38e5b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e5b2 expref: 15 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.132817:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6ec21dfc00/0x99288105fd38e5b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e5b2 expref: 15 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.132826:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6ec21dfc00, rc 0) 00000100:00100000:3.0:1788271680.133270:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:9474:x1875138590051456:12345-0@lo:101: Request processed in 677us (4697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271680.133278:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788271680.135973:0:9474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:9474:1875138590051456:0@lo:101: 00010000:00010000:0.0:1788271680.136012:0:9474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079e00/0x99288105fd38e5b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x99288105fd38e5b9 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.136026:0:9474:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079e00/0x99288105fd38e5b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x99288105fd38e5b9 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271680.136160:0:9474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:9474:1875138590051584:0@lo:501: 00000100:00100000:0.0:1788271680.136235:0:9474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271680.136284:0:9474:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4041180 going to sleep for 11 seconds 00000100:00100000:1.0:1788271680.136434:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590051584 00000100:00100000:1.0:1788271680.136441:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590051584 00000100:00100000:1.0:1788271680.136493:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788271680.136503:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:9474:x1875138590051584:12345-0@lo:501: 00000100:00100000:1.0:1788271680.136584:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:9474:x1875138590051584:12345-0@lo:501: Request processed in 82us (348us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788271680.136592:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788271680.141976:0:9474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:9474:1875138590051584:0@lo:501: 10000000:01000000:0.0:1788271680.142017:0:9474:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788271680.142062:0:9474:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788271680.142072:0:9474:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079e00/0x99288105fd38e5b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x99288105fd38e5b9 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.142083:0:9474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079e00/0x99288105fd38e5b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x99288105fd38e5b9 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.142090:0:9474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079e00/0x99288105fd38e5b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x99288105fd38e5b9 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.142110:0:9474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788271680.142141:0:9474:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f6d820cc800 10000000:01000000:0.0:1788271680.142148:0:9474:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788271680.142154:0:9474:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788271680.142157:0:9474:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788271680.142161:0:9474:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788271680.142164:0:9474:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788271680.142195:0:9474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078400/0x99288105fd38e5c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.142203:0:9474:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078400/0x99288105fd38e5c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.142213:0:9474:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078400/0x99288105fd38e5c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271680.142253:0:9474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:9474:1875138590051712:0@lo:101: 00000100:00100000:0.0:1788271680.142313:0:9474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271680.142368:0:9474:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4041540 going to sleep for 11 seconds 00000100:00100000:3.0:1788271680.142507:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590051712 00000100:00100000:3.0:1788271680.142515:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590051712 00000100:00100000:3.0:1788271680.142572:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788271680.142582:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:9474:x1875138590051712:12345-0@lo:101: 00010000:00010000:3.0:1788271680.142595:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271680.142608:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6ec21de200/0x99288105fd38e5c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e5c0 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.142658:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6ec21de200/0x99288105fd38e5c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e5c0 expref: 16 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.142668:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6ec21de200/0x99288105fd38e5c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e5c0 expref: 16 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.142676:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6ec21de200, rc 0) 00000100:00100000:3.0:1788271680.142711:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:9474:x1875138590051712:12345-0@lo:101: Request processed in 130us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271680.142718:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788271680.143133:0:9474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:9474:1875138590051712:0@lo:101: 00010000:00010000:0.0:1788271680.143146:0:9474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078400/0x99288105fd38e5c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e5c7 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.143154:0:9474:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078400/0x99288105fd38e5c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e5c7 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271680.143229:0:9474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:9474:1875138590051840:0@lo:501: 00000100:00100000:0.0:1788271680.143260:0:9474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271680.143280:0:9474:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4041540 going to sleep for 11 seconds 00000100:00100000:0.0:1788271680.143296:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590051840 00000100:00100000:0.0:1788271680.143299:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590051840 00000100:00100000:0.0:1788271680.143323:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788271680.143329:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:9474:x1875138590051840:12345-0@lo:501: 00000100:00100000:0.0:1788271680.143452:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:9474:x1875138590051840:12345-0@lo:501: Request processed in 122us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271680.143459:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788271680.143493:0:9474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:9474:1875138590051840:0@lo:501: 00000100:00100000:0.0:1788271680.143517:0:9474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:9474:1875138590051968:0@lo:503: 00000100:00100000:0.0:1788271680.143555:0:9474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271680.143568:0:9474:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4041540 going to sleep for 11 seconds 00000100:00100000:0.0:1788271680.143580:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590051968 00000100:00100000:0.0:1788271680.143589:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590051968 00000100:00100000:0.0:1788271680.143607:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788271680.143613:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:9474:x1875138590051968:12345-0@lo:503: 00000100:00100000:0.0:1788271680.143708:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:9474:x1875138590051968:12345-0@lo:503: Request processed in 94us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271680.143714:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788271680.143766:0:9474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:9474:1875138590051968:0@lo:503: 00010000:00010000:1.0:1788271680.144880:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271680.144891:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079e00/0x99288105fd38e5b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x99288105fd38e5b9 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.144901:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4079e00 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:1.0:1788271680.144905:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079e00/0x99288105fd38e5b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x99288105fd38e5b9 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.144915:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079e00/0x99288105fd38e5b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x99288105fd38e5b9 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788271680.144923:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079e00/0x99288105fd38e5b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x99288105fd38e5b9 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271680.144929:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788271680.144990:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079e00/0x99288105fd38e5b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x99288105fd38e5b9 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.144998:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788271680.145028:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079e00/0x99288105fd38e5b2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x99288105fd38e5b9 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.145050:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079e00/0x99288105fd38e5b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x99288105fd38e5b9 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.145068:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271680.145070:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271680.145071:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271680.145191:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8233aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590052096:0@lo:103: 00000100:00100000:3.0:1788271680.145245:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271680.145583:0:9485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590052096 00000100:00100000:1.0:1788271680.145590:0:9485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590052096 00000040:00080000:3.0:1788271680.149331:0:9474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788271680.149435:0:9474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c62300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:9474:1875138590052224:0@lo:502: 00000100:00100000:3.0:1788271680.149512:0:9474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271680.150857:0:9485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788271680.150879:0:9485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0c60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:3607:x1875138590052096:12345-0@lo:103: 00010000:00010000:1.0:1788271680.150902:0:9485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271680.150925:0:9485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6ec21dfc00/0x99288105fd38e5b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x99288105fd38e5b2 expref: 16 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.150943:0:9485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271680.151013:0:9485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0c60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:3607:x1875138590052096:12345-0@lo:103: Request processed in 144us (5767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271680.151021:0:9485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788271680.151132:0:9474:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e89061b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788271680.151273:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8233aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590052096:0@lo:103: 00000100:00100000:0.0:1788271680.152918:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590052224 00000100:00100000:0.0:1788271680.152932:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590052224 00000100:00100000:1.0:1788271680.153250:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788271680.153262:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:9474:x1875138590052224:12345-0@lo:502: 00000100:00100000:1.0:1788271680.153438:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:9474:x1875138590052224:12345-0@lo:502: Request processed in 178us (3925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271680.153446:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788271680.153540:0:9474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c62300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:9474:1875138590052224:0@lo:502: 00000040:00080000:0.0:1788271680.153854:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788271680.153882:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788271680.153895:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788271680.153912:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788271680.153923:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788271680.153934:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788271680.155457:0:9474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:9474:1875138590052352:0@lo:502: 00000100:00100000:0.0:1788271680.155557:0:9474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271680.161968:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590052352 00000100:00100000:0.0:1788271680.163129:0:9474:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4041540 going to sleep for 11 seconds 00000100:00100000:3.0:1788271680.163233:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590052352 00000100:00100000:3.0:1788271680.163298:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788271680.163308:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:9474:x1875138590052352:12345-0@lo:502: 00000100:00100000:3.0:1788271680.163497:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:9474:x1875138590052352:12345-0@lo:502: Request processed in 190us (7940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271680.163515:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788271680.163665:0:9474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:9474:1875138590052352:0@lo:502: 00000040:00080000:0.0:1788271680.163756:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788271680.163851:0:9474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:3.0:1788271680.167302:0:9487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788271680.167316:0:9487:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1788271680.167323:0:9487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271680.167326:0:9487:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788271680.167334:0:9487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788271680.167375:0:9487:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8f6d82354d28) 00000020:00000080:3.0:1788271680.167403:0:9487:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788271680.167410:0:9487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788271680.167494:0:9487:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f6d820cc800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788271680.167504:0:9487:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788271680.167511:0:9487:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x99288105fd38e5d5 00010000:00010000:3.0:1788271680.184444:0:9487:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1788271680.187498:0:9487:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1788271680.195549:0:9487:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788271680.197183:0:9487:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1788271680.211561:0:9487:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1788271680.213370:0:9487:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1788271680.233402:0:9487:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1788271680.238516:0:9487:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788271680.238530:0:9487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788271680.238539:0:9487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271680.238542:0:9487:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788271680.238545:0:9487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788271680.238549:0:9487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271680.238551:0:9487:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788271680.238554:0:9487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788271680.238556:0:9487:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788271680.238585:0:9487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788271680.238587:0:9487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271680.238589:0:9487:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788271680.238592:0:9487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788271680.238999:0:9474:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788271680.239029:0:9474:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788271680.239053:0:9474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078400/0x99288105fd38e5c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e5c7 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.239068:0:9474:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078400/0x99288105fd38e5c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e5c7 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271680.239076:0:9474:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f6d820cc800 from 1 10000000:01000000:3.0:1788271680.239079:0:9474:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788271680.239116:0:9474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6ec21de800/0x99288105fd38e5dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.239140:0:9474:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6ec21de800/0x99288105fd38e5dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.239151:0:9474:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6ec21de800/0x99288105fd38e5dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271680.239175:0:9474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c62300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:9474:1875138590052480:0@lo:101: 00000100:00100000:3.0:1788271680.239245:0:9474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271680.239285:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590052480 00000100:00100000:3.0:1788271680.239292:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590052480 00000100:00100000:3.0:1788271680.239359:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788271680.239368:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:9474:x1875138590052480:12345-0@lo:101: 00010000:00010000:3.0:1788271680.239381:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271680.239393:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6ec21de000/0x99288105fd38e5e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e5dc expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.239414:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6ec21de000/0x99288105fd38e5e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e5dc expref: 16 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.239424:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6ec21de000/0x99288105fd38e5e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e5dc expref: 16 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.239433:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6ec21de000, rc 0) 00000100:00100000:3.0:1788271680.239464:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:9474:x1875138590052480:12345-0@lo:101: Request processed in 97us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271680.239470:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788271680.239523:0:9474:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc8ba840 going to sleep for 11 seconds 00000100:00100000:3.0:1788271680.239544:0:9474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c62300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:9474:1875138590052480:0@lo:101: 00010000:00010000:3.0:1788271680.239563:0:9474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6ec21de800/0x99288105fd38e5dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e5e3 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.239571:0:9474:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6ec21de800/0x99288105fd38e5dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e5e3 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271680.239954:0:9474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c62300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:9474:1875138590052608:0@lo:501: 00000100:00100000:3.0:1788271680.239994:0:9474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271680.240025:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590052608 00000100:00100000:3.0:1788271680.240030:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590052608 00000100:00100000:3.0:1788271680.240058:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788271680.240065:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:9474:x1875138590052608:12345-0@lo:501: 00000100:00100000:3.0:1788271680.240172:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:9474:x1875138590052608:12345-0@lo:501: Request processed in 107us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271680.240179:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788271680.240213:0:9474:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc8ba840 going to sleep for 11 seconds 00000100:00100000:3.0:1788271680.240228:0:9474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c62300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:9474:1875138590052608:0@lo:501: 00000100:00100000:3.0:1788271680.240255:0:9474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c62300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:9474:1875138590052736:0@lo:503: 00000100:00100000:3.0:1788271680.240297:0:9474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271680.240317:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590052736 00000100:00100000:3.0:1788271680.240320:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590052736 00000100:00100000:3.0:1788271680.240346:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788271680.244108:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:9474:x1875138590052736:12345-0@lo:503: 00000100:00100000:3.0:1788271680.244290:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:9474:x1875138590052736:12345-0@lo:503: Request processed in 201us (3991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271680.246880:0:9474:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc8ba840 going to sleep for 11 seconds 00000100:00100000:1.0:1788271680.246924:0:9474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c62300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:9474:1875138590052736:0@lo:503: 00000040:00080000:1.0:1788271680.247257:0:9474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788271680.247347:0:9474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82339c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:9474:1875138590052864:0@lo:502: 00000100:00100000:1.0:1788271680.247418:0:9474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271680.247455:0:9474:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e82fcbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788271680.250471:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590052864 00000100:00100000:0.0:1788271680.250486:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590052864 00000100:00100000:0.0:1788271680.250554:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788271680.250563:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:9474:x1875138590052864:12345-0@lo:502: 00000100:00100000:0.0:1788271680.250794:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:9474:x1875138590052864:12345-0@lo:502: Request processed in 231us (3375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271680.250809:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788271680.250918:0:9474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82339c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:9474:1875138590052864:0@lo:502: 00000040:00080000:1.0:1788271680.251186:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788271680.251218:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788271680.251253:0:9474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82339c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:9474:1875138590052992:0@lo:502: 00000100:00100000:1.0:1788271680.251297:0:9474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271680.251331:0:9474:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e82fcbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788271680.251861:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590052992 00000100:00100000:0.0:1788271680.251868:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590052992 00000100:00100000:0.0:1788271680.251906:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788271680.251914:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:9474:x1875138590052992:12345-0@lo:502: 00000100:00100000:0.0:1788271680.252058:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:9474:x1875138590052992:12345-0@lo:502: Request processed in 144us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271680.252066:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788271680.252193:0:9474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82339c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:9474:1875138590052992:0@lo:502: 00000040:00080000:2.0:1788271680.252244:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788271680.252253:0:9474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000100:00100000:3.0:1788271680.253946:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000020:01000000:1.0:1788271680.256509:0:9491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788271680.256525:0:9491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271680.256528:0:9491:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788271680.256536:0:9491:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f6d820cc800 00000020:00000080:1.0:1788271680.256540:0:9491:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788271680.256554:0:9491:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788271680.256557:0:9491:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271680.256559:0:9491:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788271680.256562:0:9491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788271680.256945:0:9474:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788271680.256978:0:9474:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788271680.257112:0:9474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6ec21de800/0x99288105fd38e5dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e5e3 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271680.257137:0:9474:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6ec21de800/0x99288105fd38e5dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e5e3 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271680.257196:0:9474:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788271680.257200:0:9474:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f6d820cc800 10000000:01000000:2.0:1788271680.257203:0:9474:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f6d820cc800 10000000:01000000:2.0:1788271680.257207:0:9474:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788271680.257213:0:9474:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f6d820cc800 from 1 10000000:01000000:2.0:1788271680.257216:0:9474:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788271680.257252:0:9474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20400/0x99288105fd38e5ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271680.257262:0:9474:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20400/0x99288105fd38e5ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271680.257273:0:9474:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20400/0x99288105fd38e5ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271680.257297:0:9474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ec8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:9474:1875138590053120:0@lo:101: 00000100:00100000:2.0:1788271680.257378:0:9474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271680.257427:0:9474:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84ea1900 going to sleep for 11 seconds 00000100:00100000:1.0:1788271680.257538:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590053120 00000100:00100000:1.0:1788271680.257546:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590053120 00000100:00100000:1.0:1788271680.257594:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788271680.257604:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:9474:x1875138590053120:12345-0@lo:101: 00010000:00010000:1.0:1788271680.257616:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271680.257651:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e5f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e5ea expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.257675:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e5f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e5ea expref: 17 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.257685:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e5f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e5ea expref: 17 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.257700:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e92d32c00, rc 0) 00000100:00100000:1.0:1788271680.258209:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:9474:x1875138590053120:12345-0@lo:101: Request processed in 603us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271680.258218:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788271680.258457:0:9474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ec8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:9474:1875138590053120:0@lo:101: 00010000:00010000:3.0:1788271680.258474:0:9474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20400/0x99288105fd38e5ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e5f1 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.258483:0:9474:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20400/0x99288105fd38e5ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e5f1 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271680.258583:0:9474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c62300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:9474:1875138590053248:0@lo:501: 00000100:00100000:3.0:1788271680.258854:0:9474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271680.258967:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590053248 00000100:00100000:2.0:1788271680.258973:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590053248 00000100:00100000:2.0:1788271680.259060:0:9474:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc8ba000 going to sleep for 11 seconds 00000100:00100000:2.0:1788271680.259140:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788271680.259149:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:9474:x1875138590053248:12345-0@lo:501: 00000100:00100000:2.0:1788271680.259270:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:9474:x1875138590053248:12345-0@lo:501: Request processed in 121us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271680.259289:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788271680.259367:0:9474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c62300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:9474:1875138590053248:0@lo:501: 00000100:00100000:3.0:1788271680.259397:0:9474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c62300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:9474:1875138590053376:0@lo:503: 00000100:00100000:3.0:1788271680.259443:0:9474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271680.259591:0:9474:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc8ba000 going to sleep for 11 seconds 00000100:00100000:1.0:1788271680.259775:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590053376 00000100:00100000:1.0:1788271680.259779:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590053376 00000100:00100000:1.0:1788271680.259802:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788271680.259808:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:9474:x1875138590053376:12345-0@lo:503: 00000100:00100000:1.0:1788271680.259940:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:9474:x1875138590053376:12345-0@lo:503: Request processed in 131us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271680.259948:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788271680.260185:0:9474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c62300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:9474:1875138590053376:0@lo:503: 00000040:00080000:3.0:1788271680.260428:0:9474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788271680.260507:0:9474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c62300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:9474:1875138590053504:0@lo:502: 00000100:00100000:3.0:1788271680.260550:0:9474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271680.260585:0:9474:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc8ba000 going to sleep for 11 seconds 00000100:00100000:1.0:1788271680.261248:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590053504 00000100:00100000:1.0:1788271680.261259:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590053504 00000100:00100000:1.0:1788271680.261296:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788271680.261304:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:9474:x1875138590053504:12345-0@lo:502: 00000100:00100000:1.0:1788271680.261454:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:9474:x1875138590053504:12345-0@lo:502: Request processed in 149us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271680.261462:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788271680.261675:0:9474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c62300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:9474:1875138590053504:0@lo:502: 00000040:00080000:3.0:1788271680.262304:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788271680.262545:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788271680.262573:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788271680.262589:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788271680.262601:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788271680.262614:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788271680.262652:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788271680.262668:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788271680.262693:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788271680.262708:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788271680.262724:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788271680.262749:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788271680.262763:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788271680.263080:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788271680.263097:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788271680.263110:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788271680.263124:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788271680.263137:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788271680.263148:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788271680.263161:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788271680.263176:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788271680.263190:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788271680.263204:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788271680.263219:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788271680.263232:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788271680.263244:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788271680.263257:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788271680.263270:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1788271680.263285:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788271680.263300:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1788271680.263313:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1788271680.263325:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1788271680.263338:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1788271680.263543:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1788271680.263560:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1788271680.263572:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1788271680.263583:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:3.0:1788271680.263597:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1788271680.263608:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:2.0:1788271680.264559:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:2.0:1788271680.264587:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:2.0:1788271680.264601:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:2.0:1788271680.264616:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:2.0:1788271680.264748:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:2.0:1788271680.264845:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:2.0:1788271680.264879:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:2.0:1788271680.264931:0:9474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ecad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:9474:1875138590053632:0@lo:502: 00000100:00100000:2.0:1788271680.265090:0:9474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271680.265172:0:9474:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84ea1240 going to sleep for 11 seconds 00000100:00100000:1.0:1788271680.265216:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590053632 00000100:00100000:1.0:1788271680.265224:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590053632 00000100:00100000:1.0:1788271680.265309:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788271680.265319:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:9474:x1875138590053632:12345-0@lo:502: 00000100:00100000:1.0:1788271680.265608:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:9474:x1875138590053632:12345-0@lo:502: Request processed in 289us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271680.265617:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788271680.265926:0:9474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ecad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:9474:1875138590053632:0@lo:502: 00000040:00080000:3.0:1788271680.266063:0:9474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:3.0:1788271680.266074:0:9474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:3.0:1788271680.266724:0:9492:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788271680.266749:0:9492:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8f6d823519b8) 00000020:00000080:3.0:1788271680.266908:0:9492:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:2.0:1788271680.267050:0:9492:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f6d820cc800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788271680.267055:0:9492:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f6d820cc800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788271680.267058:0:9492:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f6d820cc800 3 00010000:00080000:2.0:1788271680.267089:0:9492:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f6d82346000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.103@tcp at head 00010000:00010000:2.0:1788271680.270728:0:9492:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:2.0:1788271680.271119:0:9492:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788271680.271167:0:9492:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788271680.271180:0:9492:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x99288105fd38e5ff 00000100:00080000:2.0:1788271680.271190:0:9492:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788271680.271195:0:9492:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f6d82346000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788271680.271231:0:9492:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6eb4ec8700 x1875138590053760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788271680.271332:0:9492:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788271680.271495:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3605:1875138590053760:0@lo:38: 00000100:00100000:3.0:1788271680.271566:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271680.271797:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8233bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875138590054144:0@lo:400: 00000100:00100000:1.0:1788271680.271830:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271680.271854:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788271680.271860:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3606:1875138590054272:0@lo:400: 00000100:00100000:1.0:1788271680.271884:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271680.272069:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8233b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875138590053888:0@lo:400: 00000100:00100000:3.0:1788271680.272098:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271680.272111:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82338380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3608:1875138590054400:0@lo:400: 00000100:00100000:3.0:1788271680.272131:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271680.272146:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788271680.272151:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82339f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590054016:0@lo:400: 00000100:00100000:3.0:1788271680.272174:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271680.272266:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590053760 00000100:00100000:2.0:1788271680.272274:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590053760 00000100:00100000:2.0:1788271680.272297:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590054144 00000100:00100000:2.0:1788271680.272300:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590054144 00000100:00100000:2.0:1788271680.272334:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590054272 00000100:00100000:2.0:1788271680.272336:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590054272 00000100:00100000:2.0:1788271680.272385:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590053888 00000100:00100000:2.0:1788271680.272388:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590053888 00000100:00100000:2.0:1788271680.272400:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590054400 00000100:00100000:2.0:1788271680.272402:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590054400 00000100:00100000:2.0:1788271680.272419:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788271680.272429:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8233b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1875138590054144:12345-0@lo:400: 00000100:00100000:2.0:1788271680.272487:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8233b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1875138590054144:12345-0@lo:400: Request processed in 59us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271680.272494:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788271680.272512:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788271680.272518:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1875138590054272:12345-0@lo:400: 00000100:00100000:2.0:1788271680.272560:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1875138590054272:12345-0@lo:400: Request processed in 42us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271680.272565:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788271680.272577:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788271680.272582:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875138590053888:12345-0@lo:400: 00000100:00100000:2.0:1788271680.272610:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875138590053888:12345-0@lo:400: Request processed in 28us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271680.272615:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788271680.272653:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788271680.272660:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875138590054400:12345-0@lo:400: 00000100:00100000:2.0:1788271680.272688:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875138590054400:12345-0@lo:400: Request processed in 29us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271680.272693:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788271680.272705:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788271680.272710:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0c62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3605:x1875138590053760:12345-0@lo:38: 00010000:00080000:2.0:1788271680.272745:0:6485:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 241 last 0 00000020:00000080:2.0:1788271680.272786:0:6485:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x99288105fd38e606 00000004:00100000:2.0:1788271680.272803:0:6485:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788271680.272835:0:6485:0:(import.c:65:import_set_state_nolock()) ffff8f6d82342800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788271680.272873:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0c62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3605:x1875138590053760:12345-0@lo:38: Request processed in 162us (1306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271680.272879:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788271680.273155:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788271680.273161:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788271680.273193:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d8233b480 x1875138590053888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271680.273208:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8233b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875138590053888:0@lo:400: 00010000:00080000:3.0:1788271680.273218:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d82338380 x1875138590054400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271680.273224:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82338380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3608:1875138590054400:0@lo:400: 00010000:00080000:3.0:1788271680.273252:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6eb4ec8700 x1875138590053760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788271690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271680.273259:0:3605:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788271680.273275:0:3605:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788271680.273282:0:3605:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788271680.273286:0:3605:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788271680.273288:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6d82346000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788271680.273292:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3605:1875138590053760:0@lo:38: 00000100:00100000:1.0:1788271680.273383:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590054016 00000100:00100000:1.0:1788271680.273388:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590054016 00000100:00100000:1.0:1788271680.273430:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788271680.273437:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590054016:12345-0@lo:400: 00000100:00100000:1.0:1788271680.273487:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590054016:12345-0@lo:400: Request processed in 50us (1311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271680.273493:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1788271680.273526:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d82339500 x1875138590054272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271680.273536:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3606:1875138590054272:0@lo:400: 00010000:00080000:1.0:1788271680.273547:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d8233bb80 x1875138590054144/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271680.273555:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8233bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875138590054144:0@lo:400: 00000100:00100000:1.0:1788271680.273580:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82339f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590054016:0@lo:400: 00000100:00100000:3.0:1788271680.280214:0:9493:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cdf80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9493:1875138590054528:0@lo:901: 00000100:00100000:3.0:1788271680.280289:0:9493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271680.280332:0:9493:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc8ba9c0 going to sleep for 11 seconds 00000020:01000004:0.0:1788271680.280533:0:9492:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788271680.280559:0:9492:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8f6d82f0cd28) 00000020:00000080:0.0:1788271680.280588:0:9492:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:0.0:1788271680.280704:0:9492:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f6d820cc800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788271680.280708:0:9492:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f6d820cc800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788271680.280711:0:9492:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f6d820cc800 3 00010000:00080000:0.0:1788271680.280752:0:9492:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f6eb4edc000@lustre-MDT0001-lwp-OST0001: add connection 192.168.201.103@tcp at head 00000100:00100000:1.0:1788271680.280899:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590054528 00000100:00100000:1.0:1788271680.280906:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590054528 00000100:00100000:1.0:1788271680.281456:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788271680.281468:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9493:x1875138590054528:12345-0@lo:901: 00000100:00100000:1.0:1788271680.281589:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9493:x1875138590054528:12345-0@lo:901: Request processed in 124us (1301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271680.281606:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788271680.281891:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788271680.281926:0:9493:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d816cdf80 x1875138590054528/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788271696 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271680.281950:0:9493:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cdf80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9493:1875138590054528:0@lo:901: 00010000:00010000:0.0:1788271680.288214:0:9492:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:0.0:1788271680.289498:0:9492:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1788271680.289542:0:9492:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788271680.289553:0:9492:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x99288105fd38e614 00000100:00080000:0.0:1788271680.289563:0:9492:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788271680.289568:0:9492:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8f6eb4edc000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:0.0:1788271680.289600:0:9492:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d81f42300 x1875138590054656/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788271680.289646:0:9492:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:1.0:1788271680.290152:0:9492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000100:00100000:3.0:1788271680.290332:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3605:1875138590054656:0@lo:38: 00000100:00100000:3.0:1788271680.290410:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271680.290541:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590054656 00000100:00100000:0.0:1788271680.290549:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590054656 00000100:00100000:0.0:1788271680.290586:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788271680.290605:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3605:x1875138590054656:12345-0@lo:38: 00010000:00080000:0.0:1788271680.290668:0:6485:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 241 last 0 00000020:00000080:0.0:1788271680.290696:0:6485:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x99288105fd38e61b 00000004:00100000:0.0:1788271680.290710:0:6485:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788271680.290753:0:6485:0:(import.c:65:import_set_state_nolock()) ffff8f6d81d6a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788271680.290819:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3605:x1875138590054656:12345-0@lo:38: Request processed in 212us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271680.290826:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788271680.290863:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d81f42300 x1875138590054656/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788271690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271680.290875:0:3605:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788271680.290883:0:3605:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788271680.290890:0:3605:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788271680.290895:0:3605:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788271680.290897:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6eb4edc000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788271680.290903:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3605:1875138590054656:0@lo:38: 00000020:01000000:3.0:1788271680.291740:0:9474:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:3.0:1788271680.291780:0:9474:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788271680.291798:0:9474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20400/0x99288105fd38e5ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e5f1 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.291810:0:9474:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20400/0x99288105fd38e5ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e5f1 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788271680.291861:0:9474:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788271680.291863:0:9474:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788271680.291864:0:9474:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788271680.291865:0:9474:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788271680.291867:0:9474:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788271680.291868:0:9474:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788271680.291873:0:9474:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788271680.291874:0:9474:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788271680.291876:0:9474:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788271680.291878:0:9474:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788271680.291879:0:9474:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788271680.291883:0:9474:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1788271680.291885:0:9474:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788271680.291886:0:9474:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788271680.291887:0:9474:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788271680.291888:0:9474:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788271680.291890:0:9474:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788271680.291891:0:9474:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788271680.291892:0:9474:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788271680.291893:0:9474:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788271680.291894:0:9474:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788271680.291895:0:9474:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788271680.291896:0:9474:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788271680.291914:0:9474:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788271680.291928:0:9474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816ced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:9474:1875138590054784:0@lo:253: 00000100:00100000:3.0:1788271680.291972:0:9474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271680.292148:0:9474:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc8ba9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271680.293788:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590054784 00000100:00100000:1.0:1788271680.293798:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590054784 00000100:00100000:1.0:1788271680.293856:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788271680.293866:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:9474:x1875138590054784:12345-0@lo:253: 20000000:01000000:1.0:1788271680.293895:0:6477:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788271680.293911:0:6477:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788271680.308014:0:6477:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788271680.308035:0:6477:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788271680.308284:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:9474:x1875138590054784:12345-0@lo:253: Request processed in 14416us (16307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271680.308294:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 20000000:01000000:3.0:1788271680.308351:0:6499:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788271680.308356:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788271680.308376:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f6ec21de600/0x99288105fd38e622 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.308392:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6eb4078800/0x99288105fd38e518 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e511 expref: 16 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.308401:0:6499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6eb4078a00/0x99288105fd38e55e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e557 expref: 16 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.308406:0:6499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f6ec21de600/0x99288105fd38e622 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.308437:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6eb4078a00/0x99288105fd38e55e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e557 expref: 16 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.308453:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f6eb4078a00/0x99288105fd38e55e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e557 expref: 16 pid: 6476 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271680.308464:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cc700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6499:1875138590054912:0@lo:104: 00000100:00100000:3.0:1788271680.308493:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788271680.308531:0:6499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6eb4078800/0x99288105fd38e518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e511 expref: 16 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271680.308537:0:6499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f6eb4078800/0x99288105fd38e518 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e511 expref: 16 pid: 6477 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271680.308542:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cd500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6499:1875138590055040:0@lo:104: 00000100:00100000:3.0:1788271680.308554:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271680.308564:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc8bae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788271680.308590:0:9474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816ced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f4eab87b-0440-4f90-8c88-4ffaef16406f:9474:1875138590054784:0@lo:253: 10000000:01000000:3.0:1788271680.308599:0:9474:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788271680.308601:0:9474:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788271680.308603:0:9474:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788271680.308604:0:9474:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788271680.308605:0:9474:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788271680.308606:0:9474:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788271680.308607:0:9474:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788271680.308608:0:9474:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788271680.308609:0:9474:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788271680.308610:0:9474:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788271680.308611:0:9474:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788271680.308612:0:9474:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788271680.308649:0:9474:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788271680.309057:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590054912 00000100:00100000:2.0:1788271680.309064:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590054912 00000100:00100000:2.0:1788271680.309103:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590055040 00000100:00100000:2.0:1788271680.309105:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590055040 00000100:00100000:2.0:1788271680.309118:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788271680.309126:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+4:6499:x1875138590054912:12345-0@lo:104: 00010000:00010000:2.0:1788271680.309138:0:6466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e55e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271680.309192:0:6466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788271680.309198:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+4:6499:x1875138590054912:12345-0@lo:104: Request processed in 73us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271680.309205:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788271680.309219:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788271680.309225:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+3:6499:x1875138590055040:12345-0@lo:104: 00010000:00010000:2.0:1788271680.309233:0:6466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20e00/0x99288105fd38e511 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e518 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271680.309285:0:6466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788271680.309290:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+3:6499:x1875138590055040:12345-0@lo:104: Request processed in 66us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271680.309296:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1788271680.310693:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788271680.310704:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e55e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.310714:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4078e00 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:0.0:1788271680.310718:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e55e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.310729:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e557 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e55e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788271680.310763:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e557 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e55e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271680.310843:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788271680.310895:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e557 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e55e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.310902:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788271680.310926:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e557 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e55e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.310933:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e557 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e55e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.311019:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271680.311023:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20e00/0x99288105fd38e511 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e518 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.311029:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e20e00 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:0.0:1788271680.311032:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20e00/0x99288105fd38e511 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e518 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.311039:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20e00/0x99288105fd38e511 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e518 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788271680.311046:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20e00/0x99288105fd38e511 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e518 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271680.311051:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788271680.311074:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20e00/0x99288105fd38e511 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e518 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.311080:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788271680.311097:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20e00/0x99288105fd38e511 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e518 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.311104:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20e00/0x99288105fd38e511 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e518 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.313244:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271680.313247:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271680.313249:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271680.313280:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590055168:0@lo:103: 00000100:00100000:0.0:1788271680.313847:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271680.313924:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590055296:0@lo:103: 00000100:00100000:0.0:1788271680.313953:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271680.313992:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590055168 00000100:00100000:0.0:1788271680.313999:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590055168 00010000:00010000:0.0:1788271680.314037:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6eb4078a00/0x99288105fd38e55e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e557 expref: 17 pid: 6476 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271680.314064:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590055296 00000100:00100000:0.0:1788271680.314067:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590055296 00010000:00010000:0.0:1788271680.314080:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6eb4078800/0x99288105fd38e518 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e511 expref: 18 pid: 6477 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271680.314391:0:9485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788271680.314404:0:9485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4eab87b-0440-4f90-8c88-4ffaef16406f+18:3609:x1875138590055168:12345-0@lo:103: 00010000:00010000:1.0:1788271680.314418:0:9485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271680.314424:0:9485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6eb4078a00/0x99288105fd38e55e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e557 expref: 18 pid: 6476 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.314436:0:9485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6eb4078a00/0x99288105fd38e55e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e557 expref: 18 pid: 6476 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.314457:0:9485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271680.314508:0:9485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4eab87b-0440-4f90-8c88-4ffaef16406f+18:3609:x1875138590055168:12345-0@lo:103: Request processed in 108us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271680.314515:0:9485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788271680.314536:0:9485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788271680.314542:0:9485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:3606:x1875138590055296:12345-0@lo:103: 00010000:00010000:1.0:1788271680.314550:0:9485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271680.314553:0:9485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6eb4078800/0x99288105fd38e518 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e511 expref: 17 pid: 6477 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.314561:0:9485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6eb4078800/0x99288105fd38e518 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e511 expref: 17 pid: 6477 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.314586:0:9485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f6ec21de600/0x99288105fd38e622 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.314593:0:9485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6ec21de600/0x99288105fd38e622 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788271680.314607:0:9485:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006252164s 00010000:00010000:1.0:1788271680.314611:0:9485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f6ec21de600/0x99288105fd38e622 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.314640:0:9485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f6ec21de600/0x99288105fd38e622 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.314647:0:9485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f6ec21de600/0x99288105fd38e622 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.314654:0:9485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f6ec21de600/0x99288105fd38e622 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.314660:0:9485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6ec21de600 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:1.0:1788271680.314663:0:9485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f6ec21de600/0x99288105fd38e622 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.314672:0:9485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f6ec21de600/0x99288105fd38e622 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.314682:0:9485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f6ec21de600/0x99288105fd38e622 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271680.314692:0:9485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271680.314721:0:9485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:3606:x1875138590055296:12345-0@lo:103: Request processed in 179us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271680.314744:0:9485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788271680.317840:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590055296:0@lo:103: 00000100:00100000:2.0:1788271680.318392:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590055168:0@lo:103: 00010000:00010000:2.0:1788271680.319438:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1788271680.320548:0:9474:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00010000:00010000:0.0:1788271680.320769:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4078a00/0x99288105fd38e55e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e557 expref: 16 pid: 6476 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271680.320796:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cc700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6499:1875138590054912:0@lo:104: 00010000:00010000:0.0:1788271680.320810:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4078800/0x99288105fd38e518 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e511 expref: 15 pid: 6477 timeout: 391 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271680.320818:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cd500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6499:1875138590055040:0@lo:104: 00010000:00010000:0.0:1788271680.320840:0:6499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f6ec21de600/0x99288105fd38e622 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.320850:0:6499:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f6ec21de600/0x99288105fd38e622 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.320857:0:6499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f6ec21de600/0x99288105fd38e622 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271680.320863:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6ec21de600/0x99288105fd38e622 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1788271680.321328:0:9474:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788271680.321539:0:9474:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788271680.321881:0:9474:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788271680.322240:0:9474:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1788271680.323257:0:9474:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1788271680.325091:0:9474:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788271680.337718:0:9474:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788271680.337739:0:9474:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788271680.337776:0:9474:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788271680.337817:0:9474:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.103@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788271680.337836:0:9474:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1788271680.337857:0:9474:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1788271680.342777:0:9474:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788271680.343020:0:9474:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1788271680.930087:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271681.061169:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788271681.061194:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590055424:0@lo:41: 00000100:00100000:3.0:1788271681.061262:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271681.061365:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590055424 00000100:00100000:0.0:1788271681.061374:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590055424 00000100:00100000:0.0:1788271681.061430:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788271681.061441:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590055424:12345-0@lo:41: 00000004:00000024:0.0:1788271681.061477:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1788271681.061523:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590055424:12345-0@lo:41: Request processed in 84us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271681.061531:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788271681.061606:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590055424:0@lo:41: 00000020:00000004:3.0:1788271681.386528:0:9549:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788271681.386852:0:9549:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788271681.950207:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271682.974710:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271683.998419:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271685.021796:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271685.150314:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82339f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590055552:0@lo:13: 00000100:00100000:0.0:1788271685.150408:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271685.150469:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788271685.150476:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590055680:0@lo:13: 00000100:00100000:0.0:1788271685.150498:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271685.150528:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590055552 00000100:00100000:0.0:1788271685.150536:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590055552 00000100:00100000:0.0:1788271685.150581:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590055680 00000100:00100000:0.0:1788271685.150584:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590055680 00000100:00100000:0.0:1788271685.150602:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788271685.150610:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590055552:12345-0@lo:13: 00002000:00000024:0.0:1788271685.150709:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788271685.150755:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590055552:12345-0@lo:13: Request processed in 145us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271685.150763:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788271685.150780:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788271685.150786:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590055680:12345-0@lo:13: 00002000:00000024:0.0:1788271685.150795:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788271685.150817:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590055680:12345-0@lo:13: Request processed in 32us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271685.150823:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788271685.150838:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788271685.150864:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d81f42a00 x1875138590055680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271701 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271685.150884:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590055680:0@lo:13: 00010000:00080000:0.0:1788271685.150895:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82339f80 x1875138590055552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271701 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271685.150906:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82339f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590055552:0@lo:13: 00000100:00100000:2.0:1788271685.151462:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788271685.151473:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ec8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590055808:0@lo:41: 00000100:00100000:2.0:1788271685.151512:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271685.151544:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590055808 00000100:00100000:2.0:1788271685.151549:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590055808 00000100:00100000:2.0:1788271685.151583:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788271685.151590:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4eca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590055808:12345-0@lo:41: 00000004:00000024:2.0:1788271685.151642:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788271685.151703:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4eca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590055808:12345-0@lo:41: Request processed in 113us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271685.151710:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788271685.151747:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ec8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590055808:0@lo:41: 00000100:00100000:1.0:1788271685.662069:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875138590056320:0@lo:400: 00000100:00100000:0.0:1788271685.662121:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8233bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590055936:0@lo:400: 00000100:00100000:1.0:1788271685.662156:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271685.662170:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271685.662215:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82338e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3606:1875138590056832:0@lo:400: 00000100:00100000:0.0:1788271685.662220:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8233a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3607:1875138590056448:0@lo:400: 00000100:00100000:1.0:1788271685.662249:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271685.662281:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271685.662301:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875138590056064:0@lo:400: 00000100:00100000:1.0:1788271685.662333:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271685.662345:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3608:1875138590056576:0@lo:400: 00000100:00100000:1.0:1788271685.662368:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271685.662380:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788271685.662385:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590056192:0@lo:400: 00000100:00100000:1.0:1788271685.662407:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271685.662434:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8233ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3608:1875138590056704:0@lo:400: 00000100:00100000:1.0:1788271685.662459:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271685.662479:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590056192 00000100:00100000:1.0:1788271685.662486:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590056320 00000100:00100000:0.0:1788271685.662488:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590056192 00000100:00100000:1.0:1788271685.662492:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590056320 00000100:00100000:1.0:1788271685.662538:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590056832 00000100:00100000:1.0:1788271685.662542:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590056832 00000100:00100000:0.0:1788271685.662548:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788271685.662559:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8233b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590056192:12345-0@lo:400: 00000100:00100000:1.0:1788271685.662585:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590056448 00000100:00100000:1.0:1788271685.662589:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590056448 00000100:00100000:1.0:1788271685.662605:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590056064 00000100:00100000:1.0:1788271685.662607:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590056064 00000100:00100000:0.0:1788271685.662648:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8233b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590056192:12345-0@lo:400: Request processed in 62us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271685.662651:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590056576 00000100:00100000:1.0:1788271685.662656:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590056576 00000100:00100000:0.0:1788271685.662661:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788271685.662675:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590056704 00000100:00100000:1.0:1788271685.662679:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590056704 00000100:00100000:1.0:1788271685.662703:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788271685.662727:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8233b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1875138590056320:12345-0@lo:400: 00000100:00100000:1.0:1788271685.662768:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8233b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1875138590056320:12345-0@lo:400: Request processed in 41us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271685.662773:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788271685.662788:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788271685.662794:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1875138590056832:12345-0@lo:400: 00010000:00080000:0.0:1788271685.662811:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82338a80 x1875138590056320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271685.662823:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1875138590056832:12345-0@lo:400: Request processed in 29us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271685.662829:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875138590056320:0@lo:400: 00000100:00100000:1.0:1788271685.662832:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788271685.662849:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82338e00 x1875138590056832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271685.662850:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788271685.662860:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875138590056448:12345-0@lo:400: 00000100:00100000:0.0:1788271685.662863:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82338e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3606:1875138590056832:0@lo:400: 00000100:00100000:1.0:1788271685.662898:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875138590056448:12345-0@lo:400: Request processed in 39us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271685.662904:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788271685.662920:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788271685.662925:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82339f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875138590056064:12345-0@lo:400: 00000100:00100000:1.0:1788271685.662948:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82339f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875138590056064:12345-0@lo:400: Request processed in 24us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271685.662953:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788271685.662962:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788271685.662966:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875138590056576:12345-0@lo:400: 00000100:00100000:1.0:1788271685.662986:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875138590056576:12345-0@lo:400: Request processed in 17us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271685.662992:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788271685.663000:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788271685.663004:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875138590056704:12345-0@lo:400: 00000100:00100000:1.0:1788271685.663030:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875138590056704:12345-0@lo:400: Request processed in 26us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271685.663035:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788271685.663053:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590055936 00000100:00100000:1.0:1788271685.663056:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590055936 00000100:00100000:1.0:1788271685.663083:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788271685.663090:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:3607:x1875138590055936:12345-0@lo:400: 00000100:00100000:1.0:1788271685.663119:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:3607:x1875138590055936:12345-0@lo:400: Request processed in 29us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271685.663126:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:1.0:1788271685.663167:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788271685.663171:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788271685.663188:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8233bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590055936:0@lo:400: 00010000:00080000:1.0:1788271685.663197:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d8233a300 x1875138590056448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271685.663205:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8233a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3607:1875138590056448:0@lo:400: 00000100:00100000:1.0:1788271685.663227:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590056192:0@lo:400: 00010000:00080000:1.0:1788271685.663234:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d8233ad80 x1875138590056704/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271685.663240:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8233ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3608:1875138590056704:0@lo:400: 00010000:00080000:1.0:1788271685.663248:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82339500 x1875138590056064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271685.663257:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875138590056064:0@lo:400: 00010000:00080000:1.0:1788271685.663267:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82338000 x1875138590056576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271701 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271685.663281:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3608:1875138590056576:0@lo:400: 00000001:02000400:0.0:1788271685.809024:0:9839:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg103-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788271686.048643:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271686.174073:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590056960:0@lo:41: 00000100:00100000:1.0:1788271686.174157:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271686.174362:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590056960 00000100:00100000:0.0:1788271686.174372:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590056960 00000100:00100000:0.0:1788271686.174427:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788271686.174436:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590056960:12345-0@lo:41: 00000004:00000024:0.0:1788271686.174467:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1788271686.174519:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590056960:12345-0@lo:41: Request processed in 84us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271686.174540:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788271686.174671:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590056960:0@lo:41: 10000000:01000000:0.0:1788271686.685782:0:6480:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788271686.685792:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f6eb4b8b800 from 39 10000000:01000000:0.0:1788271686.685799:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788271686.685860:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079400/0x99288105fd38e629 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271686.685872:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079400/0x99288105fd38e629 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271686.685883:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079400/0x99288105fd38e629 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271686.685906:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f43480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590057088:0@lo:101: 00000100:00100000:0.0:1788271686.685975:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271686.686031:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8219a840 going to sleep for 11 seconds 00000100:00100000:0.0:1788271686.686051:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590057088 00000100:00100000:0.0:1788271686.686058:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590057088 00000100:00100000:0.0:1788271686.687259:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788271686.687269:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:6480:x1875138590057088:12345-0@lo:101: 00010000:00010000:0.0:1788271686.687284:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271686.687298:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4079200/0x99288105fd38e630 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e629 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271686.687327:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4079200/0x99288105fd38e630 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e629 expref: 16 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271686.687338:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4079200/0x99288105fd38e630 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e629 expref: 16 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271686.687358:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4079200, rc 0) 00000100:00100000:0.0:1788271686.687408:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:6480:x1875138590057088:12345-0@lo:101: Request processed in 140us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271686.687414:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788271686.687460:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f43480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590057088:0@lo:101: 00010000:00010000:0.0:1788271686.687475:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079400/0x99288105fd38e629 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e630 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271686.687484:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079400/0x99288105fd38e629 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e630 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271686.687549:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f43480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590057216:0@lo:501: 00000100:00100000:0.0:1788271686.687575:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271686.687599:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8219a840 going to sleep for 11 seconds 00000100:00100000:0.0:1788271686.687612:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590057216 00000100:00100000:0.0:1788271686.687616:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590057216 00000100:00100000:0.0:1788271686.687664:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788271686.687670:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:6480:x1875138590057216:12345-0@lo:501: 00000100:00100000:0.0:1788271686.687779:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:6480:x1875138590057216:12345-0@lo:501: Request processed in 108us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271686.687786:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788271686.687814:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f43480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590057216:0@lo:501: 00000100:00100000:0.0:1788271686.687851:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f43480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590057344:0@lo:503: 00000100:00100000:0.0:1788271686.687888:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271686.687901:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8219a840 going to sleep for 11 seconds 00000100:00100000:0.0:1788271686.687917:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590057344 00000100:00100000:0.0:1788271686.687920:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590057344 00000100:00100000:0.0:1788271686.687939:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788271686.687945:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:6480:x1875138590057344:12345-0@lo:503: 00000100:00100000:0.0:1788271686.688026:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:6480:x1875138590057344:12345-0@lo:503: Request processed in 78us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271686.688032:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788271686.688046:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f43480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590057344:0@lo:503: 00000100:00100000:3.0:1788271686.688289:0:9889:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816ce680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:9889:1875138590057472:0@lo:502: 00000100:00100000:3.0:1788271686.688330:0:9889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271686.688359:0:9889:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d81d58240 going to sleep for 11 seconds 00000100:00100000:0.0:1788271686.689421:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590057472 00000100:00100000:0.0:1788271686.689428:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590057472 00000100:00100000:0.0:1788271686.689474:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788271686.689483:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:9889:x1875138590057472:12345-0@lo:502: 00000100:00100000:0.0:1788271686.689604:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:9889:x1875138590057472:12345-0@lo:502: Request processed in 122us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271686.689612:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788271686.691071:0:9889:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816ce680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:9889:1875138590057472:0@lo:502: 00000100:00100000:3.0:1788271686.691144:0:9889:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816ce680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:9889:1875138590057600:0@lo:502: 00000100:00100000:3.0:1788271686.691203:0:9889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271686.691255:0:9889:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d81d58240 going to sleep for 11 seconds 00000100:00100000:0.0:1788271686.691677:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590057600 00000100:00100000:0.0:1788271686.691685:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590057600 00000100:00100000:0.0:1788271686.691741:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788271686.691752:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:9889:x1875138590057600:12345-0@lo:502: 00000100:00100000:0.0:1788271686.691883:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:9889:x1875138590057600:12345-0@lo:502: Request processed in 131us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271686.691890:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788271686.692691:0:9889:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816ce680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:9889:1875138590057600:0@lo:502: 00000040:00080000:3.0:1788271686.692732:0:9889:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788271686.693573:0:6480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788271686.693602:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788271686.693615:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079400/0x99288105fd38e629 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e630 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271686.693653:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079400/0x99288105fd38e629 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e630 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271686.693679:0:6480:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788271686.693683:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788271686.693686:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788271686.693736:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079c00/0x99288105fd38e637 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271686.693744:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079c00/0x99288105fd38e637 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271686.693754:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079c00/0x99288105fd38e637 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271686.693776:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f43480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590057728:0@lo:101: 00000100:00100000:0.0:1788271686.693963:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271686.694009:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8219a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271686.694663:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590057728 00000100:00100000:1.0:1788271686.694671:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590057728 00000100:00100000:1.0:1788271686.695138:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788271686.695149:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:6480:x1875138590057728:12345-0@lo:101: 00010000:00010000:1.0:1788271686.695164:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271686.695179:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6e92d33e00/0x99288105fd38e63e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e637 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271686.695206:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6e92d33e00/0x99288105fd38e63e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e637 expref: 17 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271686.695217:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6e92d33e00/0x99288105fd38e63e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e637 expref: 17 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271686.695228:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e92d33e00, rc 0) 00000100:00100000:1.0:1788271686.695283:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:6480:x1875138590057728:12345-0@lo:101: Request processed in 137us (1449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271686.695290:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788271686.695875:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f43480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590057728:0@lo:101: 00010000:00010000:0.0:1788271686.695899:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079c00/0x99288105fd38e637 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e63e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271686.695909:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079c00/0x99288105fd38e637 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e63e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271686.695992:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f43480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590057856:0@lo:501: 00000100:00100000:0.0:1788271686.696033:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271686.696059:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8219a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271686.696221:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590057856 00000100:00100000:1.0:1788271686.696228:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590057856 00000100:00100000:1.0:1788271686.696263:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788271686.696272:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:6480:x1875138590057856:12345-0@lo:501: 00000100:00100000:1.0:1788271686.696422:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:6480:x1875138590057856:12345-0@lo:501: Request processed in 151us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271686.696430:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788271686.700722:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f43480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590057856:0@lo:501: 00000100:00100000:0.0:1788271686.700791:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f43480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590057984:0@lo:503: 00000100:00100000:0.0:1788271686.700903:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271686.700940:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8219a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271686.700965:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590057984 00000100:00100000:0.0:1788271686.700971:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590057984 00000100:00100000:0.0:1788271686.701024:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788271686.701033:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:6480:x1875138590057984:12345-0@lo:503: 00000100:00100000:0.0:1788271686.701155:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:6480:x1875138590057984:12345-0@lo:503: Request processed in 122us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271686.701163:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788271686.701210:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f43480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590057984:0@lo:503: 00000100:00100000:0.0:1788271686.701400:0:9892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f43480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:9892:1875138590058112:0@lo:502: 00000100:00100000:0.0:1788271686.701433:0:9892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271686.701451:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590058112 00000100:00100000:0.0:1788271686.701454:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590058112 00000100:00100000:0.0:1788271686.701472:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788271686.701478:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:9892:x1875138590058112:12345-0@lo:502: 00000100:00100000:0.0:1788271686.701541:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:9892:x1875138590058112:12345-0@lo:502: Request processed in 63us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271686.701548:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788271686.701576:0:9892:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8219acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271686.701587:0:9892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f43480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:9892:1875138590058112:0@lo:502: 00000020:01000000:0.0:1788271686.701606:0:9892:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788271686.701615:0:9892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271686.701648:0:9892:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788271686.701656:0:9892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788271686.701658:0:9892:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788271686.701672:0:9892:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f43480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:9892:1875138590058240:0@lo:502: 00000100:00100000:0.0:1788271686.701708:0:9892:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271686.701726:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590058240 00000100:00100000:0.0:1788271686.701729:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590058240 00000100:00100000:0.0:1788271686.701751:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788271686.701758:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:9892:x1875138590058240:12345-0@lo:502: 00000100:00100000:0.0:1788271686.701810:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:9892:x1875138590058240:12345-0@lo:502: Request processed in 53us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271686.701817:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788271686.701850:0:9892:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8219acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271686.701861:0:9892:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f43480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:9892:1875138590058240:0@lo:502: 00000020:01000000:0.0:1788271686.701877:0:9892:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788271686.701881:0:9892:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271686.701882:0:9892:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788271686.701885:0:9892:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1788271686.702985:0:6480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788271686.703014:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788271686.703025:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079c00/0x99288105fd38e637 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e63e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271686.703051:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079c00/0x99288105fd38e637 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e63e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271686.703063:0:6480:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788271686.703066:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f6eb0cef800 from 39 10000000:01000000:2.0:1788271686.703070:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788271686.703101:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20600/0x99288105fd38e645 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271686.703110:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20600/0x99288105fd38e645 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271686.703120:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20600/0x99288105fd38e645 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271686.703135:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ec8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590058368:0@lo:101: 00000100:00100000:2.0:1788271686.703178:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271686.703207:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590058368 00000100:00100000:0.0:1788271686.703213:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590058368 00000100:00100000:2.0:1788271686.703214:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d88480 going to sleep for 11 seconds 00000100:00100000:0.0:1788271686.703256:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788271686.703266:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:6480:x1875138590058368:12345-0@lo:101: 00010000:00010000:0.0:1788271686.703277:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271686.703290:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4079a00/0x99288105fd38e64c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e645 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271686.703313:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4079a00/0x99288105fd38e64c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e645 expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271686.703323:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4079a00/0x99288105fd38e64c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e645 expref: 18 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271686.703331:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4079a00, rc 0) 00000100:00100000:0.0:1788271686.703380:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+18:6480:x1875138590058368:12345-0@lo:101: Request processed in 115us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271686.703386:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788271686.703681:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ec8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590058368:0@lo:101: 00010000:00010000:2.0:1788271686.703694:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20600/0x99288105fd38e645 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e64c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271686.703704:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20600/0x99288105fd38e645 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e64c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271686.703760:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ec8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590058496:0@lo:501: 00000100:00100000:2.0:1788271686.703787:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271686.703824:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d88480 going to sleep for 11 seconds 00000100:00100000:1.0:1788271686.704281:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590058496 00000100:00100000:1.0:1788271686.704288:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590058496 00000100:00100000:1.0:1788271686.704331:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788271686.704340:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+18:6480:x1875138590058496:12345-0@lo:501: 00000100:00100000:1.0:1788271686.704473:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+18:6480:x1875138590058496:12345-0@lo:501: Request processed in 134us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271686.704480:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788271686.704584:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ec8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590058496:0@lo:501: 00000100:00100000:2.0:1788271686.704615:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ec8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590058624:0@lo:503: 00000100:00100000:2.0:1788271686.704696:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271686.704720:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d88480 going to sleep for 11 seconds 00000100:00100000:1.0:1788271686.704797:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590058624 00000100:00100000:1.0:1788271686.704801:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590058624 00000100:00100000:1.0:1788271686.704845:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788271686.704853:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+18:6480:x1875138590058624:12345-0@lo:503: 00000100:00100000:1.0:1788271686.704942:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+18:6480:x1875138590058624:12345-0@lo:503: Request processed in 89us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271686.704948:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788271686.705169:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ec8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590058624:0@lo:503: 00000100:00100000:0.0:1788271686.705813:0:9893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f43480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:9893:1875138590058752:0@lo:502: 00000100:00100000:0.0:1788271686.705873:0:9893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271686.705906:0:9893:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8219a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788271686.706027:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590058752 00000100:00100000:2.0:1788271686.706033:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590058752 00000100:00100000:2.0:1788271686.706086:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788271686.706097:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+18:9893:x1875138590058752:12345-0@lo:502: 00000100:00100000:2.0:1788271686.706187:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+18:9893:x1875138590058752:12345-0@lo:502: Request processed in 93us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271686.706195:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788271686.706361:0:9893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f43480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:9893:1875138590058752:0@lo:502: 00000100:00100000:0.0:1788271686.706409:0:9893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f43480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:9893:1875138590058880:0@lo:502: 00000100:00100000:0.0:1788271686.706441:0:9893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271686.706464:0:9893:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8219a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788271686.706549:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590058880 00000100:00100000:2.0:1788271686.706553:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590058880 00000100:00100000:2.0:1788271686.706588:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788271686.706595:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+18:9893:x1875138590058880:12345-0@lo:502: 00000100:00100000:2.0:1788271686.706778:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+18:9893:x1875138590058880:12345-0@lo:502: Request processed in 183us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271686.706784:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788271686.707024:0:9893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f43480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:9893:1875138590058880:0@lo:502: 00000040:00080000:1.0:1788271686.707046:0:9893:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1788271686.707266:0:6480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788271686.707287:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788271686.707299:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20600/0x99288105fd38e645 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e64c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271686.707311:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20600/0x99288105fd38e645 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e64c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271686.707320:0:6480:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788271686.707330:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f6eb0cef800 from 6 10000000:01000000:2.0:1788271686.707333:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788271686.707361:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21a00/0x99288105fd38e653 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271686.707368:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21a00/0x99288105fd38e653 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271686.707376:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21a00/0x99288105fd38e653 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271686.707389:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ec8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590059008:0@lo:101: 00000100:00100000:2.0:1788271686.707419:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271686.707485:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d889c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271686.713511:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590059008 00000100:00100000:1.0:1788271686.713526:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590059008 00000100:00100000:1.0:1788271686.713589:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788271686.713600:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+18:6480:x1875138590059008:12345-0@lo:101: 00010000:00010000:1.0:1788271686.713638:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271686.713659:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6e92d32800/0x99288105fd38e65a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e653 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271686.713701:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6e92d32800/0x99288105fd38e65a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e653 expref: 19 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271686.713712:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6e92d32800/0x99288105fd38e65a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e653 expref: 19 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271686.713721:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e92d32800, rc 0) 00000100:00100000:1.0:1788271686.713801:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+19:6480:x1875138590059008:12345-0@lo:101: Request processed in 203us (6381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271686.713808:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788271686.713997:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ec8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590059008:0@lo:101: 00010000:00010000:1.0:1788271686.714023:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21a00/0x99288105fd38e653 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e65a expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271686.714035:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21a00/0x99288105fd38e653 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e65a expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271686.714168:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82339500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590059136:0@lo:256: 00000100:00100000:1.0:1788271686.714208:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271686.714250:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9014bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788271686.714970:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590059136 00000100:00100000:3.0:1788271686.714977:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590059136 00000100:00100000:3.0:1788271686.715022:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788271686.715030:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+19:6480:x1875138590059136:12345-0@lo:256: 20000000:01000000:3.0:1788271686.715045:0:6477:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788271686.715062:0:6477:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788271686.715065:0:6477:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788271686.715157:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+19:6480:x1875138590059136:12345-0@lo:256: Request processed in 127us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271686.715166:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82339500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590059136:0@lo:256: 00000100:00100000:3.0:1788271686.715167:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 10000000:01000000:2.0:1788271686.715220:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788271686.715228:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21a00/0x99288105fd38e653 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e65a expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271686.715237:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21a00/0x99288105fd38e653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e65a expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271686.715247:0:6480:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788271686.715249:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:2.0:1788271686.715252:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788271686.715274:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20200/0x99288105fd38e661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271686.715282:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20200/0x99288105fd38e661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271686.715300:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20200/0x99288105fd38e661 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271686.715313:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ec9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590059264:0@lo:101: 00000100:00100000:2.0:1788271686.715340:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271686.715372:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d88840 going to sleep for 11 seconds 00000100:00100000:3.0:1788271686.715670:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590059264 00000100:00100000:3.0:1788271686.715676:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590059264 00000100:00100000:3.0:1788271686.715715:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788271686.715722:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+19:6480:x1875138590059264:12345-0@lo:101: 00010000:00010000:3.0:1788271686.715732:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271686.715745:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6ec21de600/0x99288105fd38e668 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e661 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271686.715765:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6ec21de600/0x99288105fd38e668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e661 expref: 20 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271686.715776:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6ec21de600/0x99288105fd38e668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e661 expref: 20 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271686.715784:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6ec21de600, rc 0) 00000100:00100000:3.0:1788271686.715814:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:6480:x1875138590059264:12345-0@lo:101: Request processed in 93us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271686.715820:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788271686.722070:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ec9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590059264:0@lo:101: 00010000:00010000:3.0:1788271686.722122:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20200/0x99288105fd38e661 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e668 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271686.722135:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20200/0x99288105fd38e661 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e668 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271686.722226:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816ce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590059392:0@lo:501: 00000100:00100000:3.0:1788271686.722291:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271686.722332:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d81d58840 going to sleep for 11 seconds 00000100:00100000:1.0:1788271686.724834:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590059392 00000100:00100000:1.0:1788271686.724847:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590059392 00000100:00100000:1.0:1788271686.724912:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788271686.724922:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:6480:x1875138590059392:12345-0@lo:501: 00000100:00100000:1.0:1788271686.725112:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:6480:x1875138590059392:12345-0@lo:501: Request processed in 190us (2821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271686.725120:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788271686.725184:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816ce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590059392:0@lo:501: 00000100:00100000:1.0:1788271686.725232:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8233ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590059520:0@lo:503: 00000100:00100000:1.0:1788271686.725280:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271686.725299:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9014b780 going to sleep for 11 seconds 00000100:00100000:1.0:1788271686.725312:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590059520 00000100:00100000:1.0:1788271686.725315:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590059520 00000100:00100000:1.0:1788271686.725332:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788271686.725338:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:6480:x1875138590059520:12345-0@lo:503: 00000100:00100000:1.0:1788271686.725412:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:6480:x1875138590059520:12345-0@lo:503: Request processed in 74us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271686.725419:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788271686.725455:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8233ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590059520:0@lo:503: 00000100:00100000:3.0:1788271686.726326:0:9896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816ce680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:9896:1875138590059648:0@lo:502: 00000100:00100000:3.0:1788271686.726366:0:9896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271686.726389:0:9896:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d81d583c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271686.726929:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590059648 00000100:00100000:1.0:1788271686.726935:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590059648 00000100:00100000:1.0:1788271686.726975:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788271686.726985:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:9896:x1875138590059648:12345-0@lo:502: 00000100:00100000:1.0:1788271686.727217:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:9896:x1875138590059648:12345-0@lo:502: Request processed in 233us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271686.727225:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788271686.727302:0:9896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816ce680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:9896:1875138590059648:0@lo:502: 00000020:01000000:3.0:1788271686.727332:0:9896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788271686.727340:0:9896:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788271686.727346:0:9896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271686.727349:0:9896:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788271686.727355:0:9896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788271686.727360:0:9896:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.103@tcp to nid 0x20000c0a8c967 (192.168.201.103@tcp) 00000020:01000000:3.0:1788271686.727382:0:9896:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788271686.727386:0:9896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788271686.727401:0:9896:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8f6d82353370) 00000020:00000080:3.0:1788271686.727427:0:9896:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1788271686.727433:0:9896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788271686.727546:0:9896:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788271686.727554:0:9896:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788271686.727563:0:9896:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x99288105fd38e676 00000020:00000004:0.0:1788271686.727564:0:9894:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00010000:00080000:3.0:1788271686.727597:0:9896:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f6d830f3800@lustre-OST0001-osc-MDT0001: add connection 192.168.201.103@tcp at head 00010000:00010000:3.0:1788271686.727902:0:9896:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1788271686.728027:0:9896:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788271686.728039:0:9896:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788271686.729275:0:9896:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788271686.729399:0:9896:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788271686.729540:0:9896:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788271686.729688:0:9896:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788271686.730258:0:9897:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788271686.730265:0:9897:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000004:0.0:1788271686.730383:0:9894:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000080:2.0:1788271686.731426:0:9896:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788271686.731439:0:9896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788271686.731483:0:9896:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788271686.731516:0:9896:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x99288105fd38e67d 00000100:00080000:2.0:1788271686.731531:0:9896:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788271686.731538:0:9896:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f6d830f3800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788271686.731576:0:9896:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6eb4ec9880 x1875138590059776/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788271686.731609:0:9896:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1788271686.731765:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590060160:0@lo:400: 00000100:00100000:2.0:1788271686.731831:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271686.731875:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590060672:0@lo:400: 00000100:00100000:2.0:1788271686.731897:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271686.731917:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788271686.731923:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ecad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3606:1875138590060288:0@lo:400: 00000100:00100000:2.0:1788271686.731946:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271686.731960:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3606:1875138590060800:0@lo:400: 00000100:00100000:2.0:1788271686.731996:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1788271686.732052:0:9896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788271686.732057:0:9896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271686.732059:0:9896:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788271686.732062:0:9896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:0.0:1788271686.733039:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590060160 00000100:00100000:0.0:1788271686.733049:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590060160 00000100:00100000:0.0:1788271686.733103:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788271686.733113:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590060160:12345-0@lo:400: 00000100:00100000:0.0:1788271686.733184:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590060160:12345-0@lo:400: Request processed in 71us (1351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271686.733189:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590060672 00000100:00100000:0.0:1788271686.733194:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788271686.733196:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590060672 00000100:00100000:3.0:1788271686.733235:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788271686.733244:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590060672:12345-0@lo:400: 00000100:00100000:0.0:1788271686.733267:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590060160:0@lo:400: 00000100:00100000:3.0:1788271686.733290:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83155180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590060672:12345-0@lo:400: Request processed in 43us (1387us total) trans 0 rc 0/0 00010000:00080000:0.0:1788271686.733290:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83154000 x1875138590060672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271686.733304:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788271686.733309:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83154000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590060672:0@lo:400: 00000020:00000080:2.0:1788271686.733739:0:9896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271686.733742:0:9896:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788271686.733748:0:9896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788271686.733750:0:9896:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788271686.733782:0:9896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83156680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:9896:1875138590061056:0@lo:502: 00000100:00100000:2.0:1788271686.733827:0:9896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271686.733859:0:9896:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d88c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788271686.734214:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ec9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3605:1875138590059776:0@lo:8: 00000100:00100000:1.0:1788271686.734256:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271686.734291:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875138590059904:0@lo:400: 00000100:00100000:1.0:1788271686.734319:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271686.734338:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ec8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3608:1875138590060416:0@lo:400: 00000100:00100000:1.0:1788271686.734360:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271686.734382:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3608:1875138590060928:0@lo:400: 00000100:00100000:1.0:1788271686.734408:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271686.734426:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788271686.734433:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ec8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875138590060032:0@lo:400: 00000100:00100000:1.0:1788271686.734455:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271686.734467:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590060544:0@lo:400: 00000100:00100000:1.0:1788271686.734491:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271686.734534:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590060288 00000100:00100000:1.0:1788271686.734539:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590060288 00000100:00100000:1.0:1788271686.734571:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590060800 00000100:00100000:1.0:1788271686.734574:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590060800 00000100:00100000:1.0:1788271686.734587:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590059904 00000100:00100000:1.0:1788271686.734590:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590059904 00000100:00100000:1.0:1788271686.734602:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590060416 00000100:00100000:1.0:1788271686.734605:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590060416 00000100:00100000:1.0:1788271686.734615:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590060928 00000100:00100000:1.0:1788271686.734647:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590060928 00000100:00100000:1.0:1788271686.734662:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590060032 00000100:00100000:1.0:1788271686.734664:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590060032 00000100:00100000:1.0:1788271686.734683:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788271686.734692:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1875138590060288:12345-0@lo:400: 00000100:00100000:1.0:1788271686.734748:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83155c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1875138590060288:12345-0@lo:400: Request processed in 58us (2800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271686.734756:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788271686.734774:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788271686.734781:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3606:x1875138590060800:12345-0@lo:400: 00000100:00100000:1.0:1788271686.734812:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83156a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3606:x1875138590060800:12345-0@lo:400: Request processed in 33us (2816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271686.734818:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788271686.734832:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788271686.734850:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875138590059904:12345-0@lo:400: 00000100:00100000:3.0:1788271686.734897:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590061056 00000100:00100000:3.0:1788271686.734902:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590061056 00000100:00100000:3.0:1788271686.734929:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788271686.734936:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:9896:x1875138590061056:12345-0@lo:502: 00000100:00100000:2.0:1788271686.737770:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590059776 00000100:00100000:2.0:1788271686.737783:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590059776 00000100:00100000:2.0:1788271686.737824:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590060544 00000100:00100000:2.0:1788271686.737827:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590060544 00000100:00100000:2.0:1788271686.737860:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788271686.737870:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590060544:12345-0@lo:400: 00000100:00100000:1.0:1788271686.737947:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788271686.737960:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8233a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875138590060416:12345-0@lo:400: 00000100:00100000:3.0:1788271686.740939:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:9896:x1875138590061056:12345-0@lo:502: Request processed in 5993us (7101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271686.740953:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788271686.741040:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875138590059904:12345-0@lo:400: Request processed in 6191us (6717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271686.741050:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788271686.741077:0:6483:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788271686.741087:0:6483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788271686.741110:0:6485:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788271686.741119:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788271686.741130:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8233bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875138590060928:12345-0@lo:400: 00000100:00100000:0.0:1788271686.741178:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8233bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875138590060928:12345-0@lo:400: Request processed in 53us (6770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271686.741184:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788271686.741197:0:6485:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788271686.741203:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788271686.741211:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8233aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875138590060032:12345-0@lo:400: 00000100:00100000:0.0:1788271686.741240:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8233aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875138590060032:12345-0@lo:400: Request processed in 31us (6784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271686.741245:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1788271686.741320:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4ecad80 x1875138590060288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271686.741334:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ecad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3606:1875138590060288:0@lo:400: 00010000:00080000:0.0:1788271686.741357:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83156d80 x1875138590060800/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271686.741367:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3606:1875138590060800:0@lo:400: 00000100:00100000:2.0:1788271686.741381:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590060544:12345-0@lo:400: Request processed in 3510us (6886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271686.741393:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788271686.741410:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788271686.741417:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8233ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3605:x1875138590059776:12345-0@lo:8: 00010000:00080000:0.0:1788271686.741459:0:8398:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 247 last 0 00010000:00080000:1.0:1788271686.741475:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4ec8a80 x1875138590060032/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271686.741488:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ec8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875138590060032:0@lo:400: 00000020:00000080:0.0:1788271686.741492:0:8398:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x99288105fd38e684 00010000:00080000:1.0:1788271686.741501:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4ecbb80 x1875138590060544/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271686.741510:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590060544:0@lo:400: 00002000:00100000:0.0:1788271686.741512:0:8398:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8f6d81dd7000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113940 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1788271686.741519:0:8398:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00010000:00080000:1.0:1788271686.741523:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4ec8000 x1875138590059904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000001:00000004:0.0:1788271686.741524:0:8398:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1788271686.741535:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875138590059904:0@lo:400: 00010000:00080000:1.0:1788271686.741546:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83154e00 x1875138590060928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271686.741554:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83154e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3608:1875138590060928:0@lo:400: 00002000:00100000:0.0:1788271686.741597:0:8398:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1788271686.741608:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8233a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875138590060416:12345-0@lo:400: Request processed in 3653us (7246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271686.741616:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1788271686.741668:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4ec8e00 x1875138590060416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271686.741677:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ec8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3608:1875138590060416:0@lo:400: 00002000:00080000:0.0:1788271686.741862:0:8398:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1788271686.743723:0:8398:0:(import.c:65:import_set_state_nolock()) ffff8f6d81dd1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788271686.743821:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8233ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3605:x1875138590059776:12345-0@lo:8: Request processed in 2399us (9560us total) trans 0 rc 0/0 00010000:00080000:1.0:1788271686.745537:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4ec9880 x1875138590059776/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788271696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271686.745550:0:3605:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788271686.745566:0:3605:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788271686.745575:0:3605:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788271686.745581:0:3605:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788271686.745584:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6d830f3800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788271686.745605:0:3605:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788271686.745611:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ec9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3605:1875138590059776:0@lo:8: 00000100:00100000:1.0:1788271686.748991:0:9898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82338e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9898:1875138590061184:0@lo:700: 00000100:00100000:1.0:1788271686.749059:0:9898:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271686.749093:0:9898:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9014b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271686.749278:0:9896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83156680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:9896:1875138590061056:0@lo:502: 00000020:01000000:2.0:1788271686.749316:0:9896:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788271686.749323:0:9896:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271686.749325:0:9896:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788271686.749330:0:9896:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000004:00080000:2.0:1788271686.749440:0:9897:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788271686.749510:0:9897:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 247838890377ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788271686.749517:0:9897:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000020:01000000:1.0:1788271686.749857:0:6480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:1.0:1788271686.749881:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788271686.749891:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20200/0x99288105fd38e661 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e668 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271686.749902:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20200/0x99288105fd38e661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e668 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271686.749912:0:6480:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788271686.749915:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f6e91513000 from 39 10000000:01000000:1.0:1788271686.749918:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788271686.749959:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33c00/0x99288105fd38e68b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271686.749968:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33c00/0x99288105fd38e68b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271686.749977:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33c00/0x99288105fd38e68b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271686.749991:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfb84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590061312:0@lo:101: 00000100:00100000:1.0:1788271686.750031:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271686.750062:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9014b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271686.750286:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590061184 00000100:00100000:3.0:1788271686.750292:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590061184 00000100:00100000:3.0:1788271686.750352:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788271686.750362:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+7:9898:x1875138590061184:12345-0@lo:700: 00000100:00100000:3.0:1788271686.750396:0:8405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816ce680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8405:1875138590061440:0@lo:700: 00000100:00100000:3.0:1788271686.750424:0:8405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271686.750442:0:8405:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d81d58000 going to sleep for 11 seconds 00000100:00080000:3.0:1788271686.750464:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788271686.750490:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590061440 00000100:00100000:3.0:1788271686.750494:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590061440 00000100:00100000:3.0:1788271686.750520:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788271686.750526:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8405:x1875138590061440:12345-0@lo:700: 00000100:00100000:2.0:1788271686.751952:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590061312 00000100:00100000:2.0:1788271686.751971:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590061312 00000100:00100000:2.0:1788271686.752098:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788271686.752106:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:6480:x1875138590061312:12345-0@lo:101: 00010000:00010000:2.0:1788271686.752120:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271686.752137:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4e20c00/0x99288105fd38e692 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e68b expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271686.752165:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4e20c00/0x99288105fd38e692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e68b expref: 21 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271686.752177:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4e20c00/0x99288105fd38e692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e68b expref: 21 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271686.752186:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e20c00, rc 0) 00000100:00100000:2.0:1788271686.752244:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:6480:x1875138590061312:12345-0@lo:101: Request processed in 138us (2212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271686.752251:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788271686.752400:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfb84000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590061312:0@lo:101: 00010000:00010000:2.0:1788271686.752416:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33c00/0x99288105fd38e68b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e692 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271686.752426:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33c00/0x99288105fd38e68b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e692 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271686.752493:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83156680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590061568:0@lo:501: 00000100:00100000:2.0:1788271686.752525:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271686.752542:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d88cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271686.753389:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590061568 00000100:00100000:3.0:1788271686.753398:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590061568 00000100:00100000:0.0:1788271686.753497:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000004:00080000:0.0:1788271686.756088:0:7414:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:3.0:1788271686.756102:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788271686.756115:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:6480:x1875138590061568:12345-0@lo:501: 00000100:00100000:3.0:1788271686.756315:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:6480:x1875138590061568:12345-0@lo:501: Request processed in 203us (3789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271686.756325:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788271686.756997:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83156680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590061568:0@lo:501: 00000100:00100000:0.0:1788271686.757054:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590061696:0@lo:503: 00000100:00100000:0.0:1788271686.757110:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271686.757143:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8219a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271686.757185:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590061696 00000100:00100000:3.0:1788271686.757191:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590061696 00000100:00100000:3.0:1788271686.757212:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788271686.757217:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:6480:x1875138590061696:12345-0@lo:503: 00000100:00100000:3.0:1788271686.757288:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:6480:x1875138590061696:12345-0@lo:503: Request processed in 70us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271686.757293:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788271686.757333:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590061696:0@lo:503: 00000100:00100000:1.0:1788271686.758038:0:9901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfb86d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:9901:1875138590061824:0@lo:502: 00000100:00100000:1.0:1788271686.758083:0:9901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271686.758196:0:9901:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9014bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788271686.758814:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590061824 00000100:00100000:3.0:1788271686.758821:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590061824 00000100:00100000:3.0:1788271686.759034:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788271686.759047:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:9901:x1875138590061824:12345-0@lo:502: 00000100:00100000:3.0:1788271686.759158:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:9901:x1875138590061824:12345-0@lo:502: Request processed in 114us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271686.759167:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 40000000:02000000:0.0:1788271686.759393:0:6490:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:1.0:1788271686.763149:0:9901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfb86d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:9901:1875138590061824:0@lo:502: 00000100:00100000:1.0:1788271686.763236:0:9901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfb86d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:9901:1875138590061952:0@lo:502: 00000100:00100000:1.0:1788271686.763314:0:9901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271686.763362:0:9901:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9014bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788271686.763445:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590061952 00000100:00100000:3.0:1788271686.763453:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590061952 00000100:00100000:3.0:1788271686.763505:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788271686.763515:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:9901:x1875138590061952:12345-0@lo:502: 00000100:00100000:3.0:1788271686.763645:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:9901:x1875138590061952:12345-0@lo:502: Request processed in 131us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271686.763653:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788271686.763750:0:9901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfb86d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:9901:1875138590061952:0@lo:502: 00000040:00080000:1.0:1788271686.763770:0:9901:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1788271686.764734:0:6480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788271686.764758:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788271686.764776:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33c00/0x99288105fd38e68b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e692 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271686.764788:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33c00/0x99288105fd38e68b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e692 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271686.764796:0:6480:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788271686.764799:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f6e91513000 from 6 10000000:01000000:2.0:1788271686.764802:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788271686.764844:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21400/0x99288105fd38e699 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271686.764852:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21400/0x99288105fd38e699 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271686.764862:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21400/0x99288105fd38e699 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271686.764885:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83157480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590062080:0@lo:101: 00000100:00100000:2.0:1788271686.764930:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271686.764959:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d88cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271686.765006:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590062080 00000100:00100000:1.0:1788271686.765012:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590062080 00000100:00100000:1.0:1788271686.765061:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788271686.765070:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:6480:x1875138590062080:12345-0@lo:101: 00010000:00010000:1.0:1788271686.765080:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271686.765094:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6e92d32a00/0x99288105fd38e6a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e699 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271686.765116:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6e92d32a00/0x99288105fd38e6a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e699 expref: 22 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271686.765127:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6e92d32a00/0x99288105fd38e6a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e699 expref: 22 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271686.765135:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e92d32a00, rc 0) 00000100:00100000:1.0:1788271686.765169:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:6480:x1875138590062080:12345-0@lo:101: Request processed in 101us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271686.765180:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788271686.765210:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83157480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590062080:0@lo:101: 00010000:00010000:1.0:1788271686.765221:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21400/0x99288105fd38e699 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e6a0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271686.765230:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21400/0x99288105fd38e699 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e6a0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271686.765274:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfb86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590062208:0@lo:256: 00000100:00100000:1.0:1788271686.765303:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271686.765317:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9014bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788271686.765331:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590062208 00000100:00100000:1.0:1788271686.765334:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590062208 00000100:00100000:1.0:1788271686.765352:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788271686.765358:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:6480:x1875138590062208:12345-0@lo:256: 20000000:01000000:1.0:1788271686.765370:0:6476:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788271686.765388:0:6476:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788271686.765391:0:6476:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788271686.765461:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:6480:x1875138590062208:12345-0@lo:256: Request processed in 103us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271686.765468:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788271686.765496:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfb86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590062208:0@lo:256: 10000000:01000000:1.0:1788271686.765538:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788271686.765543:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21400/0x99288105fd38e699 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e6a0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271686.765550:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21400/0x99288105fd38e699 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e6a0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271686.765561:0:6480:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788271686.765562:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1788271686.765564:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788271686.765577:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33a00/0x99288105fd38e6a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271686.765584:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33a00/0x99288105fd38e6a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271686.765591:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33a00/0x99288105fd38e6a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271686.765602:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfb86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590062336:0@lo:101: 00000100:00100000:1.0:1788271686.765657:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271686.765670:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9014bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788271686.765681:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590062336 00000100:00100000:1.0:1788271686.765684:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590062336 00000100:00100000:1.0:1788271686.765701:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788271686.765708:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:6480:x1875138590062336:12345-0@lo:101: 00010000:00010000:1.0:1788271686.765714:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271686.765722:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6e92d33000/0x99288105fd38e6ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e6a7 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271686.765735:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6e92d33000/0x99288105fd38e6ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e6a7 expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271686.765743:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6e92d33000/0x99288105fd38e6ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e6a7 expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271686.765761:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e92d33000, rc 0) 00000100:00100000:1.0:1788271686.765788:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:6480:x1875138590062336:12345-0@lo:101: Request processed in 80us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271686.765794:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788271686.765819:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfb86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590062336:0@lo:101: 00010000:00010000:1.0:1788271686.765828:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33a00/0x99288105fd38e6a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e6ae expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271686.765999:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33a00/0x99288105fd38e6a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e6ae expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271686.766049:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfb86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590062464:0@lo:501: 00000100:00100000:1.0:1788271686.766072:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271686.766085:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4d10480 going to sleep for 11 seconds 00000100:00100000:1.0:1788271686.766097:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590062464 00000100:00100000:1.0:1788271686.766099:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590062464 00000100:00100000:1.0:1788271686.766116:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788271686.766122:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:6480:x1875138590062464:12345-0@lo:501: 00000100:00100000:1.0:1788271686.766224:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:6480:x1875138590062464:12345-0@lo:501: Request processed in 102us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271686.766230:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788271686.766257:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfb86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590062464:0@lo:501: 00000100:00100000:1.0:1788271686.766281:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfb86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590062592:0@lo:503: 00000100:00100000:1.0:1788271686.766315:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271686.766326:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4d10480 going to sleep for 11 seconds 00000100:00100000:1.0:1788271686.766340:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590062592 00000100:00100000:1.0:1788271686.766343:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590062592 00000100:00100000:1.0:1788271686.766357:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788271686.766362:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:6480:x1875138590062592:12345-0@lo:503: 00000100:00100000:1.0:1788271686.766431:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:6480:x1875138590062592:12345-0@lo:503: Request processed in 68us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271686.766437:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788271686.766471:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfb86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590062592:0@lo:503: 00000100:00100000:2.0:1788271686.769109:0:9902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83155f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:9902:1875138590062720:0@lo:502: 00000100:00100000:2.0:1788271686.769186:0:9902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271686.769259:0:9902:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d889c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271686.773296:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8405:x1875138590061440:12345-0@lo:700: Request processed in 22761us (22862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271686.773310:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788271686.774402:0:8405:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d816ce680 x1875138590061440/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788271702 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271686.774423:0:8405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816ce680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8405:1875138590061440:0@lo:700: 40000000:02000000:2.0:1788271686.774440:0:8405:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:1.0:1788271686.774962:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590062720 00000100:00100000:1.0:1788271686.774970:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590062720 00000100:00100000:1.0:1788271686.775028:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788271686.775038:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:9902:x1875138590062720:12345-0@lo:502: 00000100:00100000:1.0:1788271686.775186:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:9902:x1875138590062720:12345-0@lo:502: Request processed in 149us (6000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271686.775194:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788271686.775250:0:9902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83155f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:9902:1875138590062720:0@lo:502: 00000020:01000000:1.0:1788271686.775283:0:9902:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788271686.775291:0:9902:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788271686.775299:0:9902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271686.775301:0:9902:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788271686.775309:0:9902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788271686.775313:0:9902:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.103@tcp to nid 0x20000c0a8c967 (192.168.201.103@tcp) 00000020:01000000:1.0:1788271686.775341:0:9902:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788271686.775344:0:9902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788271686.775373:0:9902:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8f6eb4e93370) 00000020:00000080:1.0:1788271686.775400:0:9902:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:1.0:1788271686.775406:0:9902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788271686.775514:0:9902:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788271686.775521:0:9902:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788271686.775528:0:9902:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x99288105fd38e6bc 00010000:00080000:1.0:1788271686.775557:0:9902:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f6eb4edf000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.103@tcp at head 00010000:00010000:1.0:1788271686.776601:0:9902:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:1.0:1788271686.776795:0:9902:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788271686.776813:0:9902:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788271686.777006:0:9902:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788271686.777141:0:9902:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788271686.777291:0:9902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788271686.777381:0:9902:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788271686.782813:0:9904:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788271686.782822:0:9904:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788271686.787581:0:9902:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788271686.787599:0:9902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788271686.787694:0:9902:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788271686.787734:0:9902:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x99288105fd38e6c3 00000100:00080000:0.0:1788271686.787759:0:9902:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788271686.787766:0:9902:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f6eb4edf000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:0.0:1788271686.787822:0:9902:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d81f43b80 x1875138590062848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788271686.787858:0:9902:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788271686.787922:0:9902:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788271686.787926:0:9902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271686.787928:0:9902:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788271686.787932:0:9902:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788271686.787936:0:9902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271686.787937:0:9902:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788271686.787940:0:9902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788271686.787942:0:9902:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788271686.787975:0:9902:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f42300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:9902:1875138590062976:0@lo:502: 00000100:00100000:2.0:1788271686.788032:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3605:1875138590062848:0@lo:8: 00000100:00100000:0.0:1788271686.788056:0:9902:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271686.788099:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271686.788100:0:9902:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8219ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788271686.788146:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590062976 00000100:00100000:2.0:1788271686.788153:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590062976 00000100:00100000:2.0:1788271686.788200:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788271686.788210:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:9902:x1875138590062976:12345-0@lo:502: 00000100:00100000:2.0:1788271686.788328:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:9902:x1875138590062976:12345-0@lo:502: Request processed in 120us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271686.788335:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788271686.788369:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590062848 00000100:00100000:2.0:1788271686.788372:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590062848 00000100:00100000:2.0:1788271686.788387:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788271686.788390:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3605:x1875138590062848:12345-0@lo:8: 00010000:00080000:2.0:1788271686.788410:0:8397:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 247 last 0 00000020:00000080:2.0:1788271686.788431:0:8397:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x99288105fd38e6ca 00002000:00100000:2.0:1788271686.788446:0:8397:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8f6d82345000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113940 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788271686.788450:0:8397:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788271686.788452:0:8397:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788271686.788522:0:8397:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788271686.788540:0:8397:0:(import.c:65:import_set_state_nolock()) ffff8f6d82347000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788271686.788566:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83157b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3605:x1875138590062848:12345-0@lo:8: Request processed in 175us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271686.788571:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788271686.788595:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d81f43b80 x1875138590062848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788271696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271686.788602:0:3605:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788271686.788608:0:3605:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788271686.788613:0:3605:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788271686.788649:0:3605:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788271686.788651:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6eb4edf000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788271686.788657:0:3605:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788271686.788660:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3605:1875138590062848:0@lo:8: 00000100:00100000:2.0:1788271686.788682:0:9902:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f42300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:9902:1875138590062976:0@lo:502: 00000020:01000000:2.0:1788271686.788698:0:9902:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788271686.788702:0:9902:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271686.788703:0:9902:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788271686.788705:0:9902:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:1.0:1788271686.789519:0:6480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:1.0:1788271686.789543:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788271686.789552:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33a00/0x99288105fd38e6a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e6ae expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271686.789560:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33a00/0x99288105fd38e6a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e6ae expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271686.789568:0:6480:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788271686.789570:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f6e85beb370 from 1 10000000:01000000:1.0:1788271686.789571:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788271686.789605:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e6d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271686.789610:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e6d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271686.789643:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e6d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271686.789664:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfb86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590063104:0@lo:101: 00000100:00100000:1.0:1788271686.789711:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:2.0:1788271686.789726:0:9475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788271686.789739:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4d10840 going to sleep for 11 seconds 00000100:00100000:1.0:1788271686.789753:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590063104 00000100:00100000:1.0:1788271686.789757:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590063104 00000100:00100000:2.0:1788271686.789790:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9898:x1875138590061184:12345-0@lo:700: Request processed in 39429us (40730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271686.789790:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788271686.789797:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:6480:x1875138590063104:12345-0@lo:101: 00000100:00100000:2.0:1788271686.789799:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788271686.789808:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271686.789819:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4ed4e00/0x99288105fd38e6d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e6d1 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271686.789973:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4ed4e00/0x99288105fd38e6d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e6d1 expref: 24 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271686.789982:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4ed4e00/0x99288105fd38e6d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e6d1 expref: 24 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271686.789989:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4ed4e00, rc 0) 00000100:00100000:1.0:1788271686.790016:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:6480:x1875138590063104:12345-0@lo:101: Request processed in 219us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271686.790022:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788271686.790043:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfb86d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590063104:0@lo:101: 00010000:00010000:2.0:1788271686.790055:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e6d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e6d8 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271686.790065:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e6d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e6d8 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271686.790116:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83155500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590063232:0@lo:501: 00010000:00080000:1.0:1788271686.790129:0:9898:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82338e00 x1875138590061184/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788271702 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271686.790138:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271686.790140:0:9898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82338e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9898:1875138590061184:0@lo:700: 00000100:00100000:2.0:1788271686.790150:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d88780 going to sleep for 11 seconds 00000100:00100000:2.0:1788271686.790161:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590063232 00000100:00100000:2.0:1788271686.790163:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590063232 00000100:00100000:2.0:1788271686.790184:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788271686.790189:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:6480:x1875138590063232:12345-0@lo:501: 00000100:00100000:2.0:1788271686.790267:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:6480:x1875138590063232:12345-0@lo:501: Request processed in 77us (127us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788271686.790273:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788271686.790298:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83155500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590063232:0@lo:501: 10000000:01000000:2.0:1788271686.790318:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788271686.790323:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e6d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e6d8 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271686.790329:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e6d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e6d8 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788271686.790748:0:9904:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788271686.790810:0:9904:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 247880189975ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788271686.790819:0:9904:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1788271686.792778:0:6462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1788271686.800091:0:9905:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788271686.800107:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83155500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590063360:0@lo:13: 00000100:00100000:2.0:1788271686.800124:0:9905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83154380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9905:1875138590063488:0@lo:7: 00000100:00100000:0.0:1788271686.800191:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271686.800192:0:9905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271686.800235:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590063488 00000100:00100000:2.0:1788271686.800243:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590063488 00000100:00100000:2.0:1788271686.800304:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788271686.800314:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9905:x1875138590063488:12345-0@lo:7: 00000100:00100000:0.0:1788271686.801696:0:9905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d88840 going to sleep for 11 seconds 00000100:00100000:3.0:1788271686.802265:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590063360 00000100:00100000:3.0:1788271686.802274:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590063360 00000100:00100000:3.0:1788271686.802336:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788271686.802346:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3609:x1875138590063360:12345-0@lo:13: 00002000:00000024:3.0:1788271686.802373:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923861504 avail 3692339200 00000100:00100000:3.0:1788271686.802460:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3609:x1875138590063360:12345-0@lo:13: Request processed in 115us (2272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271686.802468:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788271686.802494:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788271686.802535:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83155500 x1875138590063360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271702 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271686.802557:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83155500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590063360:0@lo:13: 00000004:00080000:3.0:1788271686.802882:0:9898:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788271686.802907:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590063616:0@lo:13: 00000100:00100000:3.0:1788271686.802908:0:9898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816ce680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9898:1875138590063744:0@lo:7: 00000100:00100000:0.0:1788271686.802964:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271686.802975:0:9898:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271686.803005:0:9898:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e8511ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788271686.803021:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590063616 00000100:00100000:0.0:1788271686.803027:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590063616 00000100:00100000:0.0:1788271686.803061:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788271686.803071:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590063616:12345-0@lo:13: 00002000:00000024:0.0:1788271686.803083:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923861504 avail 3692339200 00000100:00100000:0.0:1788271686.803127:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590063616:12345-0@lo:13: Request processed in 59us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271686.803134:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788271686.803168:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d816cc700 x1875138590063616/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271702 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271686.803182:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590063616:0@lo:13: 00002000:00080000:2.0:1788271686.803684:0:8396:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1788271686.803691:0:8396:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788271686.803745:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83157100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9905:x1875138590063488:12345-0@lo:7: Request processed in 3431us (3555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271686.803753:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788271686.803769:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590063744 00000100:00100000:2.0:1788271686.803774:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590063744 00000100:00100000:2.0:1788271686.803801:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788271686.803813:0:9905:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83154380 x1875138590063488/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788271702 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271686.803818:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9898:x1875138590063744:12345-0@lo:7: 00000100:00100000:0.0:1788271686.803834:0:9905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83154380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9905:1875138590063488:0@lo:7: 00000004:00080000:0.0:1788271686.803848:0:9905:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788271686.803897:0:9905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f43b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9905:1875138590063872:0@lo:5: 00000100:00100000:0.0:1788271686.803926:0:9905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271686.803957:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590063872 00000100:00100000:0.0:1788271686.803961:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590063872 00000100:00100000:0.0:1788271686.803983:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788271686.803990:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9905:x1875138590063872:12345-0@lo:5: 00002000:00080000:0.0:1788271686.804015:0:8398:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788271686.804019:0:8398:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788271686.804045:0:9905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8219ab40 going to sleep for 11 seconds 00002000:00080000:2.0:1788271686.807361:0:8396:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1788271686.807371:0:8396:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788271686.807582:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9898:x1875138590063744:12345-0@lo:7: Request processed in 3763us (4604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271686.807593:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788271686.807794:0:9898:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d816ce680 x1875138590063744/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788271702 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271686.807809:0:9898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816ce680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9898:1875138590063744:0@lo:7: 00000004:00080000:3.0:1788271686.807829:0:9898:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788271686.807865:0:9898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85809500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9898:1875138590064000:0@lo:5: 00000100:00100000:3.0:1788271686.807902:0:9898:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271686.807933:0:9898:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e8511ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788271686.807961:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590064000 00000100:00100000:0.0:1788271686.807969:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590064000 00000100:00100000:0.0:1788271686.808673:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788271686.808685:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e85809f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9898:x1875138590064000:12345-0@lo:5: 00002000:00080000:0.0:1788271686.808724:0:8452:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1788271686.808774:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e85809f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9898:x1875138590064000:12345-0@lo:5: Request processed in 90us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271686.808782:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000001:00080000:2.0:1788271686.810495:0:9475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1788271686.810510:0:9475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788271686.810676:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9905:x1875138590063872:12345-0@lo:5: Request processed in 6682us (6744us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788271686.810686:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788271686.811353:0:9905:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d81f43b80 x1875138590063872/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788271702 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788271686.811366:0:9898:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6e85809500 x1875138590064000/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788271702 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271686.811396:0:9905:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788271686.811401:0:9898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85809500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9898:1875138590064000:0@lo:5: 00000100:00100000:1.0:1788271686.811405:0:9905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f43b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9905:1875138590063872:0@lo:5: 00000004:00080000:0.0:1788271686.811421:0:9898:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000004:00080000:1.0:1788271686.811422:0:9905:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788271686.811480:0:9898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f43480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9898:1875138590064128:0@lo:5: 00000100:00100000:1.0:1788271686.811481:0:9905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfb84e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9905:1875138590064256:0@lo:700: 00000100:00100000:1.0:1788271686.811531:0:9905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271686.811568:0:9905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4d100c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271686.811595:0:9898:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271686.811650:0:9898:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8219ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788271686.811663:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590064128 00000100:00100000:1.0:1788271686.811672:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590064128 00000100:00100000:1.0:1788271686.811720:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788271686.811730:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9898:x1875138590064128:12345-0@lo:5: 00000100:00100000:3.0:1788271686.811734:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590064256 00000100:00100000:3.0:1788271686.811741:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590064256 00002000:00080000:1.0:1788271686.811768:0:8397:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:3.0:1788271686.811784:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788271686.811794:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9905:x1875138590064256:12345-0@lo:700: 00000100:00100000:1.0:1788271686.814439:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9898:x1875138590064128:12345-0@lo:5: Request processed in 2705us (2839us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788271686.814453:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788271686.814681:0:9898:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d81f43480 x1875138590064128/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788271702 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271686.814700:0:9898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f43480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9898:1875138590064128:0@lo:5: 00000004:00080000:0.0:1788271686.814727:0:9898:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788271686.814772:0:9898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816ce680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9898:1875138590064384:0@lo:900: 00000100:00100000:0.0:1788271686.814811:0:9898:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271686.814836:0:9898:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8219ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788271686.816275:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590064384 00000100:00100000:1.0:1788271686.816286:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590064384 00000100:00100000:1.0:1788271686.816353:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788271686.816364:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9898:x1875138590064384:12345-0@lo:900: 00000100:00100000:1.0:1788271686.816446:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9898:x1875138590064384:12345-0@lo:900: Request processed in 83us (1634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271686.816454:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788271686.821896:0:9898:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d816ce680 x1875138590064384/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788271702 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271686.821916:0:9898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816ce680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9898:1875138590064384:0@lo:900: 00000001:00080000:3.0:1788271686.825778:0:9475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:2.0:1788271686.826903:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9905:x1875138590064256:12345-0@lo:700: Request processed in 15101us (15361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271686.826919:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788271686.827071:0:9905:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6ebfb84e00 x1875138590064256/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788271702 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271686.827086:0:9905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfb84e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9905:1875138590064256:0@lo:700: 00000004:02000040:0.0:1788271686.832700:0:9905:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:0.0:1788271686.846812:0:9905:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816ce680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9905:1875138590064512:0@lo:5: 00000100:00100000:0.0:1788271686.846903:0:9905:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271686.846965:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590064512 00000100:00100000:0.0:1788271686.846967:0:9905:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8219ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788271686.846973:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590064512 00000100:00100000:3.0:1788271686.847041:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788271686.847061:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4ec9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9905:x1875138590064512:12345-0@lo:5: 00002000:00080000:3.0:1788271686.852414:0:8452:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788271686.852438:0:8452:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:3.0:1788271686.854775:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4ec9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9905:x1875138590064512:12345-0@lo:5: Request processed in 7716us (7865us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788271686.854787:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788271686.857190:0:9905:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d816ce680 x1875138590064512/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788271702 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271686.857220:0:9905:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816ce680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9905:1875138590064512:0@lo:5: 00000004:00080000:1.0:1788271686.857237:0:9905:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:0.0:1788271687.069948:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788271687.523062:0:9475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:2.0:1788271688.093935:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271689.124293:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788271689.418115:0:10003:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788271689.418461:0:10003:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788271690.143173:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271690.271753:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590064640:0@lo:13: 00000100:00100000:1.0:1788271690.271814:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfb84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590064768:0@lo:13: 00000100:00100000:1.0:1788271690.271992:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271690.272164:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590064768 00000100:00100000:3.0:1788271690.272175:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590064768 00000100:00100000:3.0:1788271690.272296:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788271690.272309:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590064768:12345-0@lo:13: 00002000:00000024:3.0:1788271690.272351:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271690.272492:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590064768:12345-0@lo:13: Request processed in 185us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271690.272584:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788271690.272702:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788271690.272739:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6ebfb84e00 x1875138590064768/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271706 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271690.272760:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfb84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590064768:0@lo:13: 00000100:00100000:0.0:1788271690.275087:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271690.275160:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590064640 00000100:00100000:3.0:1788271690.275174:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590064640 00000100:00100000:3.0:1788271690.275266:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788271690.275318:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788271690.275375:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590064640:12345-0@lo:13: 00002000:00000024:3.0:1788271690.275424:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271690.275525:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590064640:12345-0@lo:13: Request processed in 155us (448us total) trans 0 rc 0/0 00010000:00080000:1.0:1788271690.275607:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6e85808e00 x1875138590064640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271706 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271690.275653:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590064640:0@lo:13: 00000100:00100000:1.0:1788271690.278094:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788271690.278132:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfb84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590064896:0@lo:41: 00000100:00100000:1.0:1788271690.278230:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271690.278458:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590064896 00000100:00100000:0.0:1788271690.278468:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590064896 00000100:00100000:0.0:1788271690.278534:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788271690.278576:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590064896:12345-0@lo:41: 00000004:00000024:0.0:1788271690.278643:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788271690.278706:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590064896:12345-0@lo:41: Request processed in 133us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271690.278713:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788271690.278775:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfb84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590064896:0@lo:41: 00000100:00100000:3.0:1788271690.280241:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000020:00000004:1.0:1788271690.557271:0:10051:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788271690.557284:0:10051:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:1.0:1788271690.972950:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271690.973069:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577432704 00000100:00100000:2.0:1788271690.973083:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577432704 00000100:00100000:2.0:1788271690.973149:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 180 00000100:00100000:2.0:1788271690.973161:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2394:x1875138577432704:12345-192.168.201.3@tcp:250: 00010000:00080000:2.0:1788271690.973202:0:6477:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 8a94beb9-7f16-4b5a-842a-fac2e5234617@192.168.201.3@tcp t0 exp 0000000000000000 cur 252 last 0 00000020:00000080:2.0:1788271690.973247:0:6477:0:(genops.c:1385:class_connect()) connect: client 8a94beb9-7f16-4b5a-842a-fac2e5234617, cookie 0x99288105fd38e6df 00000100:00080000:2.0:1788271690.973452:0:6477:0:(import.c:65:import_set_state_nolock()) ffff8f6d82344000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788271690.973538:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+5:2394:x1875138577432704:12345-192.168.201.3@tcp:250: Request processed in 377us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271690.973556:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 180 00000100:00100000:0.0:1788271690.981537:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271690.981672:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577432832 00000100:00100000:1.0:1788271690.981686:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577432832 00000100:00100000:1.0:1788271690.981770:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 181 00000100:00100000:1.0:1788271690.981783:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+5:6156:x1875138577432832:12345-192.168.201.3@tcp:101: 00010000:00010000:1.0:1788271690.981829:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271690.981852:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4ed5c00/0x99288105fd38e6e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd2a0 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271690.981898:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4ed5c00/0x99288105fd38e6e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd2a0 expref: 6 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271690.981910:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4ed5c00/0x99288105fd38e6e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd2a0 expref: 6 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271690.981919:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4ed5c00, rc 0) 00000100:00100000:1.0:1788271690.981997:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+6:6156:x1875138577432832:12345-192.168.201.3@tcp:101: Request processed in 217us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271690.982005:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 181 00000100:00100000:0.0:1788271690.984945:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271690.985274:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577432960 00000100:00100000:3.0:1788271690.985288:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577432960 00000100:00100000:3.0:1788271690.985359:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 182 00000100:00100000:3.0:1788271690.985371:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+6:6156:x1875138577432960:12345-192.168.201.3@tcp:501: 00000100:00100000:3.0:1788271690.985591:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+6:6156:x1875138577432960:12345-192.168.201.3@tcp:501: Request processed in 221us (660us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788271690.985601:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 182 00000100:00100000:1.0:1788271690.989171:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271690.989275:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577433088 00000100:00100000:0.0:1788271690.989285:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577433088 00000100:00100000:0.0:1788271690.989488:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 183 00000100:00100000:0.0:1788271690.989502:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+6:6156:x1875138577433088:12345-192.168.201.3@tcp:101: 00010000:00010000:0.0:1788271690.989527:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271690.989562:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4079e00/0x99288105fd38e6ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd2a7 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271690.989610:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4079e00/0x99288105fd38e6ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd2a7 expref: 7 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271690.989790:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4079e00/0x99288105fd38e6ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd2a7 expref: 7 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271690.989853:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4079e00, rc 0) 00000100:00100000:0.0:1788271690.989934:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+7:6156:x1875138577433088:12345-192.168.201.3@tcp:101: Request processed in 435us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271690.989942:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 183 00000100:00100000:0.0:1788271690.992407:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271690.992865:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577433216 00000100:00100000:2.0:1788271690.992877:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577433216 00000100:00100000:2.0:1788271690.992997:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 184 00000100:00100000:2.0:1788271690.993009:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+7:6156:x1875138577433216:12345-192.168.201.3@tcp:501: 00000100:00100000:2.0:1788271690.993241:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+8:6156:x1875138577433216:12345-192.168.201.3@tcp:501: Request processed in 228us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271690.993261:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 184 00000100:00100000:1.0:1788271690.997461:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271690.997537:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577433344 00000100:00100000:0.0:1788271690.997562:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577433344 00000100:00100000:0.0:1788271690.997784:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 185 00000100:00100000:0.0:1788271690.997808:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+8:6156:x1875138577433344:12345-192.168.201.3@tcp:503: 00000100:00100000:0.0:1788271690.998045:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+8:6156:x1875138577433344:12345-192.168.201.3@tcp:503: Request processed in 250us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271690.998054:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 185 00000100:00100000:1.0:1788271691.004914:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271691.006359:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577433472 00000100:00100000:2.0:1788271691.006377:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577433472 00000100:00100000:2.0:1788271691.006577:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 186 00000100:00100000:2.0:1788271691.006591:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+8:6174:x1875138577433472:12345-192.168.201.3@tcp:502: 00000100:00100000:2.0:1788271691.006869:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+8:6174:x1875138577433472:12345-192.168.201.3@tcp:502: Request processed in 279us (1969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271691.006879:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 186 00000100:00100000:1.0:1788271691.055474:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271691.055668:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577433600 00000100:00100000:0.0:1788271691.055683:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577433600 00000100:00100000:0.0:1788271691.055775:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 187 00000100:00100000:0.0:1788271691.055791:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+8:6174:x1875138577433600:12345-192.168.201.3@tcp:502: 00000100:00100000:0.0:1788271691.056291:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+8:6174:x1875138577433600:12345-192.168.201.3@tcp:502: Request processed in 503us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271691.056302:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 187 00000100:00100000:0.0:1788271691.062940:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271691.063093:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577433728 00000100:00100000:2.0:1788271691.063107:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577433728 00000100:00100000:2.0:1788271691.063187:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 188 00000100:00100000:2.0:1788271691.063200:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+8:6156:x1875138577433728:12345-192.168.201.3@tcp:101: 00010000:00010000:2.0:1788271691.063225:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271691.063248:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4e20e00/0x99288105fd38e6f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd2d8 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271691.063291:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4e20e00/0x99288105fd38e6f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd2d8 expref: 9 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271691.063305:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4e20e00/0x99288105fd38e6f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd2d8 expref: 9 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271691.063317:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e20e00, rc 0) 00000100:00100000:2.0:1788271691.066823:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+9:6156:x1875138577433728:12345-192.168.201.3@tcp:101: Request processed in 3605us (3878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271691.066841:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 188 00000100:00100000:1.0:1788271691.070578:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271691.070722:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577433856 00000100:00100000:3.0:1788271691.070735:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577433856 00000100:00100000:3.0:1788271691.070816:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 189 00000100:00100000:3.0:1788271691.070830:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+9:6156:x1875138577433856:12345-192.168.201.3@tcp:256: 20000000:01000000:3.0:1788271691.070869:0:6478:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788271691.070902:0:6478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788271691.070907:0:6478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788271691.070910:0:6478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788271691.070914:0:6478:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788271691.070916:0:6478:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1788271691.073399:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+9:6156:x1875138577433856:12345-192.168.201.3@tcp:256: Request processed in 2554us (2821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271691.073419:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 189 00000100:00100000:0.0:1788271691.076728:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271691.077291:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577433984 00000100:00100000:2.0:1788271691.077327:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577433984 00000100:00100000:2.0:1788271691.077406:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 190 00000100:00100000:2.0:1788271691.077418:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+9:6156:x1875138577433984:12345-192.168.201.3@tcp:101: 00010000:00010000:2.0:1788271691.077442:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271691.077467:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4e21600/0x99288105fd38e6fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd2df expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271691.077505:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4e21600/0x99288105fd38e6fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd2df expref: 10 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271691.077519:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4e21600/0x99288105fd38e6fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd2df expref: 10 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271691.077531:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e21600, rc 0) 00000100:00100000:2.0:1788271691.077665:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:6156:x1875138577433984:12345-192.168.201.3@tcp:101: Request processed in 248us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271691.077673:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 190 00000100:00100000:1.0:1788271691.085767:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271691.085946:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577434112 00000100:00100000:3.0:1788271691.085959:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577434112 00000100:00100000:3.0:1788271691.086039:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 191 00000100:00100000:3.0:1788271691.086051:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:6156:x1875138577434112:12345-192.168.201.3@tcp:501: 00000100:00100000:3.0:1788271691.086273:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:6156:x1875138577434112:12345-192.168.201.3@tcp:501: Request processed in 222us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271691.086282:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 191 00000100:00100000:0.0:1788271691.088139:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271691.088579:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577434240 00000100:00100000:1.0:1788271691.088592:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577434240 00000100:00100000:1.0:1788271691.088693:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 192 00000100:00100000:1.0:1788271691.088706:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:6156:x1875138577434240:12345-192.168.201.3@tcp:503: 00000100:00100000:1.0:1788271691.089079:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:6156:x1875138577434240:12345-192.168.201.3@tcp:503: Request processed in 374us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271691.089089:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 192 00000100:00100000:0.0:1788271691.092136:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271691.092309:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577434368 00000100:00100000:3.0:1788271691.092324:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577434368 00000100:00100000:3.0:1788271691.092400:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 193 00000100:00100000:3.0:1788271691.092412:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:6180:x1875138577434368:12345-192.168.201.3@tcp:502: 00000100:00100000:3.0:1788271691.092778:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:6180:x1875138577434368:12345-192.168.201.3@tcp:502: Request processed in 366us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271691.092789:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 193 00000100:00100000:3.0:1788271691.095283:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271691.095357:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577434496 00000100:00100000:1.0:1788271691.095368:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577434496 00000100:00100000:1.0:1788271691.095568:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 194 00000100:00100000:1.0:1788271691.095583:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:6180:x1875138577434496:12345-192.168.201.3@tcp:502: 00000100:00100000:1.0:1788271691.095879:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:6180:x1875138577434496:12345-192.168.201.3@tcp:502: Request processed in 299us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271691.095890:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 194 00000100:00100000:2.0:1788271691.107235:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271691.107504:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271691.113949:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577434880 00000100:00100000:1.0:1788271691.113973:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577434880 00000100:00100000:1.0:1788271691.114049:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:1.0:1788271691.114060:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1875138577434880:12345-192.168.201.3@tcp:38: 00010000:00080000:1.0:1788271691.114115:0:6484:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from ef8df183-a1b1-4e56-bce5-924a894c4a71@192.168.201.3@tcp t0 exp 0000000000000000 cur 252 last 0 00000020:00000080:1.0:1788271691.114229:0:6484:0:(genops.c:1385:class_connect()) connect: client ef8df183-a1b1-4e56-bce5-924a894c4a71, cookie 0x99288105fd38e702 00000004:00100000:1.0:1788271691.114267:0:6484:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788271691.114587:0:6484:0:(import.c:65:import_set_state_nolock()) ffff8f6d83216800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788271691.114906:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577434624 00000100:00100000:0.0:1788271691.114913:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577434624 00000100:00100000:1.0:1788271691.114950:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83154700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2394:x1875138577434880:12345-192.168.201.3@tcp:38: Request processed in 888us (7443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271691.114959:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:1.0:1788271691.114986:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 8 00000100:00100000:1.0:1788271691.114992:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1875138577434624:12345-192.168.201.3@tcp:38: 00010000:00080000:1.0:1788271691.115010:0:6484:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from ef8df183-a1b1-4e56-bce5-924a894c4a71@192.168.201.3@tcp t0 exp 0000000000000000 cur 252 last 0 00000020:00000080:1.0:1788271691.115064:0:6484:0:(genops.c:1385:class_connect()) connect: client ef8df183-a1b1-4e56-bce5-924a894c4a71, cookie 0x99288105fd38e709 00000004:00100000:1.0:1788271691.115082:0:6484:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788271691.115250:0:6484:0:(import.c:65:import_set_state_nolock()) ffff8f6d83212000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788271691.115280:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83155880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2394:x1875138577434624:12345-192.168.201.3@tcp:38: Request processed in 287us (8058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271691.115297:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 8 00010000:00010000:0.0:1788271691.167157:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271691.294398:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590065024:0@lo:41: 00000100:00100000:2.0:1788271691.294498:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271691.296093:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590065024 00000100:00100000:0.0:1788271691.296106:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590065024 00000100:00100000:0.0:1788271691.296195:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788271691.296208:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590065024:12345-0@lo:41: 00000004:00000024:0.0:1788271691.296259:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788271691.296361:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590065024:12345-0@lo:41: Request processed in 155us (1863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271691.296387:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788271691.296603:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590065024:0@lo:41: 00000100:00100000:3.0:1788271691.806956:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875138590065408:0@lo:400: 00000100:00100000:3.0:1788271691.807062:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271691.807137:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3609:1875138590065920:0@lo:400: 00000100:00100000:3.0:1788271691.807164:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271691.807182:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3609:1875138590066432:0@lo:400: 00000100:00100000:3.0:1788271691.807212:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271691.807244:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788271691.807249:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590065280:0@lo:400: 00000100:00100000:3.0:1788271691.807298:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271691.807322:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3609:1875138590065792:0@lo:400: 00000100:00100000:3.0:1788271691.807345:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271691.807359:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3609:1875138590066304:0@lo:400: 00000100:00100000:3.0:1788271691.807378:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271691.807406:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590065408 00000100:00100000:3.0:1788271691.807414:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590065408 00000100:00100000:3.0:1788271691.807476:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590065920 00000100:00100000:3.0:1788271691.807480:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590065920 00000100:00100000:3.0:1788271691.807501:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590066432 00000100:00100000:3.0:1788271691.807504:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590066432 00000100:00100000:3.0:1788271691.807517:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590065792 00000100:00100000:3.0:1788271691.807520:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590065792 00000100:00100000:3.0:1788271691.807542:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590066304 00000100:00100000:3.0:1788271691.807545:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590066304 00000100:00100000:3.0:1788271691.807565:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788271691.807574:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875138590065408:12345-0@lo:400: 00000100:00100000:3.0:1788271691.807667:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875138590065408:12345-0@lo:400: Request processed in 93us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271691.807675:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788271691.807697:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788271691.807704:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875138590065920:12345-0@lo:400: 00000100:00100000:3.0:1788271691.807733:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875138590065920:12345-0@lo:400: Request processed in 30us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271691.807739:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788271691.807749:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788271691.807755:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875138590066432:12345-0@lo:400: 00000100:00100000:3.0:1788271691.807782:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875138590066432:12345-0@lo:400: Request processed in 28us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271691.807794:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788271691.807806:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788271691.807812:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875138590065792:12345-0@lo:400: 00000100:00100000:3.0:1788271691.807839:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875138590065792:12345-0@lo:400: Request processed in 28us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271691.807845:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788271691.807855:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788271691.807860:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875138590066304:12345-0@lo:400: 00000100:00100000:3.0:1788271691.807886:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875138590066304:12345-0@lo:400: Request processed in 26us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271691.807891:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1788271691.807936:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4f38000 x1875138590065792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271691.807953:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3609:1875138590065792:0@lo:400: 00010000:00080000:3.0:1788271691.807965:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4f39180 x1875138590066304/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271691.807973:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3609:1875138590066304:0@lo:400: 00010000:00080000:3.0:1788271691.807982:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6e85809500 x1875138590065408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271691.807989:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875138590065408:0@lo:400: 00010000:00080000:3.0:1788271691.807997:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4f3ad80 x1875138590065920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271691.808005:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3609:1875138590065920:0@lo:400: 00010000:00080000:3.0:1788271691.808022:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4f39c00 x1875138590066432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271691.808030:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3609:1875138590066432:0@lo:400: 00000100:00100000:3.0:1788271691.808078:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590065280 00000100:00100000:3.0:1788271691.808082:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590065280 00000100:00100000:3.0:1788271691.808110:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788271691.808117:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3609:x1875138590065280:12345-0@lo:400: 00000100:00100000:3.0:1788271691.808153:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3609:x1875138590065280:12345-0@lo:400: Request processed in 36us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271691.808160:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788271691.808191:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590065280:0@lo:400: 00000100:00100000:0.0:1788271691.808478:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590065152:0@lo:13: 00000100:00100000:0.0:1788271691.808521:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271691.808562:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590065664:0@lo:400: 00000100:00100000:0.0:1788271691.808587:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271691.808609:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590066176:0@lo:400: 00000100:00100000:0.0:1788271691.808656:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271691.808674:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590066688:0@lo:400: 00000100:00100000:0.0:1788271691.808695:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271691.808717:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788271691.808722:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875138590065536:0@lo:400: 00000100:00100000:0.0:1788271691.808747:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271691.808766:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590066048:0@lo:400: 00000100:00100000:0.0:1788271691.808805:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271691.808826:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590066560:0@lo:400: 00000100:00100000:0.0:1788271691.808847:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271691.808874:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590066176 00000100:00100000:0.0:1788271691.808879:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590066176 00000100:00100000:0.0:1788271691.808907:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590066688 00000100:00100000:0.0:1788271691.808910:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590066688 00000100:00100000:0.0:1788271691.808924:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590066048 00000100:00100000:0.0:1788271691.808926:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590066048 00000100:00100000:0.0:1788271691.808936:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590066560 00000100:00100000:0.0:1788271691.808938:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590066560 00000100:00100000:0.0:1788271691.808951:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788271691.808957:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4ecad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590066176:12345-0@lo:400: 00000100:00100000:0.0:1788271691.809009:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4ecad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590066176:12345-0@lo:400: Request processed in 52us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271691.809016:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788271691.809031:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788271691.809037:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4ec8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590066688:12345-0@lo:400: 00000100:00100000:0.0:1788271691.809065:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4ec8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590066688:12345-0@lo:400: Request processed in 29us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271691.809072:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788271691.809082:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788271691.809089:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfbab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590066048:12345-0@lo:400: 00000100:00100000:0.0:1788271691.809115:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfbab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590066048:12345-0@lo:400: Request processed in 27us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271691.809120:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788271691.809130:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788271691.809135:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfba9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590066560:12345-0@lo:400: 00000100:00100000:0.0:1788271691.809159:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfba9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590066560:12345-0@lo:400: Request processed in 24us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271691.809164:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788271691.809212:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4f38e00 x1875138590066048/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271691.809223:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590066048:0@lo:400: 00010000:00080000:0.0:1788271691.809233:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4f3aa00 x1875138590066560/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271691.809239:0:3607:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788271691.809254:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590066560:0@lo:400: 00010000:00080000:0.0:1788271691.809270:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4f3b800 x1875138590066176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271691.809278:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590066176:0@lo:400: 00010000:00080000:0.0:1788271691.809286:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4f3a680 x1875138590066688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271691.809292:0:3607:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1788271691.809301:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590066688:0@lo:400: 00000100:00100000:0.0:1788271691.809325:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590065536 00000100:00100000:0.0:1788271691.809328:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590065536 00000100:00100000:0.0:1788271691.809353:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788271691.809359:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4ec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875138590065536:12345-0@lo:400: 00000100:00100000:0.0:1788271691.809395:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4ec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875138590065536:12345-0@lo:400: Request processed in 36us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271691.809401:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1788271691.809425:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4f38a80 x1875138590065536/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271691.809433:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875138590065536:0@lo:400: 00000100:00080000:1.0:1788271691.809759:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788271691.809767:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788271691.809771:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788271691.809847:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788271691.809858:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfb86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590066816:0@lo:13: 00000100:00100000:1.0:1788271691.809895:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271691.809993:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590065152 00000100:00100000:2.0:1788271691.809999:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590065152 00000100:00100000:2.0:1788271691.810025:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590066816 00000100:00100000:2.0:1788271691.810027:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590066816 00000100:00100000:2.0:1788271691.810040:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788271691.810046:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590065152:12345-0@lo:13: 00002000:00000024:2.0:1788271691.810074:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788271691.810138:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590065152:12345-0@lo:13: Request processed in 91us (1616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271691.810146:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788271691.810160:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788271691.810165:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590066816:12345-0@lo:13: 00002000:00000024:2.0:1788271691.810175:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788271691.810201:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590066816:12345-0@lo:13: Request processed in 36us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271691.810207:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788271691.813993:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590065664 00000100:00100000:3.0:1788271691.814015:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590065664 00000100:00100000:3.0:1788271691.814092:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788271691.814104:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4ec8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590065664:12345-0@lo:400: 00000100:00100000:3.0:1788271691.814230:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4ec8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590065664:12345-0@lo:400: Request processed in 128us (5640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271691.814237:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1788271691.815874:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6e85808a80 x1875138590065152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271707 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271691.815907:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590065152:0@lo:13: 00000100:00100000:1.0:1788271691.815926:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590065664:0@lo:400: 00010000:00080000:1.0:1788271691.815983:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6ebfb86a00 x1875138590066816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271707 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271691.815998:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfb86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590066816:0@lo:13: 00000100:00100000:2.0:1788271692.119925:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271692.120097:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577435136 00000100:00100000:0.0:1788271692.120109:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577435136 00000100:00100000:0.0:1788271692.120232:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 9 00000100:00100000:0.0:1788271692.120247:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:6156:x1875138577435136:12345-192.168.201.3@tcp:41: 00000004:00000024:0.0:1788271692.120299:0:9899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788271692.120385:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83156300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:6156:x1875138577435136:12345-192.168.201.3@tcp:41: Request processed in 143us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271692.120392:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 9 00000100:00080000:1.0:1788271692.120656:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788271692.121599:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271692.121671:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271692.121747:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577435008 00000100:00100000:1.0:1788271692.121755:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577435008 00000100:00100000:1.0:1788271692.121823:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577434752 00000100:00100000:1.0:1788271692.121826:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577434752 00000100:00100000:1.0:1788271692.121852:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 10 00000100:00100000:1.0:1788271692.121862:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:0:x1875138577435008:12345-192.168.201.3@tcp:41: 00000004:00000024:1.0:1788271692.121900:0:6484:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788271692.121959:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:0:x1875138577435008:12345-192.168.201.3@tcp:41: Request processed in 98us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271692.121981:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 10 00000100:00100000:1.0:1788271692.122000:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 11 00000100:00100000:1.0:1788271692.122007:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:0:x1875138577434752:12345-192.168.201.3@tcp:41: 00000004:00000024:1.0:1788271692.122019:0:6484:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788271692.122041:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:0:x1875138577434752:12345-192.168.201.3@tcp:41: Request processed in 35us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271692.122047:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 11 00000100:00080000:2.0:1788271692.122281:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788271692.124259:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271692.124493:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577435264 00000100:00100000:1.0:1788271692.124505:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577435264 00000100:00100000:1.0:1788271692.124588:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 12 00000100:00100000:1.0:1788271692.124599:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:6156:x1875138577435264:12345-192.168.201.3@tcp:40: 00000100:00100000:1.0:1788271692.124734:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:6156:x1875138577435264:12345-192.168.201.3@tcp:40: Request processed in 136us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271692.124742:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 12 00000100:00100000:1.0:1788271692.127601:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271692.127715:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577435648 00000100:00100000:2.0:1788271692.127727:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577435648 00000100:00100000:2.0:1788271692.127796:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 4 00000100:00100000:2.0:1788271692.127807:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:6156:x1875138577435648:12345-192.168.201.3@tcp:900: 00000100:00100000:2.0:1788271692.127903:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:6156:x1875138577435648:12345-192.168.201.3@tcp:900: Request processed in 97us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271692.127910:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 4 00000100:00100000:3.0:1788271692.130724:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271692.130946:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577435392 00000100:00100000:0.0:1788271692.130961:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577435392 00000100:00100000:0.0:1788271692.131022:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 16 00000100:00100000:0.0:1788271692.131033:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2394:x1875138577435392:12345-192.168.201.3@tcp:8: 00010000:00080000:0.0:1788271692.131085:0:8398:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from ef8df183-a1b1-4e56-bce5-924a894c4a71@192.168.201.3@tcp t0 exp 0000000000000000 cur 253 last 0 00000020:00000080:0.0:1788271692.131139:0:8398:0:(genops.c:1385:class_connect()) connect: client ef8df183-a1b1-4e56-bce5-924a894c4a71, cookie 0x99288105fd38e710 00002000:00100000:0.0:1788271692.131157:0:8398:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ef8df183-a1b1-4e56-bce5-924a894c4a71/ffff8f6d81dd6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788271692.131183:0:8398:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788271692.131763:0:8398:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788271692.131813:0:8398:0:(import.c:65:import_set_state_nolock()) ffff8f6d81dd3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788271692.131908:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2394:x1875138577435392:12345-192.168.201.3@tcp:8: Request processed in 875us (1196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271692.131918:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 16 00000100:00100000:3.0:1788271692.136539:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271692.136597:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271692.136799:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577435776 00000100:00100000:1.0:1788271692.136814:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577435776 00000100:00100000:1.0:1788271692.136887:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 196 00000100:00100000:1.0:1788271692.136899:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:2395:x1875138577435776:12345-192.168.201.3@tcp:400: 00000100:00100000:1.0:1788271692.137000:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:2395:x1875138577435776:12345-192.168.201.3@tcp:400: Request processed in 103us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271692.137009:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 196 00000100:00100000:0.0:1788271692.137296:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577435520 00000100:00100000:0.0:1788271692.137301:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577435520 00000100:00100000:0.0:1788271692.137337:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 17 00000100:00100000:0.0:1788271692.137343:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2394:x1875138577435520:12345-192.168.201.3@tcp:8: 00010000:00080000:0.0:1788271692.137379:0:8396:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from ef8df183-a1b1-4e56-bce5-924a894c4a71@192.168.201.3@tcp t0 exp 0000000000000000 cur 253 last 0 00000020:00000080:0.0:1788271692.137418:0:8396:0:(genops.c:1385:class_connect()) connect: client ef8df183-a1b1-4e56-bce5-924a894c4a71, cookie 0x99288105fd38e717 00002000:00100000:0.0:1788271692.137433:0:8396:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ef8df183-a1b1-4e56-bce5-924a894c4a71/ffff8f6d81dd2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788271692.137447:0:8396:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788271692.137730:0:8396:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788271692.137782:0:8396:0:(import.c:65:import_set_state_nolock()) ffff8f6d81dd6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788271692.137825:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2394:x1875138577435520:12345-192.168.201.3@tcp:8: Request processed in 480us (1309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271692.137842:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 17 00000100:00100000:2.0:1788271692.140703:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271692.140809:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577435904 00000100:00100000:0.0:1788271692.140821:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577435904 00000100:00100000:0.0:1788271692.140890:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 0 00000100:00100000:0.0:1788271692.140901:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:6156:x1875138577435904:12345-192.168.201.3@tcp:33: 00000004:00080000:1.0:1788271692.179130:0:6486:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 38111us 00010000:00010000:1.0:1788271692.192153:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00200000:0.0:1788271692.207070:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788271692.207219:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:6156:x1875138577435904:12345-192.168.201.3@tcp:33: Request processed in 66313us (66522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271692.207231:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 0 00000100:00100000:2.0:1788271692.462284:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271692.462877:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577436032 00000100:00100000:3.0:1788271692.462892:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577436032 00000100:00100000:3.0:1788271692.463008:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 13 00000100:00100000:3.0:1788271692.463021:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:6198:x1875138577436032:12345-192.168.201.3@tcp:101: 00010000:00010000:3.0:1788271692.463051:0:9899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271692.463250:0:9899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21dfc00/0x99288105fd38e71e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd310 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271692.463347:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21df800/0x99288105fd38e725 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271692.463361:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21df800/0x99288105fd38e725 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271692.463377:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21df800/0x99288105fd38e725 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271692.463429:0:9899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788271692.463434:0:9899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788271692.463453:0:9899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21df800/0x99288105fd38e725 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271692.463481:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21dfc00/0x99288105fd38e71e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd310 expref: 8 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271692.463505:0:9899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21df800/0x99288105fd38e725 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd310 expref: 7 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271692.463513:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6e920a2f00) 00010000:00010000:3.0:1788271692.463516:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788271692.463530:0:9899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6ec21df800, rc 0) 00000100:00100000:3.0:1788271692.463696:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83155500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:6198:x1875138577436032:12345-192.168.201.3@tcp:101: Request processed in 676us (1426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271692.463718:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 13 00010000:00010000:3.0:1788271693.213978:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271694.238994:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271694.683899:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271694.687584:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577436160 00000100:00100000:1.0:1788271694.687604:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577436160 00000100:00100000:1.0:1788271694.687751:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 14 00000100:00100000:1.0:1788271694.687766:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:6251:x1875138577436160:12345-192.168.201.3@tcp:41: 00000004:00000024:1.0:1788271694.687820:0:6484:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788271694.687911:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83155f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:6251:x1875138577436160:12345-192.168.201.3@tcp:41: Request processed in 148us (4028us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271694.687918:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 14 00000100:00080000:2.0:1788271694.690160:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788271694.694179:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271694.694505:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577436288 00000100:00100000:3.0:1788271694.694523:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577436288 00000100:00100000:3.0:1788271694.694655:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 15 00000100:00100000:3.0:1788271694.694670:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:6251:x1875138577436288:12345-192.168.201.3@tcp:41: 00000004:00000024:3.0:1788271694.694732:0:9899:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788271694.694825:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83157480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:6251:x1875138577436288:12345-192.168.201.3@tcp:41: Request processed in 158us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271694.694834:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 15 00000100:00080000:2.0:1788271694.695327:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788271694.706288:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271694.706513:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577436416 00000100:00100000:2.0:1788271694.706527:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577436416 00000100:00100000:2.0:1788271694.706678:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 18 00000100:00100000:2.0:1788271694.707153:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:6251:x1875138577436416:12345-192.168.201.3@tcp:13: 00002000:00000024:2.0:1788271694.707221:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788271694.707320:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:6251:x1875138577436416:12345-192.168.201.3@tcp:13: Request processed in 630us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271694.707329:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 18 00000100:00080000:1.0:1788271694.708245:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788271694.712747:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271694.712839:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577436544 00000100:00100000:3.0:1788271694.712853:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577436544 00000100:00100000:3.0:1788271694.712961:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 19 00000100:00100000:3.0:1788271694.712975:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:6251:x1875138577436544:12345-192.168.201.3@tcp:13: 00002000:00000024:3.0:1788271694.713029:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271694.713285:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:6251:x1875138577436544:12345-192.168.201.3@tcp:13: Request processed in 313us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271694.713295:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 19 00000100:00080000:1.0:1788271694.713665:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788271695.263432:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271695.389874:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfba9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590066944:0@lo:41: 00000100:00100000:0.0:1788271695.389980:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271695.390923:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590066944 00000100:00100000:0.0:1788271695.390936:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590066944 00000100:00100000:0.0:1788271695.391003:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788271695.391014:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfbaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590066944:12345-0@lo:41: 00000004:00000024:0.0:1788271695.391058:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788271695.391141:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfbaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590066944:12345-0@lo:41: Request processed in 127us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271695.391149:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788271695.391202:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfba9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590066944:0@lo:41: 00000100:00100000:0.0:1788271695.393981:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfba9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590067072:0@lo:13: 00000100:00100000:0.0:1788271695.394083:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271695.394564:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590067072 00000100:00100000:3.0:1788271695.394576:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590067072 00000100:00100000:3.0:1788271695.394675:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788271695.394691:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfbaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590067072:12345-0@lo:13: 00002000:00000024:3.0:1788271695.394796:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271695.394868:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfbaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590067072:12345-0@lo:13: Request processed in 182us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271695.394899:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1788271695.394925:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788271695.395015:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6ebfba9c00 x1875138590067072/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271711 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271695.395042:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfba9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590067072:0@lo:13: 00000100:00100000:1.0:1788271695.395067:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788271695.395076:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590067200:0@lo:13: 00000100:00100000:1.0:1788271695.395113:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271695.395225:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590067200 00000100:00100000:3.0:1788271695.395231:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590067200 00000100:00100000:3.0:1788271695.395277:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788271695.395284:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590067200:12345-0@lo:13: 00002000:00000024:3.0:1788271695.395299:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271695.395334:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590067200:12345-0@lo:13: Request processed in 50us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271695.395341:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1788271695.395367:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4f39880 x1875138590067200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271711 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271695.395380:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590067200:0@lo:13: 00000100:00080000:1.0:1788271695.395448:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1788271695.904445:0:9475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ef8df183-a1b1-4e56-bce5-924a894c4a71 00010000:00010000:1.0:1788271696.286055:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271696.416256:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfbab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590067328:0@lo:41: 00000100:00100000:2.0:1788271696.416336:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271696.416532:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590067328 00000100:00100000:0.0:1788271696.416540:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590067328 00000100:00100000:0.0:1788271696.416673:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788271696.416683:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590067328:12345-0@lo:41: 00000004:00000024:0.0:1788271696.416731:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788271696.416784:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590067328:12345-0@lo:41: Request processed in 102us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271696.416790:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788271696.416873:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfbab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590067328:0@lo:41: 00000100:00100000:0.0:1788271696.926529:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfbabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875138590067584:0@lo:400: 00000100:00100000:1.0:1788271696.926710:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfba9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590067456:0@lo:400: 00000100:00100000:1.0:1788271696.926760:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271696.926802:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfbab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590067968:0@lo:400: 00000100:00100000:1.0:1788271696.926827:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271696.926846:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfbaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590068480:0@lo:400: 00000100:00100000:1.0:1788271696.926866:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271696.926891:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfbab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590068992:0@lo:400: 00000100:00100000:1.0:1788271696.926909:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271696.926933:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788271696.926938:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfba8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875138590067840:0@lo:400: 00000100:00100000:1.0:1788271696.926971:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271696.926987:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfba8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590068352:0@lo:400: 00000100:00100000:1.0:1788271696.927004:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271696.927018:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590068864:0@lo:400: 00000100:00100000:1.0:1788271696.927036:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271696.927258:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590067968 00000100:00100000:1.0:1788271696.927276:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590067968 00000100:00100000:1.0:1788271696.927323:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788271696.927333:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590067968:12345-0@lo:400: 00000100:00100000:1.0:1788271696.927387:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590067968:12345-0@lo:400: Request processed in 55us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271696.927394:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788271696.927416:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590068480 00000100:00100000:1.0:1788271696.927419:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590068480 00000100:00100000:1.0:1788271696.927438:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590068992 00000100:00100000:1.0:1788271696.927450:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590068992 00000100:00100000:1.0:1788271696.927471:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590068352 00000100:00100000:1.0:1788271696.927474:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590068352 00000100:00100000:1.0:1788271696.927482:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590068864 00000100:00100000:1.0:1788271696.927485:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590068864 00000100:00100000:1.0:1788271696.927497:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788271696.927503:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590068480:12345-0@lo:400: 00000100:00100000:1.0:1788271696.927533:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590068480:12345-0@lo:400: Request processed in 31us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271696.927547:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788271696.927558:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788271696.927563:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590068992:12345-0@lo:400: 00000100:00100000:1.0:1788271696.927602:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590068992:12345-0@lo:400: Request processed in 38us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271696.927608:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788271696.927636:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788271696.927642:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590068352:12345-0@lo:400: 00000100:00100000:1.0:1788271696.927666:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590068352:12345-0@lo:400: Request processed in 25us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271696.927671:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788271696.927681:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788271696.927686:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590068864:12345-0@lo:400: 00000100:00100000:1.0:1788271696.927707:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590068864:12345-0@lo:400: Request processed in 22us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271696.927712:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788271696.927728:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590067840 00000100:00100000:1.0:1788271696.927731:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590067840 00000100:00100000:1.0:1788271696.927753:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788271696.927759:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875138590067840:12345-0@lo:400: 00000100:00100000:1.0:1788271696.927783:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875138590067840:12345-0@lo:400: Request processed in 25us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271696.927788:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1788271696.927804:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788271696.927833:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfba8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875138590067840:0@lo:400: 00010000:00080000:1.0:1788271696.927856:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6ebfba8a80 x1875138590068352/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271696.927865:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfba8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590068352:0@lo:400: 00010000:00080000:1.0:1788271696.927874:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6ebfba8e00 x1875138590068864/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271696.927881:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590068864:0@lo:400: 00000100:00100000:1.0:1788271696.927891:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfbab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590067968:0@lo:400: 00010000:00080000:1.0:1788271696.927899:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6ebfbaa300 x1875138590068480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271696.927906:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfbaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590068480:0@lo:400: 00010000:00080000:1.0:1788271696.927913:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6ebfbab480 x1875138590068992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271696.927921:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfbab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590068992:0@lo:400: 00000100:00100000:1.0:1788271696.927979:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590067456 00000100:00100000:1.0:1788271696.927982:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590067456 00000100:00100000:1.0:1788271696.928009:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788271696.928016:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3609:x1875138590067456:12345-0@lo:400: 00000100:00100000:1.0:1788271696.928050:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3609:x1875138590067456:12345-0@lo:400: Request processed in 35us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271696.928056:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788271696.928197:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfba9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590067712:0@lo:400: 00000100:00100000:1.0:1788271696.928223:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271696.928242:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3607:1875138590068224:0@lo:400: 00000100:00100000:1.0:1788271696.928270:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271696.928290:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfbaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3607:1875138590068736:0@lo:400: 00000100:00100000:1.0:1788271696.928309:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271696.928326:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfb84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590069248:0@lo:13: 00000100:00100000:1.0:1788271696.928361:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271696.928386:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788271696.928392:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfb86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590069120:0@lo:13: 00000100:00100000:1.0:1788271696.928415:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271696.928456:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590068224 00000100:00100000:1.0:1788271696.928460:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590068224 00000100:00100000:1.0:1788271696.928488:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590068736 00000100:00100000:1.0:1788271696.928491:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590068736 00000100:00100000:1.0:1788271696.928507:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788271696.928513:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875138590068224:12345-0@lo:400: 00000100:00100000:1.0:1788271696.928547:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875138590068224:12345-0@lo:400: Request processed in 33us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271696.928552:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788271696.928562:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788271696.928567:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875138590068736:12345-0@lo:400: 00000100:00100000:1.0:1788271696.928586:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875138590068736:12345-0@lo:400: Request processed in 21us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271696.928591:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788271696.928607:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590069248 00000100:00100000:1.0:1788271696.928611:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590069248 00000100:00100000:1.0:1788271696.928651:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590069120 00000100:00100000:1.0:1788271696.928654:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590069120 00000100:00100000:1.0:1788271696.928665:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788271696.928670:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83274700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590069248:12345-0@lo:13: 00002000:00000024:1.0:1788271696.928697:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788271696.928725:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83274700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590069248:12345-0@lo:13: Request processed in 54us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271696.928731:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788271696.928743:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788271696.928749:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83274a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590069120:12345-0@lo:13: 00002000:00000024:1.0:1788271696.928757:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788271696.928780:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83274a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590069120:12345-0@lo:13: Request processed in 30us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271696.928785:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1788271696.928798:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788271696.928810:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590067712 00000100:00100000:1.0:1788271696.928813:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590067712 00000100:00100000:1.0:1788271696.928829:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788271696.928834:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590067712:12345-0@lo:400: 00000100:00100000:1.0:1788271696.928861:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590067712:12345-0@lo:400: Request processed in 27us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271696.928867:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1788271696.928890:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6ebfb86300 x1875138590069120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271712 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271696.928905:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfb86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590069120:0@lo:13: 00000100:00100000:1.0:1788271696.928915:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfba9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590067712:0@lo:400: 00010000:00080000:1.0:1788271696.928925:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6ebfba8700 x1875138590068224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271696.928932:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfba8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3607:1875138590068224:0@lo:400: 00010000:00080000:1.0:1788271696.928949:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6ebfbaad80 x1875138590068736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271696.928957:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfbaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3607:1875138590068736:0@lo:400: 00010000:00080000:1.0:1788271696.928966:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6ebfb84e00 x1875138590069248/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271712 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271696.928976:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfb84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590069248:0@lo:13: 00000100:00100000:1.0:1788271696.929011:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfba9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590067456:0@lo:400: 00000100:00100000:1.0:1788271696.933529:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271696.933578:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3606:1875138590068096:0@lo:400: 00000100:00100000:1.0:1788271696.933647:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271696.933666:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfba8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3606:1875138590068608:0@lo:400: 00000100:00100000:1.0:1788271696.933695:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271696.933738:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590067584 00000100:00100000:1.0:1788271696.933746:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590067584 00000100:00100000:1.0:1788271696.933786:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590068096 00000100:00100000:1.0:1788271696.933789:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590068096 00000100:00100000:1.0:1788271696.933808:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590068608 00000100:00100000:1.0:1788271696.933810:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590068608 00000100:00100000:1.0:1788271696.933824:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788271696.933832:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83276300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875138590067584:12345-0@lo:400: 00000100:00100000:1.0:1788271696.933886:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83276300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875138590067584:12345-0@lo:400: Request processed in 53us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271696.933892:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788271696.933908:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788271696.933913:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83274000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1875138590068096:12345-0@lo:400: 00000100:00100000:1.0:1788271696.933949:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83274000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1875138590068096:12345-0@lo:400: Request processed in 35us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271696.937877:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788271696.937898:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83276d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3606:x1875138590068608:12345-0@lo:400: 00000100:00100000:3.0:1788271696.938069:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83276d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3606:x1875138590068608:12345-0@lo:400: Request processed in 178us (4377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271696.938078:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1788271696.938108:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271696.938453:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788271696.939132:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfbabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875138590067584:0@lo:400: 00000100:00100000:1.0:1788271696.939148:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3606:1875138590068096:0@lo:400: 00000100:00100000:1.0:1788271696.939160:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfba8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3606:1875138590068608:0@lo:400: 00000001:00100000:3.0:1788271696.939328:0:6462:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ef8df183-a1b1-4e56-bce5-924a894c4a71 00000001:00100000:1.0:1788271696.951977:0:7414:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ef8df183-a1b1-4e56-bce5-924a894c4a71 00000001:02000400:3.0:1788271697.048877:0:10149:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788271697.310830:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271697.313051:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271697.313158:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271697.313195:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271697.313226:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271697.313277:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271697.313310:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577437184 00000100:00100000:2.0:1788271697.313320:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577437184 00000100:00100000:2.0:1788271697.313378:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577437056 00000100:00100000:2.0:1788271697.313382:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577437056 00000100:00100000:2.0:1788271697.313406:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 16 00000100:00100000:2.0:1788271697.313416:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577437184:12345-192.168.201.3@tcp:400: 00000100:00100000:2.0:1788271697.313499:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577437184:12345-192.168.201.3@tcp:400: Request processed in 83us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271697.313507:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 16 00000100:00100000:2.0:1788271697.313523:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 17 00000100:00100000:2.0:1788271697.313529:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4fb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2395:x1875138577437056:12345-192.168.201.3@tcp:400: 00000100:00100000:2.0:1788271697.313551:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4fb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2395:x1875138577437056:12345-192.168.201.3@tcp:400: Request processed in 22us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271697.313567:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 17 00000100:00100000:1.0:1788271697.313855:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577436928 00000100:00100000:1.0:1788271697.313860:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577436928 00000100:00100000:1.0:1788271697.313903:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577436800 00000100:00100000:1.0:1788271697.313906:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577436800 00000100:00100000:1.0:1788271697.313932:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 55 00000100:00100000:1.0:1788271697.313939:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577436928:12345-192.168.201.3@tcp:400: 00000100:00100000:1.0:1788271697.313970:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83154e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577436928:12345-192.168.201.3@tcp:400: Request processed in 32us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271697.313977:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 55 00000100:00100000:1.0:1788271697.313990:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 56 00000100:00100000:1.0:1788271697.313996:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2395:x1875138577436800:12345-192.168.201.3@tcp:400: 00000100:00100000:1.0:1788271697.314018:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83154000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2395:x1875138577436800:12345-192.168.201.3@tcp:400: Request processed in 23us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271697.314025:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 56 00000100:00100000:3.0:1788271697.324317:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577436672 00000100:00100000:3.0:1788271697.324333:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577436672 00000100:00100000:3.0:1788271697.324395:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 198 00000100:00100000:3.0:1788271697.324416:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:2395:x1875138577436672:12345-192.168.201.3@tcp:400: 00000100:00100000:3.0:1788271697.324516:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:2395:x1875138577436672:12345-192.168.201.3@tcp:400: Request processed in 103us (11475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271697.324525:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 198 00000100:00080000:3.0:1788271697.324559:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788271697.324565:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788271697.324568:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788271697.324572:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1788271697.958839:0:8391:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ef8df183-a1b1-4e56-bce5-924a894c4a71 00010000:00010000:2.0:1788271698.345735:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271699.361269:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271700.381864:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271700.510008:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788271700.510060:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83274e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590069376:0@lo:13: 00000100:00100000:1.0:1788271700.510155:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271700.510235:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590069376 00000100:00100000:1.0:1788271700.510244:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590069376 00000100:00100000:1.0:1788271700.510308:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788271700.510322:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83277800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590069376:12345-0@lo:13: 00002000:00000024:1.0:1788271700.510355:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788271700.510421:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83277800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590069376:12345-0@lo:13: Request processed in 102us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271700.510430:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1788271700.510490:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83274e00 x1875138590069376/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271716 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271700.510508:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83274e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590069376:0@lo:13: 00000100:00100000:1.0:1788271700.511265:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590069504:0@lo:41: 00000100:00100000:1.0:1788271700.511316:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271700.511495:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590069504 00000100:00100000:2.0:1788271700.511501:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590069504 00000100:00100000:2.0:1788271700.511551:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788271700.511562:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83274e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590069504:12345-0@lo:41: 00000004:00000024:2.0:1788271700.511597:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788271700.511671:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83274e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590069504:12345-0@lo:41: Request processed in 112us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271700.511678:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788271700.511713:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590069504:0@lo:41: 00000100:00080000:3.0:1788271700.518105:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788271700.518659:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590069632:0@lo:13: 00000100:00100000:1.0:1788271700.518748:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271700.518864:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590069632 00000100:00100000:3.0:1788271700.518873:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590069632 00000100:00100000:3.0:1788271700.518943:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788271700.518953:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83275180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590069632:12345-0@lo:13: 00002000:00000024:3.0:1788271700.518978:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271700.520061:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83275180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590069632:12345-0@lo:13: Request processed in 1105us (1309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271700.520074:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1788271700.520108:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788271700.523981:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4fb5c00 x1875138590069632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271716 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271700.524007:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590069632:0@lo:13: 00000020:00000080:1.0:1788271701.343880:0:10297:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff11d96540 20000000:00000080:1.0:1788271701.343907:0:10297:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f6d832a6c00 uarg=0000000000000000 20000000:01000000:1.0:1788271701.343968:0:10297:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1788271701.344036:0:10297:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1788271701.344041:0:10297:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788271701.344047:0:10297:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788271701.344062:0:10297:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1788271701.344145:0:10297:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788271701.344149:0:10297:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788271701.344925:0:10298:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:1.0:1788271701.345466:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:1.0:1788271701.345501:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:1.0:1788271701.345515:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:1.0:1788271701.345526:0:10297:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788271701.345528:0:10297:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788271701.346269:0:10299:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:1.0:1788271701.346894:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:1.0:1788271701.346923:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:1.0:1788271701.346939:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:1.0:1788271701.346949:0:10297:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788271701.346952:0:10297:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788271701.347539:0:10300:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:1.0:1788271701.348179:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:1.0:1788271701.348212:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:1.0:1788271701.348228:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:1.0:1788271701.348239:0:10297:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788271701.348241:0:10297:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788271701.348876:0:10301:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:1.0:1788271701.349143:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:1.0:1788271701.349167:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:1.0:1788271701.349184:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:1.0:1788271701.349193:0:10297:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788271701.349195:0:10297:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788271701.351853:0:10302:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:1.0:1788271701.352535:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:1.0:1788271701.352573:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:1.0:1788271701.352589:0:10297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 10000000:01000000:1.0:1788271701.352609:0:10297:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788271701.352859:0:10297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f6eb4ed5e00/0x99288105fd38e72c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271701.352883:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6ec21de200/0x99288105fd38e5c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e5c0 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271701.352893:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e5f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e5ea expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271701.352921:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6eb4079200/0x99288105fd38e630 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e629 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271701.352928:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6e92d33e00/0x99288105fd38e63e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e637 expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271701.352936:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6eb4079a00/0x99288105fd38e64c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e645 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271701.352943:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6ec21de600/0x99288105fd38e668 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e661 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271701.352951:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6eb4e20c00/0x99288105fd38e692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e68b expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271701.352959:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6e92d33000/0x99288105fd38e6ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e6a7 expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271701.352966:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6eb4ed4e00/0x99288105fd38e6d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e6d1 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271701.353041:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6eb4ed5c00/0x99288105fd38e6e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd2a0 expref: 9 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271701.353049:0:10297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6eb4079e00/0x99288105fd38e6ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd2a7 expref: 9 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271701.353056:0:10297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f6eb4ed5e00/0x99288105fd38e72c lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271701.353121:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6eb4079e00/0x99288105fd38e6ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd2a7 expref: 9 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271701.353139:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f6eb4079e00/0x99288105fd38e6ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd2a7 expref: 9 pid: 6476 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271701.353157:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83275c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1875138590069760:192.168.201.3@tcp:104: 00010000:00010000:1.0:1788271701.353357:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6eb4ed5c00/0x99288105fd38e6e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd2a0 expref: 9 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271701.353377:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f6eb4ed5c00/0x99288105fd38e6e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd2a0 expref: 9 pid: 6476 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271701.353387:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83276a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1875138590069888:192.168.201.3@tcp:104: 00010000:00010000:1.0:1788271701.353541:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6eb4ed4e00/0x99288105fd38e6d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e6d1 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271701.353551:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f6eb4ed4e00/0x99288105fd38e6d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e6d1 expref: 23 pid: 6477 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271701.353562:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83276680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1875138590070016:0@lo:104: 00000100:00100000:1.0:1788271701.353653:0:10297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788271701.353694:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6e92d33000/0x99288105fd38e6ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e6a7 expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271701.353702:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f6e92d33000/0x99288105fd38e6ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e6a7 expref: 23 pid: 6476 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271701.353722:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83275f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1875138590070144:0@lo:104: 00000100:00100000:1.0:1788271701.353747:0:10297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788271701.353773:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6eb4e20c00/0x99288105fd38e692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e68b expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271701.353782:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f6eb4e20c00/0x99288105fd38e692 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e68b expref: 23 pid: 6477 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271701.353791:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83275500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1875138590070272:0@lo:104: 00000100:00100000:1.0:1788271701.353812:0:10297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788271701.353830:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6ec21de600/0x99288105fd38e668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e661 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271701.353838:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f6ec21de600/0x99288105fd38e668 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e661 expref: 23 pid: 6478 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271701.353847:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83277100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1875138590070400:0@lo:104: 00000100:00100000:1.0:1788271701.353872:0:10297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788271701.353889:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6eb4079a00/0x99288105fd38e64c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e645 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271701.353898:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f6eb4079a00/0x99288105fd38e64c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e645 expref: 23 pid: 6478 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271701.353906:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83275880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1875138590070528:0@lo:104: 00010000:00010000:1.0:1788271701.353932:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6e92d33e00/0x99288105fd38e63e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e637 expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271701.353951:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f6e92d33e00/0x99288105fd38e63e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e637 expref: 23 pid: 6476 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271701.353959:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfb84e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1875138590070656:0@lo:104: 00000100:00100000:0.0:1788271701.354112:0:6467:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788271701.354197:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590070016 00000100:00100000:3.0:1788271701.354207:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590070016 00000100:00100000:3.0:1788271701.354258:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590070144 00000100:00100000:3.0:1788271701.354261:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590070144 00000100:00100000:3.0:1788271701.354273:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590070272 00000100:00100000:3.0:1788271701.354275:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590070272 00000100:00100000:3.0:1788271701.354285:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590070400 00000100:00100000:3.0:1788271701.354287:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590070400 00000100:00100000:3.0:1788271701.354312:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788271701.354323:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83277480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+6:10297:x1875138590070016:12345-0@lo:104: 00010000:00010000:3.0:1788271701.354348:0:6466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e6d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e6d8 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271701.354766:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271701.354781:0:6467:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1788271701.354788:0:6467:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:3.0:1788271701.355124:0:6466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788271701.355132:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83277480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+6:10297:x1875138590070016:12345-0@lo:104: Request processed in 811us (1479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271701.355140:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788271701.355164:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590070528 00000100:00100000:3.0:1788271701.355168:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590070528 00000100:00100000:3.0:1788271701.355187:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788271701.355192:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83277b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+6:10297:x1875138590070144:12345-0@lo:104: 00010000:00010000:3.0:1788271701.355202:0:6466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33a00/0x99288105fd38e6a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e6ae expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.355239:0:6466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788271701.355244:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83277b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+6:10297:x1875138590070144:12345-0@lo:104: Request processed in 52us (1497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271701.355250:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788271701.355262:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788271701.355267:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83274380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+5:10297:x1875138590070272:12345-0@lo:104: 00010000:00010000:3.0:1788271701.355274:0:6466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33c00/0x99288105fd38e68b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e692 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.355474:0:6466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788271701.355480:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83274380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+5:10297:x1875138590070272:12345-0@lo:104: Request processed in 212us (1667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271701.355486:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788271701.355498:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788271701.355511:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebca77450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+4:10297:x1875138590070400:12345-0@lo:104: 00010000:00010000:3.0:1788271701.355519:0:6466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20200/0x99288105fd38e661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e668 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.355555:0:6466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788271701.355559:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebca77450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+4:10297:x1875138590070400:12345-0@lo:104: Request processed in 50us (1687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271701.355565:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788271701.355601:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788271701.355607:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfba9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+3:10297:x1875138590070528:12345-0@lo:104: 00010000:00010000:3.0:1788271701.355648:0:6466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20600/0x99288105fd38e645 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e64c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.355675:0:6466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788271701.355679:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfba9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+3:10297:x1875138590070528:12345-0@lo:104: Request processed in 73us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271701.355685:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:3.0:1788271701.355704:0:8413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788271701.355711:0:8413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e6d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e6d8 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.355718:0:8413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4ed4400 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:3.0:1788271701.355722:0:8413:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e6d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e6d8 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.355733:0:8413:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e6d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e6d8 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788271701.355742:0:8413:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e6d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e6d8 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271701.355756:0:8413:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788271701.355800:0:8413:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e6d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e6d8 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.355808:0:8413:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788271701.355831:0:8413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e6d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e6d8 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.355838:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e6d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e6d8 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.355855:0:8413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788271701.355858:0:8413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33a00/0x99288105fd38e6a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e6ae expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.355864:0:8413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e92d33a00 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:3.0:1788271701.355867:0:8413:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33a00/0x99288105fd38e6a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e6ae expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.355874:0:8413:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33a00/0x99288105fd38e6a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e6ae expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788271701.355880:0:8413:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33a00/0x99288105fd38e6a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e6ae expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271701.355885:0:8413:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788271701.355898:0:8413:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33a00/0x99288105fd38e6a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e6ae expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.355904:0:8413:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788271701.355926:0:8413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33a00/0x99288105fd38e6a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e6ae expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.355934:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33a00/0x99288105fd38e6a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e6ae expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.355944:0:8413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788271701.355947:0:8413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33c00/0x99288105fd38e68b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e692 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.355953:0:8413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e92d33c00 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:3.0:1788271701.355955:0:8413:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33c00/0x99288105fd38e68b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e692 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.355961:0:8413:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33c00/0x99288105fd38e68b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e692 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788271701.355967:0:8413:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33c00/0x99288105fd38e68b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e692 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271701.355985:0:8413:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788271701.355999:0:8413:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33c00/0x99288105fd38e68b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e692 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.356005:0:8413:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788271701.356010:0:8413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33c00/0x99288105fd38e68b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e692 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.356016:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6e92d33c00/0x99288105fd38e68b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e692 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.356025:0:8413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788271701.356034:0:8413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20200/0x99288105fd38e661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e668 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.356040:0:8413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e20200 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:3.0:1788271701.356043:0:8413:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20200/0x99288105fd38e661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e668 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.356049:0:8413:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20200/0x99288105fd38e661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e668 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788271701.356055:0:8413:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20200/0x99288105fd38e661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e668 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271701.356061:0:8413:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788271701.356075:0:8413:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20200/0x99288105fd38e661 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e668 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.356081:0:8413:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788271701.356086:0:8413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20200/0x99288105fd38e661 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e668 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.356093:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20200/0x99288105fd38e661 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e668 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.356102:0:8413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788271701.356106:0:8413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20600/0x99288105fd38e645 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e64c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.356112:0:8413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e20600 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:3.0:1788271701.356114:0:8413:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20600/0x99288105fd38e645 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e64c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.356131:0:8413:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20600/0x99288105fd38e645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e64c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788271701.356137:0:8413:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20600/0x99288105fd38e645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e64c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271701.356142:0:8413:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788271701.356156:0:8413:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20600/0x99288105fd38e645 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e64c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.356162:0:8413:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788271701.356167:0:8413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20600/0x99288105fd38e645 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e64c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.356173:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20600/0x99288105fd38e645 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e64c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.356182:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271701.356183:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271701.356185:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271701.356194:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271701.356200:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271701.356206:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271701.356231:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590070784:0@lo:103: 00000100:00100000:3.0:1788271701.356275:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271701.356326:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590071296:0@lo:103: 00000100:00100000:3.0:1788271701.356351:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271701.356385:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788271701.356391:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590071168:0@lo:103: 00000100:00100000:3.0:1788271701.356420:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271701.356451:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590070912:0@lo:103: 00000100:00100000:3.0:1788271701.356473:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271701.356493:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788271701.356497:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590071040:0@lo:103: 00000100:00100000:3.0:1788271701.356516:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271701.356549:0:9485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590070784 00000100:00100000:3.0:1788271701.356555:0:9485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590070784 00010000:00010000:3.0:1788271701.356583:0:9485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6eb4ed4e00/0x99288105fd38e6d8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e6d1 expref: 24 pid: 6477 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271701.356602:0:9485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590071296 00000100:00100000:3.0:1788271701.356605:0:9485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590071296 00010000:00010000:3.0:1788271701.356616:0:9485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6eb4079a00/0x99288105fd38e64c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e645 expref: 25 pid: 6478 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271701.356658:0:9485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590071168 00000100:00100000:3.0:1788271701.356660:0:9485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590071168 00010000:00010000:3.0:1788271701.356670:0:9485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6ec21de600/0x99288105fd38e668 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e661 expref: 26 pid: 6478 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271701.356678:0:9485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590070912 00000100:00100000:3.0:1788271701.356680:0:9485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590070912 00010000:00010000:3.0:1788271701.356690:0:9485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6e92d33000/0x99288105fd38e6ae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e6a7 expref: 27 pid: 6476 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271701.356699:0:9485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590071040 00000100:00100000:3.0:1788271701.356701:0:9485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590071040 00010000:00010000:3.0:1788271701.356709:0:9485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6eb4e20c00/0x99288105fd38e692 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e68b expref: 28 pid: 6477 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271701.356734:0:9485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788271701.356742:0:9485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4eab87b-0440-4f90-8c88-4ffaef16406f+28:3607:x1875138590070784:12345-0@lo:103: 00010000:00010000:3.0:1788271701.356754:0:9485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271701.356760:0:9485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6eb4ed4e00/0x99288105fd38e6d8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e6d1 expref: 28 pid: 6477 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.356769:0:9485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6eb4ed4e00/0x99288105fd38e6d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e6d1 expref: 28 pid: 6477 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.356790:0:9485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271701.356821:0:9485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4eab87b-0440-4f90-8c88-4ffaef16406f+28:3607:x1875138590070784:12345-0@lo:103: Request processed in 80us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271701.356828:0:9485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788271701.356869:0:9485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788271701.356875:0:9485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4eab87b-0440-4f90-8c88-4ffaef16406f+27:3607:x1875138590071296:12345-0@lo:103: 00010000:00010000:3.0:1788271701.356881:0:9485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271701.356886:0:9485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6eb4079a00/0x99288105fd38e64c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e645 expref: 27 pid: 6478 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.356895:0:9485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6eb4079a00/0x99288105fd38e64c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e645 expref: 27 pid: 6478 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.356906:0:9485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271701.356928:0:9485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4eab87b-0440-4f90-8c88-4ffaef16406f+27:3607:x1875138590071296:12345-0@lo:103: Request processed in 53us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271701.356934:0:9485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788271701.356947:0:9485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788271701.356960:0:9485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4eab87b-0440-4f90-8c88-4ffaef16406f+26:3607:x1875138590071168:12345-0@lo:103: 00010000:00010000:3.0:1788271701.356967:0:9485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271701.356971:0:9485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6ec21de600/0x99288105fd38e668 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e661 expref: 26 pid: 6478 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.356979:0:9485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6ec21de600/0x99288105fd38e668 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e661 expref: 26 pid: 6478 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.356988:0:9485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271701.357009:0:9485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4eab87b-0440-4f90-8c88-4ffaef16406f+26:3607:x1875138590071168:12345-0@lo:103: Request processed in 51us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271701.357014:0:9485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788271701.357025:0:9485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788271701.357030:0:9485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4eab87b-0440-4f90-8c88-4ffaef16406f+25:3608:x1875138590070912:12345-0@lo:103: 00010000:00010000:3.0:1788271701.357037:0:9485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271701.357041:0:9485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6e92d33000/0x99288105fd38e6ae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e6a7 expref: 25 pid: 6476 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.357049:0:9485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6e92d33000/0x99288105fd38e6ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e6a7 expref: 25 pid: 6476 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.357058:0:9485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271701.357083:0:9485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4eab87b-0440-4f90-8c88-4ffaef16406f+25:3608:x1875138590070912:12345-0@lo:103: Request processed in 52us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271701.357089:0:9485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788271701.357101:0:9485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788271701.357107:0:9485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8233a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3608:x1875138590071040:12345-0@lo:103: 00010000:00010000:3.0:1788271701.357114:0:9485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271701.357124:0:9485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6eb4e20c00/0x99288105fd38e692 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e68b expref: 24 pid: 6477 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.357132:0:9485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6eb4e20c00/0x99288105fd38e692 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e68b expref: 24 pid: 6477 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.357140:0:9485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271701.357160:0:9485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8233a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3608:x1875138590071040:12345-0@lo:103: Request processed in 54us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271701.357166:0:9485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788271701.357220:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590071040:0@lo:103: 00000100:00100000:3.0:1788271701.357228:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590070912:0@lo:103: 00000100:00100000:3.0:1788271701.357257:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590071168:0@lo:103: 00000100:00100000:3.0:1788271701.357265:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590070784:0@lo:103: 00000100:00100000:3.0:1788271701.357271:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590071296:0@lo:103: 00000100:00100000:1.0:1788271701.357927:0:10297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788271701.358588:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6eb4079200/0x99288105fd38e630 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e629 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271701.358607:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f6eb4079200/0x99288105fd38e630 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e629 expref: 23 pid: 6477 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271701.358695:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83251180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1875138590071424:0@lo:104: 00000100:00100000:1.0:1788271701.358742:0:10297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271701.358966:0:10303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590070656 00000100:00100000:3.0:1788271701.358987:0:10303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590070656 00000100:00100000:3.0:1788271701.359040:0:10303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788271701.359051:0:10303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f4eab87b-0440-4f90-8c88-4ffaef16406f+3:10297:x1875138590070656:12345-0@lo:104: 00010000:00010000:3.0:1788271701.359064:0:10303:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079c00/0x99288105fd38e637 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e63e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.359121:0:10303:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788271701.359126:0:10303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f4eab87b-0440-4f90-8c88-4ffaef16406f+3:10297:x1875138590070656:12345-0@lo:104: Request processed in 78us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271701.359134:0:10303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1788271701.359165:0:8413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788271701.359172:0:8413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079c00/0x99288105fd38e637 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e63e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.359182:0:8413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4079c00 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:3.0:1788271701.359187:0:8413:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079c00/0x99288105fd38e637 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e63e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.359196:0:8413:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079c00/0x99288105fd38e637 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e63e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788271701.359204:0:8413:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079c00/0x99288105fd38e637 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e63e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271701.359211:0:8413:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788271701.359245:0:8413:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079c00/0x99288105fd38e637 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e63e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.359252:0:8413:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788271701.359271:0:8413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079c00/0x99288105fd38e637 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e63e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.359278:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079c00/0x99288105fd38e637 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e63e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271701.359291:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271701.359293:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271701.359295:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271701.359544:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788271701.359560:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590071552:0@lo:103: 00000100:00100000:3.0:1788271701.359595:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271701.359773:0:9485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590071552 00000100:00100000:2.0:1788271701.359779:0:9485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590071552 00010000:00010000:2.0:1788271701.359804:0:9485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6e92d33e00/0x99288105fd38e63e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e637 expref: 24 pid: 6476 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271701.359837:0:9485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788271701.359844:0:9485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3609:x1875138590071552:12345-0@lo:103: 00010000:00010000:2.0:1788271701.359856:0:9485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271701.359861:0:9485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6e92d33e00/0x99288105fd38e63e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e637 expref: 24 pid: 6476 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271701.359871:0:9485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6e92d33e00/0x99288105fd38e63e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e637 expref: 24 pid: 6476 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271701.359902:0:9485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271701.359937:0:9485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3609:x1875138590071552:12345-0@lo:103: Request processed in 94us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271701.359944:0:9485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788271701.359993:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590071552:0@lo:103: 00010000:00010000:1.0:1788271701.360222:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e5f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e5ea expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271701.360234:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e5f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e5ea expref: 23 pid: 6477 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271701.360243:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83252a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1875138590071680:0@lo:104: 00000100:00100000:1.0:1788271701.360270:0:10297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788271701.361572:0:10297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6ec21de200/0x99288105fd38e5c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e5c0 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271701.361586:0:10297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f6ec21de200/0x99288105fd38e5c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e5c0 expref: 23 pid: 6477 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271701.361599:0:10297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1875138590071808:0@lo:104: 00000100:00100000:1.0:1788271701.361659:0:10297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271701.361733:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590071424 00000100:00100000:0.0:1788271701.361742:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590071424 00000100:00100000:0.0:1788271701.361786:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590071680 00000100:00100000:0.0:1788271701.361789:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590071680 00000100:00100000:0.0:1788271701.361804:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788271701.361813:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83251c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+4:10297:x1875138590071424:12345-0@lo:104: 00010000:00010000:0.0:1788271701.361826:0:6466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079400/0x99288105fd38e629 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e630 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271701.361880:0:6466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788271701.361887:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83251c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+4:10297:x1875138590071424:12345-0@lo:104: Request processed in 75us (3145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271701.361895:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788271701.361916:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788271701.361922:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83252680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+3:10297:x1875138590071680:12345-0@lo:104: 00010000:00010000:0.0:1788271701.361931:0:6466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20400/0x99288105fd38e5ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e5f1 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271701.361964:0:6466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788271701.361987:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83252680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+3:10297:x1875138590071680:12345-0@lo:104: Request processed in 66us (1716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271701.361993:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:0.0:1788271701.362013:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788271701.362019:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079400/0x99288105fd38e629 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e630 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271701.362026:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4079400 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:0.0:1788271701.362031:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079400/0x99288105fd38e629 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e630 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271701.362040:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079400/0x99288105fd38e629 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e630 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788271701.362048:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079400/0x99288105fd38e629 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e630 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271701.362054:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788271701.362091:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079400/0x99288105fd38e629 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e630 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271701.362098:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788271701.362119:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079400/0x99288105fd38e629 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e630 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271701.362126:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079400/0x99288105fd38e629 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e630 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271701.362139:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271701.362142:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20400/0x99288105fd38e5ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e5f1 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271701.362170:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e20400 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:0.0:1788271701.362173:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20400/0x99288105fd38e5ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e5f1 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271701.362179:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20400/0x99288105fd38e5ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e5f1 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788271701.362184:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20400/0x99288105fd38e5ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e5f1 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271701.362189:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788271701.362202:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20400/0x99288105fd38e5ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e5f1 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271701.362208:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788271701.362224:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20400/0x99288105fd38e5ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e5f1 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271701.362231:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20400/0x99288105fd38e5ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e5f1 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271701.362242:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271701.362244:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271701.362246:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271701.362253:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271701.362262:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788271701.362275:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfba8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590071936:0@lo:103: 00000100:00100000:0.0:1788271701.362593:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271701.362658:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590072064:0@lo:103: 00000100:00100000:0.0:1788271701.362692:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271701.362727:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590071936 00000100:00100000:0.0:1788271701.362732:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590071936 00010000:00010000:0.0:1788271701.362755:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6eb4079200/0x99288105fd38e630 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e629 expref: 24 pid: 6477 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271701.362781:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590072064 00000100:00100000:0.0:1788271701.362785:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590072064 00010000:00010000:0.0:1788271701.362796:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e5f1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e5ea expref: 25 pid: 6477 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271701.362816:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788271701.362823:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfbabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+25:3608:x1875138590071936:12345-0@lo:103: 00010000:00010000:0.0:1788271701.362835:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271701.362841:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6eb4079200/0x99288105fd38e630 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e629 expref: 25 pid: 6477 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271701.362851:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6eb4079200/0x99288105fd38e630 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e629 expref: 25 pid: 6477 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271701.362870:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271701.362898:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfbabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+25:3608:x1875138590071936:12345-0@lo:103: Request processed in 75us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271701.362904:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788271701.362919:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788271701.362925:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3606:x1875138590072064:12345-0@lo:103: 00010000:00010000:0.0:1788271701.362933:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271701.362938:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e5f1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e5ea expref: 24 pid: 6477 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271701.362958:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e5f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e5ea expref: 24 pid: 6477 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271701.362968:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271701.363007:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3606:x1875138590072064:12345-0@lo:103: Request processed in 81us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271701.363013:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788271701.363090:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590072064:0@lo:103: 00000100:00100000:0.0:1788271701.363115:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfba8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590071936:0@lo:103: 00000100:00100000:1.0:1788271701.363578:0:10297:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830d8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271701.363599:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83275c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1875138590069760:192.168.201.3@tcp:104: 00010000:00010000:1.0:1788271701.363612:0:10297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4ed4e00/0x99288105fd38e6d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e6d1 expref: 23 pid: 6477 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271701.363651:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83276680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1875138590070016:0@lo:104: 00010000:00010000:1.0:1788271701.363665:0:10297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6e92d33000/0x99288105fd38e6ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e6a7 expref: 22 pid: 6476 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271701.363675:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83275f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1875138590070144:0@lo:104: 00010000:00010000:1.0:1788271701.363687:0:10297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4e20c00/0x99288105fd38e692 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e68b expref: 21 pid: 6477 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271701.363696:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83275500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1875138590070272:0@lo:104: 00010000:00010000:1.0:1788271701.363707:0:10297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6ec21de600/0x99288105fd38e668 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e661 expref: 20 pid: 6478 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271701.363715:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83277100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1875138590070400:0@lo:104: 00010000:00010000:1.0:1788271701.363724:0:10297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4079a00/0x99288105fd38e64c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e645 expref: 19 pid: 6478 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271701.363733:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83275880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1875138590070528:0@lo:104: 00010000:00010000:1.0:1788271701.363744:0:10297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6e92d33e00/0x99288105fd38e63e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e637 expref: 18 pid: 6476 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271701.363752:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfb84e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1875138590070656:0@lo:104: 00010000:00010000:1.0:1788271701.363761:0:10297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4079200/0x99288105fd38e630 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e629 expref: 17 pid: 6477 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271701.363782:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83251180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1875138590071424:0@lo:104: 00010000:00010000:1.0:1788271701.363794:0:10297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6e92d32c00/0x99288105fd38e5f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e5ea expref: 16 pid: 6477 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271701.363803:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83252a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1875138590071680:0@lo:104: 00000100:00100000:0.0:1788271701.363950:0:6466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590071808 00000100:00100000:0.0:1788271701.363956:0:6466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590071808 00000100:00100000:0.0:1788271701.364200:0:6466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788271701.364211:0:6466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83251f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+3:10297:x1875138590071808:12345-0@lo:104: 00010000:00010000:0.0:1788271701.364227:0:6466:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078400/0x99288105fd38e5c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e5c7 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271701.364502:0:6466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788271701.364509:0:6466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83251f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+3:10297:x1875138590071808:12345-0@lo:104: Request processed in 301us (2849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271701.364517:0:6466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1788271701.364565:0:8412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271701.364573:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078400/0x99288105fd38e5c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e5c7 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271701.364581:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4078400 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:2.0:1788271701.364586:0:8412:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078400/0x99288105fd38e5c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e5c7 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271701.364596:0:8412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078400/0x99288105fd38e5c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e5c7 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788271701.364604:0:8412:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078400/0x99288105fd38e5c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e5c7 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271701.364610:0:8412:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788271701.364674:0:8412:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078400/0x99288105fd38e5c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e5c7 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271701.364681:0:8412:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788271701.364696:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078400/0x99288105fd38e5c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e5c7 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271701.364703:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078400/0x99288105fd38e5c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e5c7 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271701.364735:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271701.364738:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271701.364739:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271701.364804:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590072192:0@lo:103: 00000100:00100000:0.0:1788271701.364843:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271701.364916:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590072192 00000100:00100000:2.0:1788271701.364922:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590072192 00010000:00010000:2.0:1788271701.364944:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6ec21de200/0x99288105fd38e5c7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e5c0 expref: 16 pid: 6477 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271701.364970:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788271701.364983:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfba8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:3607:x1875138590072192:12345-0@lo:103: 00010000:00010000:2.0:1788271701.364993:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271701.364998:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6ec21de200/0x99288105fd38e5c7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e5c0 expref: 16 pid: 6477 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271701.365007:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6ec21de200/0x99288105fd38e5c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e5c0 expref: 16 pid: 6477 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271701.365021:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271701.365051:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfba8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:3607:x1875138590072192:12345-0@lo:103: Request processed in 68us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271701.365058:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788271701.365169:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590072192:0@lo:103: 00000100:00100000:0.0:1788271701.365594:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271701.365644:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577437312 00000100:00100000:0.0:1788271701.365658:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577437312 00010000:00010000:0.0:1788271701.365679:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6eb4ed5c00/0x99288105fd38e6e6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd2a0 expref: 10 pid: 6476 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271701.365704:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 33 00000100:00100000:0.0:1788271701.365711:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfba9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:2398:x1875138577437312:12345-192.168.201.3@tcp:103: 00010000:00010000:0.0:1788271701.365722:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271701.365727:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6eb4ed5c00/0x99288105fd38e6e6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd2a0 expref: 10 pid: 6476 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271701.365737:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6eb4ed5c00/0x99288105fd38e6e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd2a0 expref: 10 pid: 6476 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271701.365750:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271701.365803:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfba9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:2398:x1875138577437312:12345-192.168.201.3@tcp:103: Request processed in 92us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271701.365810:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 33 00000100:00100000:0.0:1788271701.366590:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271701.366870:0:9485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577437440 00000100:00100000:2.0:1788271701.366877:0:9485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577437440 00010000:00010000:2.0:1788271701.366907:0:9485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6eb4079e00/0x99288105fd38e6ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd2a7 expref: 10 pid: 6476 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271701.366947:0:9485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 34 00000100:00100000:2.0:1788271701.366956:0:9485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfbabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:2397:x1875138577437440:12345-192.168.201.3@tcp:103: 00010000:00010000:2.0:1788271701.366993:0:9485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271701.367000:0:9485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6eb4079e00/0x99288105fd38e6ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd2a7 expref: 10 pid: 6476 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271701.367012:0:9485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6eb4079e00/0x99288105fd38e6ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd2a7 expref: 10 pid: 6476 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271701.367026:0:9485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4079e00/0x99288105fd38e6ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd2a7 expref: 10 pid: 6476 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271701.367043:0:9485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f6eb4ed5e00/0x99288105fd38e72c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271701.367052:0:9485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4ed5e00/0x99288105fd38e72c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271701.367068:0:9485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f6eb4ed5e00/0x99288105fd38e72c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271701.367075:0:9485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f6eb4ed5e00/0x99288105fd38e72c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271701.367081:0:9485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f6eb4ed5e00/0x99288105fd38e72c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271701.367088:0:9485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f6eb4ed5e00/0x99288105fd38e72c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271701.367094:0:9485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4ed5e00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:2.0:1788271701.367099:0:9485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f6eb4ed5e00/0x99288105fd38e72c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271701.367118:0:9485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f6eb4ed5e00/0x99288105fd38e72c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271701.367128:0:9485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f6eb4ed5e00/0x99288105fd38e72c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271701.367140:0:9485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271701.367179:0:9485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfbabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a94beb9-7f16-4b5a-842a-fac2e5234617+9:2397:x1875138577437440:12345-192.168.201.3@tcp:103: Request processed in 223us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271701.367186:0:9485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 34 00010000:00010000:1.0:1788271701.368155:0:10297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6ec21de200/0x99288105fd38e5c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e5c0 expref: 15 pid: 6477 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271701.368176:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1875138590071808:0@lo:104: 00010000:00010000:1.0:1788271701.368224:0:10297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4ed5c00/0x99288105fd38e6e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd2a0 expref: 8 pid: 6476 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271701.368234:0:10297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83276a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10297:1875138590069888:192.168.201.3@tcp:104: 00010000:00010000:1.0:1788271701.368386:0:10297:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f6eb4ed5e00/0x99288105fd38e72c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271701.368464:0:10297:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f6eb4ed5e00/0x99288105fd38e72c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271701.368472:0:10297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f6eb4ed5e00/0x99288105fd38e72c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271701.368480:0:10297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4ed5e00/0x99288105fd38e72c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271701.407820:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271701.538948:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfba9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590072320:0@lo:41: 00000100:00100000:0.0:1788271701.539018:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271701.539098:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590072320 00000100:00100000:0.0:1788271701.539106:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590072320 00000100:00100000:0.0:1788271701.539150:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788271701.539159:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfbaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590072320:12345-0@lo:41: 00000004:00000024:0.0:1788271701.539194:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788271701.539239:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfbaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590072320:12345-0@lo:41: Request processed in 81us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271701.539247:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788271701.539298:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfba9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590072320:0@lo:41: 00000100:00100000:2.0:1788271702.046537:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788271702.046611:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590072448:0@lo:13: 00000100:00100000:2.0:1788271702.046706:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271702.047173:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788271702.047186:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfba9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590072576:0@lo:13: 00000100:00100000:0.0:1788271702.047226:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271702.047384:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590072448 00000100:00100000:3.0:1788271702.047393:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590072448 00000100:00100000:3.0:1788271702.047444:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590072576 00000100:00100000:3.0:1788271702.047447:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590072576 00000100:00100000:3.0:1788271702.047464:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788271702.047473:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4fb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590072448:12345-0@lo:13: 00002000:00000024:3.0:1788271702.047501:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271702.047547:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4fb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590072448:12345-0@lo:13: Request processed in 74us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271702.047554:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788271702.047570:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788271702.047577:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfba8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590072576:12345-0@lo:13: 00002000:00000024:3.0:1788271702.047587:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271702.047614:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfba8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590072576:12345-0@lo:13: Request processed in 37us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271702.047638:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788271702.047672:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4f38a80 x1875138590072448/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271718 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271702.047690:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590072448:0@lo:13: 00000100:00100000:1.0:1788271702.047991:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875138590073088:0@lo:400: 00000100:00100000:1.0:1788271702.048026:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271702.048069:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590073600:0@lo:400: 00000100:00100000:1.0:1788271702.048093:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271702.048112:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788271702.048118:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590072704:0@lo:400: 00000100:00100000:1.0:1788271702.048142:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271702.048162:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590073216:0@lo:400: 00000100:00100000:1.0:1788271702.048182:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271702.048210:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590073728:0@lo:400: 00000100:00100000:1.0:1788271702.048228:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271702.048253:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590073600 00000100:00100000:1.0:1788271702.048257:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590073600 00000100:00100000:1.0:1788271702.048283:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590073728 00000100:00100000:1.0:1788271702.048286:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590073728 00000100:00100000:1.0:1788271702.048303:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788271702.048310:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590073600:12345-0@lo:400: 00000100:00100000:1.0:1788271702.048345:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590073600:12345-0@lo:400: Request processed in 36us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271702.048362:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788271702.048376:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788271702.048382:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590073728:12345-0@lo:400: 00000100:00100000:1.0:1788271702.048406:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590073728:12345-0@lo:400: Request processed in 25us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271702.048411:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788271702.048427:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590072704 00000100:00100000:1.0:1788271702.048429:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590072704 00000100:00100000:1.0:1788271702.048451:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788271702.048457:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:3606:x1875138590072704:12345-0@lo:400: 00000100:00100000:1.0:1788271702.048493:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:3606:x1875138590072704:12345-0@lo:400: Request processed in 36us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271702.048499:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788271702.048527:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590073216 00000100:00100000:1.0:1788271702.048531:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590073216 00000100:00100000:1.0:1788271702.048555:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788271702.048562:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590073216:12345-0@lo:400: 00000100:00100000:1.0:1788271702.048592:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590073216:12345-0@lo:400: Request processed in 31us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271702.048598:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788271702.048650:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590072960:0@lo:400: 00000100:00100000:1.0:1788271702.048675:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271702.048691:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3609:1875138590073472:0@lo:400: 00000100:00100000:1.0:1788271702.048708:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271702.048722:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3609:1875138590073984:0@lo:400: 00000100:00100000:1.0:1788271702.048741:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271702.048759:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788271702.048764:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875138590072832:0@lo:400: 00000100:00100000:1.0:1788271702.048785:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788271702.048953:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788271702.048958:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788271702.048985:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6ebfba9f80 x1875138590072576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271718 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271702.049002:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfba9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590072576:0@lo:13: 00000100:00100000:0.0:1788271702.049037:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590072960 00000100:00100000:0.0:1788271702.049041:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590072960 00000100:00100000:0.0:1788271702.049068:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788271702.049074:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590072960:12345-0@lo:400: 00000100:00100000:0.0:1788271702.049106:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590072960:12345-0@lo:400: Request processed in 32us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271702.049112:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788271702.049136:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590072704:0@lo:400: 00000100:00100000:0.0:1788271702.049145:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590073216:0@lo:400: 00010000:00080000:0.0:1788271702.049155:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4fb4a80 x1875138590073728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271702.049164:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590073728:0@lo:400: 00010000:00080000:0.0:1788271702.049173:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4fb4700 x1875138590073600/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271702.049180:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590073600:0@lo:400: 00000100:00100000:0.0:1788271702.049226:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590073088 00000100:00100000:0.0:1788271702.049236:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590073088 00000100:00100000:0.0:1788271702.049256:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590073472 00000100:00100000:0.0:1788271702.049259:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590073472 00000100:00100000:0.0:1788271702.049280:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590073984 00000100:00100000:0.0:1788271702.049283:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590073984 00000100:00100000:0.0:1788271702.049293:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590072832 00000100:00100000:0.0:1788271702.049296:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590072832 00000100:00100000:0.0:1788271702.049308:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788271702.049314:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1875138590073088:12345-0@lo:400: 00000100:00100000:0.0:1788271702.049365:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1875138590073088:12345-0@lo:400: Request processed in 36us (1324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271702.049371:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788271702.049384:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788271702.049390:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875138590073472:12345-0@lo:400: 00000100:00100000:0.0:1788271702.049412:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875138590073472:12345-0@lo:400: Request processed in 24us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271702.049418:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788271702.049430:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788271702.049435:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875138590073984:12345-0@lo:400: 00000100:00100000:0.0:1788271702.049474:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875138590073984:12345-0@lo:400: Request processed in 38us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271702.049480:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788271702.049492:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788271702.049499:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875138590072832:12345-0@lo:400: 00000100:00100000:0.0:1788271702.049523:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875138590072832:12345-0@lo:400: Request processed in 25us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271702.049528:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1788271702.049540:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788271702.049562:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875138590073088:0@lo:400: 00000100:00100000:1.0:1788271702.050156:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875138590072832:0@lo:400: 00000100:00100000:1.0:1788271702.050164:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3609:1875138590073344:0@lo:400: 00000100:00100000:1.0:1788271702.050247:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271702.050272:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3609:1875138590073856:0@lo:400: 00000100:00100000:1.0:1788271702.050295:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271702.050407:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590072960:0@lo:400: 00010000:00080000:1.0:1788271702.050428:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4fb5880 x1875138590073472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271702.050438:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3609:1875138590073472:0@lo:400: 00010000:00080000:1.0:1788271702.050446:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4fb4000 x1875138590073984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271702.050453:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3609:1875138590073984:0@lo:400: 00000100:00100000:3.0:1788271702.053669:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590073344 00000100:00100000:3.0:1788271702.053686:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590073344 00000100:00100000:3.0:1788271702.053934:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590073856 00000100:00100000:3.0:1788271702.053939:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590073856 00000100:00100000:2.0:1788271702.054001:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788271702.054015:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875138590073344:12345-0@lo:400: 00000100:00100000:2.0:1788271702.054118:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875138590073344:12345-0@lo:400: Request processed in 107us (3870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271702.054126:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788271702.054203:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3609:1875138590073344:0@lo:400: 00000100:00080000:1.0:1788271702.055547:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788271702.055739:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788271702.055751:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875138590073856:12345-0@lo:400: 00000100:00100000:3.0:1788271702.055850:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875138590073856:12345-0@lo:400: Request processed in 102us (5552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271702.055857:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788271702.056128:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3609:1875138590073856:0@lo:400: 00010000:00010000:0.0:1788271702.429783:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271702.432568:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271702.432653:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271702.432845:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577437568 00000100:00100000:1.0:1788271702.432856:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577437568 00000100:00100000:0.0:1788271702.432949:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271702.432989:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271702.433011:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271702.433059:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577437696 00000100:00100000:1.0:1788271702.433061:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577437696 00000100:00100000:1.0:1788271702.433072:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 200 00000100:00100000:1.0:1788271702.433079:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+9:6170:x1875138577437568:12345-192.168.201.3@tcp:101: 00010000:00010000:1.0:1788271702.433092:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271702.433106:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4ed4e00/0x99288105fd38e733 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd317 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271702.433128:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4ed4e00/0x99288105fd38e733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd317 expref: 10 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271702.433136:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4ed4e00/0x99288105fd38e733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd317 expref: 10 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271702.433143:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4ed4e00, rc 0) 00000100:00100000:1.0:1788271702.433184:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:6170:x1875138577437568:12345-192.168.201.3@tcp:101: Request processed in 106us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271702.433189:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 200 00000100:00100000:1.0:1788271702.433224:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 201 00000100:00100000:1.0:1788271702.433228:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+9:2395:x1875138577437696:12345-192.168.201.3@tcp:400: 00000100:00100000:1.0:1788271702.433245:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+9:2395:x1875138577437696:12345-192.168.201.3@tcp:400: Request processed in 17us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271702.433249:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 201 00000100:00100000:2.0:1788271702.434032:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577437824 00000100:00100000:2.0:1788271702.434039:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577437824 00000100:00100000:2.0:1788271702.434080:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577437952 00000100:00100000:2.0:1788271702.434082:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577437952 00000100:00100000:2.0:1788271702.434101:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 63 00000100:00100000:2.0:1788271702.434107:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2395:x1875138577437824:12345-192.168.201.3@tcp:400: 00000100:00100000:2.0:1788271702.434140:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2395:x1875138577437824:12345-192.168.201.3@tcp:400: Request processed in 34us (1489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271702.434154:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 63 00000100:00100000:2.0:1788271702.434167:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 64 00000100:00100000:2.0:1788271702.434172:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfbab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577437952:12345-192.168.201.3@tcp:400: 00000100:00100000:2.0:1788271702.434193:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfbab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577437952:12345-192.168.201.3@tcp:400: Request processed in 21us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271702.434199:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 64 00000100:00080000:2.0:1788271702.434233:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788271702.434236:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271702.436151:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577438080 00000100:00100000:1.0:1788271702.436162:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577438080 00000100:00100000:1.0:1788271702.436218:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 20 00000100:00100000:1.0:1788271702.436226:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfba9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577438080:12345-192.168.201.3@tcp:400: 00000100:00100000:1.0:1788271702.436277:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfba9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577438080:12345-192.168.201.3@tcp:400: Request processed in 52us (3329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271702.436284:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 20 00000100:00080000:2.0:1788271702.436637:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788271702.436761:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271702.436840:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577438208 00000100:00100000:1.0:1788271702.436844:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577438208 00000100:00100000:1.0:1788271702.436875:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 21 00000100:00100000:1.0:1788271702.436892:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfbaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577438208:12345-192.168.201.3@tcp:400: 00000100:00100000:1.0:1788271702.436920:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfbaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577438208:12345-192.168.201.3@tcp:400: Request processed in 39us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271702.436927:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 21 00000100:00080000:2.0:1788271702.437207:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788271702.439153:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271702.439245:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577438336 00000100:00100000:1.0:1788271702.439254:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577438336 00000100:00100000:1.0:1788271702.439362:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 202 00000100:00100000:1.0:1788271702.439372:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+9:6170:x1875138577438336:12345-192.168.201.3@tcp:501: 00000100:00100000:1.0:1788271702.440378:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+9:6170:x1875138577438336:12345-192.168.201.3@tcp:501: Request processed in 1002us (1226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271702.440388:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 202 00000100:00100000:0.0:1788271702.443369:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271702.443609:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577438464 00000100:00100000:1.0:1788271702.443642:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577438464 00000100:00100000:1.0:1788271702.443744:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 203 00000100:00100000:1.0:1788271702.443754:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+9:6170:x1875138577438464:12345-192.168.201.3@tcp:503: 00000100:00100000:1.0:1788271702.443997:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+9:6170:x1875138577438464:12345-192.168.201.3@tcp:503: Request processed in 244us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271702.444005:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 203 00000100:00100000:0.0:1788271702.446403:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271702.446941:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577438592 00000100:00100000:1.0:1788271702.446951:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577438592 00000100:00100000:1.0:1788271702.447012:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 204 00000100:00100000:1.0:1788271702.447022:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+9:6646:x1875138577438592:12345-192.168.201.3@tcp:502: 00000100:00100000:1.0:1788271702.447169:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+9:6646:x1875138577438592:12345-192.168.201.3@tcp:502: Request processed in 148us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271702.447178:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 204 00000100:00100000:3.0:1788271702.449583:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271702.449989:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577438720 00000100:00100000:1.0:1788271702.449998:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577438720 00000100:00100000:1.0:1788271702.450045:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 205 00000100:00100000:1.0:1788271702.450052:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+9:6646:x1875138577438720:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788271702.450171:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+9:6646:x1875138577438720:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 118us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271702.450183:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 205 00000100:00100000:0.0:1788271702.454110:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271702.454176:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577438848 00000100:00100000:2.0:1788271702.454186:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577438848 00000100:00100000:2.0:1788271702.454423:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 206 00000100:00100000:2.0:1788271702.454436:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+9:6170:x1875138577438848:12345-192.168.201.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788271702.454456:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271702.454474:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4e20600/0x99288105fd38e73a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd31e expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271702.454502:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4e20600/0x99288105fd38e73a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd31e expref: 10 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271702.454513:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4e20600/0x99288105fd38e73a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd31e expref: 10 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271702.454598:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e20600, rc 0) 00000100:00100000:2.0:1788271702.454686:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:6170:x1875138577438848:12345-192.168.201.3@tcp:101:ll_cfg_requeue.0 Request processed in 252us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271702.454709:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 206 00000100:00100000:2.0:1788271702.459986:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271702.460408:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577438976 00000100:00100000:0.0:1788271702.460418:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577438976 00000100:00100000:0.0:1788271702.460477:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 207 00000100:00100000:0.0:1788271702.460488:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:6170:x1875138577438976:12345-192.168.201.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271702.460637:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:6170:x1875138577438976:12345-192.168.201.3@tcp:501:ll_cfg_requeue.0 Request processed in 132us (642us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788271702.460647:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 207 10000000:01000000:0.0:1788271702.493783:0:6480:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788271702.493790:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f6d820cc800 from 48 10000000:01000000:0.0:1788271702.493807:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788271702.493868:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078000/0x99288105fd38e741 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271702.493880:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078000/0x99288105fd38e741 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271702.493910:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078000/0x99288105fd38e741 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271702.493934:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfbab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590074112:0@lo:101: 00000100:00100000:0.0:1788271702.494008:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271702.494095:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830e69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271702.494408:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590074112 00000100:00100000:2.0:1788271702.494418:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590074112 00000100:00100000:2.0:1788271702.494475:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788271702.494485:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+15:6480:x1875138590074112:12345-0@lo:101: 00010000:00010000:2.0:1788271702.494498:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271702.494511:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4e20400/0x99288105fd38e748 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e741 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271702.494548:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4e20400/0x99288105fd38e748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e741 expref: 16 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271702.494560:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4e20400/0x99288105fd38e748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e741 expref: 16 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271702.494569:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e20400, rc 0) 00000100:00100000:2.0:1788271702.494664:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:6480:x1875138590074112:12345-0@lo:101: Request processed in 181us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271702.494671:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788271702.494870:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfbab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590074112:0@lo:101: 00010000:00010000:1.0:1788271702.494887:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078000/0x99288105fd38e741 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e748 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271702.494896:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078000/0x99288105fd38e741 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e748 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271702.494968:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83252300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590074240:0@lo:501: 00000100:00100000:1.0:1788271702.494996:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271702.495028:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830d8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788271702.495085:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590074240 00000100:00100000:3.0:1788271702.495091:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590074240 00000100:00100000:3.0:1788271702.495123:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788271702.495131:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:6480:x1875138590074240:12345-0@lo:501: 00000100:00100000:3.0:1788271702.495252:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:6480:x1875138590074240:12345-0@lo:501: Request processed in 122us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271702.495259:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788271702.495435:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83252300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590074240:0@lo:501: 00000100:00100000:1.0:1788271702.495462:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83252300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590074368:0@lo:503: 00000100:00100000:1.0:1788271702.495500:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271702.495523:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830d8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788271702.495574:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590074368 00000100:00100000:3.0:1788271702.495578:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590074368 00000100:00100000:3.0:1788271702.495606:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788271702.495612:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:6480:x1875138590074368:12345-0@lo:503: 00000100:00100000:3.0:1788271702.495705:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:6480:x1875138590074368:12345-0@lo:503: Request processed in 92us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271702.495712:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788271702.495890:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83252300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590074368:0@lo:503: 00000100:00100000:1.0:1788271702.496541:0:10315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83252300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10315:1875138590074496:0@lo:502: 00000100:00100000:1.0:1788271702.496577:0:10315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271702.496637:0:10315:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830d8300 going to sleep for 11 seconds 00000100:00100000:3.0:1788271702.496736:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590074496 00000100:00100000:3.0:1788271702.496742:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590074496 00000100:00100000:3.0:1788271702.496763:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788271702.496770:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:10315:x1875138590074496:12345-0@lo:502: 00000100:00100000:3.0:1788271702.496891:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:10315:x1875138590074496:12345-0@lo:502: Request processed in 120us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271702.496899:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788271702.497127:0:10315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83252300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10315:1875138590074496:0@lo:502: 00000100:00100000:1.0:1788271702.497165:0:10315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83252300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10315:1875138590074624:0@lo:502: 00000100:00100000:1.0:1788271702.497199:0:10315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271702.497228:0:10315:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830d8300 going to sleep for 11 seconds 00000100:00100000:3.0:1788271702.497690:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590074624 00000100:00100000:3.0:1788271702.497697:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590074624 00000100:00100000:3.0:1788271702.497732:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788271702.497740:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:10315:x1875138590074624:12345-0@lo:502: 00000100:00100000:3.0:1788271702.497842:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:10315:x1875138590074624:12345-0@lo:502: Request processed in 103us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271702.497849:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788271702.498000:0:10315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83252300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10315:1875138590074624:0@lo:502: 00000040:00080000:1.0:1788271702.498022:0:10315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788271702.498182:0:6480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788271702.498199:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788271702.498207:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078000/0x99288105fd38e741 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e748 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271702.498218:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078000/0x99288105fd38e741 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e748 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271702.498227:0:6480:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788271702.498230:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788271702.498234:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788271702.498258:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfe00/0x99288105fd38e74f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271702.498266:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfe00/0x99288105fd38e74f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271702.498275:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfe00/0x99288105fd38e74f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271702.498290:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590074752:0@lo:101: 00000100:00100000:3.0:1788271702.498320:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271702.500696:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84c8fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271702.502533:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590074752 00000100:00100000:1.0:1788271702.502549:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590074752 00000100:00100000:1.0:1788271702.502614:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788271702.502641:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+16:6480:x1875138590074752:12345-0@lo:101: 00010000:00010000:1.0:1788271702.502658:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271702.502677:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4ed4000/0x99288105fd38e756 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e74f expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271702.502724:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4ed4000/0x99288105fd38e756 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e74f expref: 17 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271702.502736:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4ed4000/0x99288105fd38e756 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e74f expref: 17 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271702.502746:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4ed4000, rc 0) 00000100:00100000:1.0:1788271702.502851:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:6480:x1875138590074752:12345-0@lo:101: Request processed in 212us (4530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271702.502866:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788271702.503503:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590074752:0@lo:101: 00010000:00010000:3.0:1788271702.503532:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfe00/0x99288105fd38e74f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e756 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271702.503554:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfe00/0x99288105fd38e74f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e756 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271702.503686:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590074880:0@lo:501: 00000100:00100000:3.0:1788271702.503723:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271702.503763:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590074880 00000100:00100000:1.0:1788271702.503769:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590074880 00000100:00100000:3.0:1788271702.503776:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84c8fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271702.503797:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788271702.503808:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:6480:x1875138590074880:12345-0@lo:501: 00000100:00100000:1.0:1788271702.503921:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:6480:x1875138590074880:12345-0@lo:501: Request processed in 116us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271702.503929:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788271702.504190:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590074880:0@lo:501: 00000100:00100000:3.0:1788271702.504219:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590075008:0@lo:503: 00000100:00100000:3.0:1788271702.504258:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271702.504276:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84c8fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271702.504296:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590075008 00000100:00100000:1.0:1788271702.504301:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590075008 00000100:00100000:1.0:1788271702.504520:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788271702.504528:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:6480:x1875138590075008:12345-0@lo:503: 00000100:00100000:1.0:1788271702.504644:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:6480:x1875138590075008:12345-0@lo:503: Request processed in 92us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271702.504650:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788271702.504786:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590075008:0@lo:503: 00000100:00100000:3.0:1788271702.505249:0:10316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10316:1875138590075136:0@lo:502: 00000100:00100000:3.0:1788271702.505284:0:10316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271702.505360:0:10316:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84c8f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788271702.505565:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590075136 00000100:00100000:1.0:1788271702.505570:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590075136 00000100:00100000:1.0:1788271702.505594:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788271702.505609:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:10316:x1875138590075136:12345-0@lo:502: 00000100:00100000:1.0:1788271702.505723:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:10316:x1875138590075136:12345-0@lo:502: Request processed in 114us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271702.505731:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788271702.505804:0:10316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10316:1875138590075136:0@lo:502: 00000020:01000000:3.0:1788271702.505828:0:10316:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788271702.505836:0:10316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271702.505839:0:10316:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788271702.505844:0:10316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788271702.505863:0:10316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10316:1875138590075264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271702.505894:0:10316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271702.505953:0:10316:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e83e9e540 going to sleep for 11 seconds 00000100:00100000:1.0:1788271702.505990:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590075264 00000100:00100000:1.0:1788271702.505994:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590075264 00000100:00100000:1.0:1788271702.506011:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788271702.506016:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:10316:x1875138590075264:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271702.506121:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:10316:x1875138590075264:12345-0@lo:502:llog_process_th.0 Request processed in 103us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271702.506127:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788271702.506181:0:10316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10316:1875138590075264:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788271702.506200:0:10316:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788271702.506208:0:10316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271702.506210:0:10316:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788271702.506214:0:10316:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:1.0:1788271702.506381:0:6480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1788271702.506564:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788271702.506574:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfe00/0x99288105fd38e74f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e756 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271702.506584:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfe00/0x99288105fd38e74f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e756 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271702.506594:0:6480:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788271702.506597:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f6eb4b8b800 from 48 10000000:01000000:1.0:1788271702.506600:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788271702.506664:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5200/0x99288105fd38e75d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271702.506672:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5200/0x99288105fd38e75d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271702.506681:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5200/0x99288105fd38e75d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271702.506702:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83252300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590075392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788271702.506731:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271702.506756:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e87389900 going to sleep for 11 seconds 00000100:00100000:3.0:1788271702.506844:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590075392 00000100:00100000:3.0:1788271702.506849:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590075392 00000100:00100000:3.0:1788271702.506882:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788271702.506889:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+17:6480:x1875138590075392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788271702.506897:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271702.506909:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6ec21dfc00/0x99288105fd38e764 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e75d expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271702.506929:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6ec21dfc00/0x99288105fd38e764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e75d expref: 18 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271702.506938:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6ec21dfc00/0x99288105fd38e764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e75d expref: 18 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271702.506947:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6ec21dfc00, rc 0) 00000100:00100000:3.0:1788271702.506987:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+18:6480:x1875138590075392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271702.506993:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788271702.507054:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83252300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590075392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788271702.507068:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5200/0x99288105fd38e75d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e764 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271702.507076:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5200/0x99288105fd38e75d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e764 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271702.507124:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83252300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590075520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271702.507149:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271702.507172:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e87389900 going to sleep for 11 seconds 00000100:00100000:0.0:1788271702.507221:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590075520 00000100:00100000:0.0:1788271702.507226:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590075520 00000100:00100000:0.0:1788271702.507257:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788271702.507264:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+18:6480:x1875138590075520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271702.507385:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+18:6480:x1875138590075520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271702.507391:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788271702.507510:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83252300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590075520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271702.507536:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83252300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590075648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271702.507570:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271702.507577:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e87389900 going to sleep for 11 seconds 00000100:00100000:0.0:1788271702.507642:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590075648 00000100:00100000:0.0:1788271702.507646:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590075648 00000100:00100000:0.0:1788271702.507660:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788271702.507665:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+18:6480:x1875138590075648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788271702.507733:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+18:6480:x1875138590075648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271702.507739:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788271702.507815:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83252300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590075648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271702.508358:0:10317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83252300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10317:1875138590075776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271702.508395:0:10317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271702.509016:0:10317:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e87389b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788271702.509063:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590075776 00000100:00100000:0.0:1788271702.509068:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590075776 00000100:00100000:0.0:1788271702.509143:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788271702.509152:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+18:10317:x1875138590075776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788271702.509257:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+18:10317:x1875138590075776:12345-0@lo:502:llog_process_th.0 Request processed in 106us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271702.509270:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788271702.509352:0:10317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83252300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10317:1875138590075776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271702.509395:0:10317:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83252300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10317:1875138590075904:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271702.509447:0:10317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271702.509691:0:10317:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e87389b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788271702.509817:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590075904 00000100:00100000:3.0:1788271702.509822:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590075904 00000100:00100000:3.0:1788271702.509845:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788271702.509851:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+18:10317:x1875138590075904:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271702.509935:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+18:10317:x1875138590075904:12345-0@lo:502:llog_process_th.0 Request processed in 83us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271702.509941:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788271702.510009:0:10317:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83252300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10317:1875138590075904:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788271702.510028:0:10317:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788271702.510183:0:6480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788271702.510207:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788271702.510215:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5200/0x99288105fd38e75d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e764 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271702.510226:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5200/0x99288105fd38e75d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e764 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271702.510235:0:6480:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788271702.510238:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1788271702.510240:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788271702.510263:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6ec21de200/0x99288105fd38e76b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271702.510272:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6ec21de200/0x99288105fd38e76b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271702.510281:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6ec21de200/0x99288105fd38e76b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271702.510293:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590076032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788271702.510320:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271702.510354:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e83e9e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788271702.510394:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590076032 00000100:00100000:1.0:1788271702.510410:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590076032 00000100:00100000:1.0:1788271702.510430:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788271702.510435:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+18:6480:x1875138590076032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788271702.510443:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271702.510454:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4ed5000/0x99288105fd38e772 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e76b expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271702.510473:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4ed5000/0x99288105fd38e772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e76b expref: 19 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271702.510483:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4ed5000/0x99288105fd38e772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e76b expref: 19 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271702.510492:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4ed5000, rc 0) 00000100:00100000:1.0:1788271702.510531:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+19:6480:x1875138590076032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271702.510537:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788271702.510681:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590076032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788271702.510699:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6ec21de200/0x99288105fd38e76b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e772 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271702.510708:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6ec21de200/0x99288105fd38e76b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e772 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271702.510755:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590076160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788271702.510786:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271702.510801:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e83e9e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788271702.510856:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590076160 00000100:00100000:1.0:1788271702.510860:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590076160 00000100:00100000:1.0:1788271702.510877:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788271702.510882:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+19:6480:x1875138590076160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271702.510998:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+19:6480:x1875138590076160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271702.511011:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788271702.519605:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590076160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788271702.519689:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590076288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788271702.519772:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271702.519816:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e83e9e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788271702.519931:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590076288 00000100:00100000:1.0:1788271702.519939:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590076288 00000100:00100000:1.0:1788271702.519981:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788271702.519989:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+19:6480:x1875138590076288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271702.520111:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+19:6480:x1875138590076288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271702.520119:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788271702.520197:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590076288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788271702.520611:0:10318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfba8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10318:1875138590076416:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788271702.520677:0:10318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271702.520702:0:10318:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830e6180 going to sleep for 11 seconds 00000100:00100000:1.0:1788271702.520808:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590076416 00000100:00100000:1.0:1788271702.520813:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590076416 00000100:00100000:1.0:1788271702.520836:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788271702.520842:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+19:10318:x1875138590076416:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271702.520930:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+19:10318:x1875138590076416:12345-0@lo:502:llog_process_th.0 Request processed in 88us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271702.520937:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788271702.521002:0:10318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfba8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10318:1875138590076416:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788271702.521023:0:10318:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788271702.521031:0:10318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271702.521033:0:10318:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788271702.521039:0:10318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788271702.521057:0:10318:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10318:1875138590076544:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271702.521087:0:10318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271702.521114:0:10318:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84c8f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788271702.521318:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590076544 00000100:00100000:1.0:1788271702.521322:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590076544 00000100:00100000:1.0:1788271702.521341:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788271702.521357:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+19:10318:x1875138590076544:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271702.521438:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+19:10318:x1875138590076544:12345-0@lo:502:llog_process_th.0 Request processed in 80us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271702.521444:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788271702.521508:0:10318:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10318:1875138590076544:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788271702.521527:0:10318:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788271702.521531:0:10318:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271702.521533:0:10318:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788271702.521536:0:10318:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:1.0:1788271702.521799:0:6480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1788271702.521818:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788271702.521827:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6ec21de200/0x99288105fd38e76b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e772 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271702.521844:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6ec21de200/0x99288105fd38e76b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e772 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271702.521853:0:6480:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788271702.521856:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f6eb0cef800 from 48 10000000:01000000:1.0:1788271702.521859:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788271702.521882:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4800/0x99288105fd38e779 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271702.521890:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4800/0x99288105fd38e779 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271702.521899:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4800/0x99288105fd38e779 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271702.521911:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83252300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590076672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788271702.521939:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271702.521968:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e89061300 going to sleep for 11 seconds 00000100:00100000:3.0:1788271702.522008:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590076672 00000100:00100000:3.0:1788271702.522012:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590076672 00000100:00100000:3.0:1788271702.522033:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788271702.522039:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+19:6480:x1875138590076672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788271702.522047:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271702.522066:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6ec21de600/0x99288105fd38e780 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e779 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271702.522088:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6ec21de600/0x99288105fd38e780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e779 expref: 20 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271702.522098:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6ec21de600/0x99288105fd38e780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e779 expref: 20 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271702.522106:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6ec21de600, rc 0) 00000100:00100000:3.0:1788271702.522146:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:6480:x1875138590076672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271702.522153:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788271702.522248:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83252300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590076672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788271702.522260:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4800/0x99288105fd38e779 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e780 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271702.522269:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4800/0x99288105fd38e779 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e780 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271702.522314:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83252300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590076800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271702.522339:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271702.522396:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e89061300 going to sleep for 11 seconds 00000100:00100000:3.0:1788271702.522482:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590076800 00000100:00100000:3.0:1788271702.522486:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590076800 00000100:00100000:3.0:1788271702.522516:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788271702.522523:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:6480:x1875138590076800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788271702.522650:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:6480:x1875138590076800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271702.522658:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788271702.523552:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83252300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590076800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271702.523590:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83252300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590076928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271702.523670:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271702.523699:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e89061300 going to sleep for 11 seconds 00000100:00100000:3.0:1788271702.523813:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590076928 00000100:00100000:3.0:1788271702.523817:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590076928 00000100:00100000:3.0:1788271702.523855:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788271702.523864:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:6480:x1875138590076928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788271702.523949:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:6480:x1875138590076928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271702.523955:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788271702.524077:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83252300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590076928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271702.525760:0:10319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83252300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10319:1875138590077056:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271702.525820:0:10319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271702.525854:0:10319:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e89061d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788271702.525941:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590077056 00000100:00100000:3.0:1788271702.525951:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590077056 00000100:00100000:3.0:1788271702.525991:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788271702.526000:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:10319:x1875138590077056:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271702.526115:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:10319:x1875138590077056:12345-0@lo:502:llog_process_th.0 Request processed in 116us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271702.526124:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788271702.526214:0:10319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83252300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10319:1875138590077056:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788271702.526254:0:10319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfba8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10319:1875138590077184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788271702.526288:0:10319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271702.526311:0:10319:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830e6180 going to sleep for 11 seconds 00000100:00100000:2.0:1788271702.526374:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590077184 00000100:00100000:2.0:1788271702.526379:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590077184 00000100:00100000:2.0:1788271702.526423:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788271702.526431:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:10319:x1875138590077184:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788271702.526514:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:10319:x1875138590077184:12345-0@lo:502:llog_process_th.0 Request processed in 84us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271702.526521:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788271702.526612:0:10319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfba8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10319:1875138590077184:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788271702.526652:0:10319:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788271702.526969:0:6480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788271702.526988:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788271702.526998:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4800/0x99288105fd38e779 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e780 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271702.527008:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4800/0x99288105fd38e779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e780 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271702.527017:0:6480:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788271702.527020:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:2.0:1788271702.527022:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788271702.527048:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20c00/0x99288105fd38e787 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271702.527056:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20c00/0x99288105fd38e787 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271702.527065:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20c00/0x99288105fd38e787 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271702.527078:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590077312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788271702.527107:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271702.528198:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d9b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271702.531655:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590077312 00000100:00100000:0.0:1788271702.531671:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590077312 00000100:00100000:0.0:1788271702.531726:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788271702.531737:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:6480:x1875138590077312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788271702.531753:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271702.531771:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4078600/0x99288105fd38e78e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e787 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271702.531798:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4078600/0x99288105fd38e78e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e787 expref: 21 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271702.531809:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4078600/0x99288105fd38e78e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e787 expref: 21 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271702.531819:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4078600, rc 0) 00000100:00100000:0.0:1788271702.531908:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:6480:x1875138590077312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (4798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271702.531928:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788271702.532085:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590077312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788271702.532104:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20c00/0x99288105fd38e787 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e78e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271702.532114:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20c00/0x99288105fd38e787 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e78e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271702.532207:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590077440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788271702.532242:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271702.532281:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d9b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271702.532432:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590077440 00000100:00100000:3.0:1788271702.532437:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590077440 00000100:00100000:3.0:1788271702.532456:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788271702.532462:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:6480:x1875138590077440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788271702.532571:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:6480:x1875138590077440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271702.532578:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788271702.532697:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590077440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788271702.532724:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590077568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788271702.532764:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271702.532784:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d9b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271702.532853:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590077568 00000100:00100000:3.0:1788271702.532857:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590077568 00000100:00100000:3.0:1788271702.532875:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788271702.532880:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:6480:x1875138590077568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788271702.532954:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:6480:x1875138590077568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271702.532961:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788271702.533035:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590077568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788271702.533494:0:10320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10320:1875138590077696:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788271702.533530:0:10320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271702.533554:0:10320:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d9ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788271702.533689:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590077696 00000100:00100000:3.0:1788271702.533693:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590077696 00000100:00100000:3.0:1788271702.533722:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788271702.533730:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:10320:x1875138590077696:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271702.533815:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:10320:x1875138590077696:12345-0@lo:502:llog_process_th.0 Request processed in 85us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271702.533832:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788271702.533930:0:10320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10320:1875138590077696:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788271702.533952:0:10320:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788271702.533962:0:10320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271702.533964:0:10320:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788271702.533970:0:10320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788271702.533988:0:10320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10320:1875138590077824:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788271702.534017:0:10320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271702.534047:0:10320:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d9ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788271702.534093:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590077824 00000100:00100000:3.0:1788271702.534097:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590077824 00000100:00100000:3.0:1788271702.534126:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788271702.534132:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:10320:x1875138590077824:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271702.534203:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:10320:x1875138590077824:12345-0@lo:502:llog_process_th.0 Request processed in 70us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271702.534209:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788271702.534305:0:10320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10320:1875138590077824:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788271702.534321:0:10320:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788271702.534325:0:10320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271702.534326:0:10320:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788271702.534334:0:10320:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:3.0:1788271702.534520:0:6480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:3.0:1788271702.534539:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788271702.534546:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20c00/0x99288105fd38e787 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e78e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271702.534556:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20c00/0x99288105fd38e787 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e78e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271702.534565:0:6480:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788271702.534568:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f6e91513000 from 48 10000000:01000000:3.0:1788271702.534571:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788271702.534593:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e80031200/0x99288105fd38e795 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271702.534601:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6e80031200/0x99288105fd38e795 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271702.534609:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6e80031200/0x99288105fd38e795 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271702.534660:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590077952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788271702.534694:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271702.534708:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e8a310d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788271702.534783:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590077952 00000100:00100000:2.0:1788271702.534788:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590077952 00000100:00100000:2.0:1788271702.534817:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788271702.534824:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:6480:x1875138590077952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788271702.534832:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271702.534842:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4e21800/0x99288105fd38e79c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e795 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271702.534859:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4e21800/0x99288105fd38e79c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e795 expref: 22 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271702.534868:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4e21800/0x99288105fd38e79c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e795 expref: 22 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271702.534875:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e21800, rc 0) 00000100:00100000:2.0:1788271702.534911:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:6480:x1875138590077952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271702.534916:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788271702.534996:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590077952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788271702.535007:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6e80031200/0x99288105fd38e795 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e79c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271702.535016:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6e80031200/0x99288105fd38e795 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e79c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271702.535062:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590078080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788271702.535084:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271702.535106:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e8a310d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788271702.535230:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590078080 00000100:00100000:2.0:1788271702.535235:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590078080 00000100:00100000:2.0:1788271702.535262:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788271702.535268:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:6480:x1875138590078080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788271702.535379:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:6480:x1875138590078080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271702.535385:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788271702.535535:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590078080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788271702.535561:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590078208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788271702.535607:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271702.535652:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e8a310d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788271702.535698:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590078208 00000100:00100000:0.0:1788271702.535702:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590078208 00000100:00100000:0.0:1788271702.535725:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788271702.535732:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:6480:x1875138590078208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788271702.535815:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:6480:x1875138590078208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271702.535821:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788271702.535922:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590078208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788271702.536200:0:10321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10321:1875138590078336:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271702.536232:0:10321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271702.536283:0:10321:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9828e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271702.538745:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590078336 00000100:00100000:1.0:1788271702.538759:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590078336 00000100:00100000:1.0:1788271702.538818:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788271702.538827:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:10321:x1875138590078336:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271702.538973:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:10321:x1875138590078336:12345-0@lo:502:llog_process_th.0 Request processed in 148us (2740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271702.538978:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788271702.539068:0:10321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10321:1875138590078336:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271702.539116:0:10321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10321:1875138590078464:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271702.539146:0:10321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271702.539175:0:10321:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9828e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271702.539218:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590078464 00000100:00100000:1.0:1788271702.539221:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590078464 00000100:00100000:1.0:1788271702.539241:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788271702.539245:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:10321:x1875138590078464:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271702.539293:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:10321:x1875138590078464:12345-0@lo:502:llog_process_th.0 Request processed in 47us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271702.539299:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788271702.539368:0:10321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10321:1875138590078464:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788271702.539384:0:10321:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788271702.539592:0:6480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788271702.539611:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788271702.539845:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e80031200/0x99288105fd38e795 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e79c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271702.539856:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6e80031200/0x99288105fd38e795 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e79c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271702.539865:0:6480:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788271702.539867:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:1.0:1788271702.539871:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788271702.539894:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5800/0x99288105fd38e7a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271702.539902:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5800/0x99288105fd38e7a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271702.539910:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5800/0x99288105fd38e7a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271702.539923:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83250000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590078592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788271702.539950:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271702.539978:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e89061a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788271702.540139:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590078592 00000100:00100000:2.0:1788271702.540144:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590078592 00000100:00100000:2.0:1788271702.540186:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788271702.540200:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:6480:x1875138590078592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788271702.540210:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271702.540221:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4e20800/0x99288105fd38e7aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e7a3 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271702.540240:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4e20800/0x99288105fd38e7aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e7a3 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271702.540259:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4e20800/0x99288105fd38e7aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e7a3 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271702.540268:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e20800, rc 0) 00000100:00100000:2.0:1788271702.540297:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:6480:x1875138590078592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271702.540304:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788271702.540495:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83250000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590078592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788271702.540510:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5800/0x99288105fd38e7a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e7aa expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271702.540520:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5800/0x99288105fd38e7a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e7aa expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271702.540580:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83250000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590078720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271702.540614:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271702.540664:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e89061a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788271702.540676:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590078720 00000100:00100000:1.0:1788271702.540679:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590078720 00000100:00100000:1.0:1788271702.540697:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788271702.540702:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:6480:x1875138590078720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271702.540795:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:6480:x1875138590078720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 92us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271702.540802:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788271702.540826:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83250000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590078720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271702.540849:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83250000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590078848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271702.540881:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271702.540893:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e89061a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788271702.540903:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590078848 00000100:00100000:1.0:1788271702.540906:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590078848 00000100:00100000:1.0:1788271702.540920:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788271702.540925:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:6480:x1875138590078848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271702.541000:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:6480:x1875138590078848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271702.541007:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788271702.541040:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83250000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590078848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271702.541683:0:10322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83250000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10322:1875138590078976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271702.541719:0:10322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271702.541742:0:10322:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e89061c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788271702.541791:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590078976 00000100:00100000:0.0:1788271702.541796:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590078976 00000100:00100000:0.0:1788271702.541824:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788271702.541832:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:10322:x1875138590078976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788271702.541913:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:10322:x1875138590078976:12345-0@lo:502:llog_process_th.0 Request processed in 81us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271702.541920:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788271702.542019:0:10322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83250000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10322:1875138590078976:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788271702.542045:0:10322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788271702.542053:0:10322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271702.542055:0:10322:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788271702.542062:0:10322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788271702.542079:0:10322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83250000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10322:1875138590079104:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271702.542108:0:10322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271702.542129:0:10322:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e89061c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788271702.542165:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590079104 00000100:00100000:2.0:1788271702.542169:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590079104 00000100:00100000:2.0:1788271702.542320:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788271702.542328:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:10322:x1875138590079104:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788271702.542418:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:10322:x1875138590079104:12345-0@lo:502:llog_process_th.0 Request processed in 91us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271702.542425:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788271702.542508:0:10322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83250000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10322:1875138590079104:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788271702.542525:0:10322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788271702.542529:0:10322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271702.542531:0:10322:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788271702.542535:0:10322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788271702.542702:0:6480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1788271702.542722:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788271702.542730:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5800/0x99288105fd38e7a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e7aa expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271702.542740:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5800/0x99288105fd38e7a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e7aa expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271702.542750:0:6480:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788271702.542752:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f6e85beb370 from 1 10000000:01000000:0.0:1788271702.542755:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788271702.542775:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e7b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271702.542789:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e7b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271702.542799:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e7b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271702.542812:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfba8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590079232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788271702.542840:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271702.542861:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830e6240 going to sleep for 11 seconds 00000100:00100000:2.0:1788271702.542909:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590079232 00000100:00100000:2.0:1788271702.542913:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590079232 00000100:00100000:2.0:1788271702.542940:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788271702.542947:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:6480:x1875138590079232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788271702.542955:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271702.542971:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4e20000/0x99288105fd38e7b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e7b1 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271702.542990:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4e20000/0x99288105fd38e7b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e7b1 expref: 24 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271702.543001:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4e20000/0x99288105fd38e7b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e7b1 expref: 24 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271702.543010:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e20000, rc 0) 00000100:00100000:2.0:1788271702.543045:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:6480:x1875138590079232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271702.543051:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788271702.543104:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfba8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590079232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788271702.543116:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e7b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e7b8 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271702.543125:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e7b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e7b8 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271702.543168:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfba8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590079360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271702.543361:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271702.543414:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830e6240 going to sleep for 11 seconds 00000100:00100000:1.0:1788271702.543857:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590079360 00000100:00100000:1.0:1788271702.543862:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590079360 00000100:00100000:1.0:1788271702.543915:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788271702.543922:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:6480:x1875138590079360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271702.544015:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:6480:x1875138590079360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (654us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788271702.544021:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788271702.544060:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfba8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590079360:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788271702.544081:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788271702.544086:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e7b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e7b8 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271702.544094:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e7b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e7b8 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271703.453745:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788271703.476426:0:10359:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffdc511360 20000000:00000080:0.0:1788271703.476446:0:10359:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f6eb4e8fc00 uarg=0000000000000000 20000000:01000000:0.0:1788271703.476492:0:10359:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788271703.476498:0:10359:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788271703.476502:0:10359:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788271703.477503:0:10360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1788271703.479345:0:10359:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788271703.484861:0:10359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788271703.484908:0:10359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788271703.484926:0:10359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788271703.484946:0:10359:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788271703.484968:0:10359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f6eb4079e00/0x99288105fd38e7bf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271703.484987:0:10359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6e813a1a00/0x99288105fd38e407 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e400 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271703.484997:0:10359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6eb4079800/0x99288105fd38e45b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e454 expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271703.485004:0:10359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6eb4079000/0x99288105fd38e4bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e4b6 expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271703.485012:0:10359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6ec21de000/0x99288105fd38e5e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e5dc expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271703.485033:0:10359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6eb4e21600/0x99288105fd38e6fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd2df expref: 9 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271703.485042:0:10359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f6eb4079e00/0x99288105fd38e7bf lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271703.485105:0:10359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6eb4e21600/0x99288105fd38e6fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd2df expref: 9 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271703.485123:0:10359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f6eb4e21600/0x99288105fd38e6fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd2df expref: 9 pid: 6477 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271703.485147:0:10359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfba8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10359:1875138590079488:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788271703.485372:0:10359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6ec21de000/0x99288105fd38e5e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e5dc expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271703.485382:0:10359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f6ec21de000/0x99288105fd38e5e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e5dc expref: 23 pid: 6477 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271703.485393:0:10359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfba8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10359:1875138590079616:0@lo:104: 00000100:00100000:0.0:1788271703.485435:0:10359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788271703.485590:0:10359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6eb4079000/0x99288105fd38e4bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e4b6 expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271703.485598:0:10359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f6eb4079000/0x99288105fd38e4bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e4b6 expref: 23 pid: 6476 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271703.485607:0:10359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfbab100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10359:1875138590079744:0@lo:104: 00000100:00100000:0.0:1788271703.485650:0:10359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788271703.486762:0:10359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6eb4079800/0x99288105fd38e45b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e454 expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271703.486777:0:10359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f6eb4079800/0x99288105fd38e45b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e454 expref: 23 pid: 6476 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271703.486819:0:10359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8233a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10359:1875138590079872:0@lo:104: 00010000:00010000:0.0:1788271703.486857:0:10359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6e813a1a00/0x99288105fd38e407 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e400 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271703.486866:0:10359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f6e813a1a00/0x99288105fd38e407 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e400 expref: 23 pid: 6477 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271703.486874:0:10359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10359:1875138590080000:0@lo:104: 00000100:00100000:0.0:1788271703.486891:0:10359:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830e6240 going to sleep for 11 seconds 00000100:00100000:2.0:1788271703.487067:0:6467:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788271703.487092:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271703.487121:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271703.487243:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590079616 00000100:00100000:2.0:1788271703.487251:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590079616 00000100:00100000:2.0:1788271703.487299:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590079744 00000100:00100000:2.0:1788271703.487303:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590079744 00000100:00100000:2.0:1788271703.487312:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590079872 00000100:00100000:2.0:1788271703.487315:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590079872 00000100:00100000:2.0:1788271703.487324:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590080000 00000100:00100000:2.0:1788271703.487339:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590080000 00000100:00100000:2.0:1788271703.487356:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788271703.487366:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfba8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+6:10359:x1875138590079616:12345-0@lo:104: 00010000:00010000:2.0:1788271703.487381:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6ec21de800/0x99288105fd38e5dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e5e3 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271703.487449:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788271703.487456:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfba8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+6:10359:x1875138590079616:12345-0@lo:104: Request processed in 91us (2020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271703.487473:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788271703.487491:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788271703.487498:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb7f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+5:10359:x1875138590079744:12345-0@lo:104: 00010000:00010000:2.0:1788271703.487506:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20a00/0x99288105fd38e4b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e4bd expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271703.487554:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788271703.487560:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb7f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+5:10359:x1875138590079744:12345-0@lo:104: Request processed in 62us (1909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271703.487567:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788271703.487640:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788271703.487648:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4fb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+4:10359:x1875138590079872:12345-0@lo:104: 00010000:00010000:2.0:1788271703.487657:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21000/0x99288105fd38e454 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e45b expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271703.487691:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788271703.487697:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4fb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+4:10359:x1875138590079872:12345-0@lo:104: Request processed in 50us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271703.487702:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788271703.487714:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788271703.487719:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+3:10359:x1875138590080000:12345-0@lo:104: 00010000:00010000:2.0:1788271703.487725:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6e92d32600/0x99288105fd38e400 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e407 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271703.487753:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788271703.487757:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+3:10359:x1875138590080000:12345-0@lo:104: Request processed in 38us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271703.487770:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1788271703.487790:0:8412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788271703.487796:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6ec21de800/0x99288105fd38e5dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e5e3 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271703.487968:0:10359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfba8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10359:1875138590079616:0@lo:104: 00000100:00100000:1.0:1788271703.487978:0:10359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfbab100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10359:1875138590079744:0@lo:104: 00000100:00100000:1.0:1788271703.487985:0:10359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8233a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10359:1875138590079872:0@lo:104: 00000100:00100000:1.0:1788271703.487991:0:10359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10359:1875138590080000:0@lo:104: 00010000:00010000:2.0:1788271703.488083:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6ec21de800 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:2.0:1788271703.488090:0:8412:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6ec21de800/0x99288105fd38e5dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e5e3 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271703.488102:0:8412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6ec21de800/0x99288105fd38e5dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e5e3 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788271703.488109:0:8412:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6ec21de800/0x99288105fd38e5dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e5e3 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271703.488115:0:8412:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788271703.488252:0:8412:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6ec21de800/0x99288105fd38e5dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e5e3 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271703.488259:0:8412:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788271703.488281:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6ec21de800/0x99288105fd38e5dc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e5e3 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271703.488289:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6ec21de800/0x99288105fd38e5dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e5e3 expref: -99 pid: 9474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271703.488303:0:8412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788271703.488306:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20a00/0x99288105fd38e4b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e4bd expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271703.488322:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e20a00 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:2.0:1788271703.488338:0:8412:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20a00/0x99288105fd38e4b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e4bd expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271703.488345:0:8412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20a00/0x99288105fd38e4b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e4bd expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788271703.488351:0:8412:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20a00/0x99288105fd38e4b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e4bd expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271703.488356:0:8412:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788271703.488527:0:6466:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00010000:00010000:0.0:1788271703.488668:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788271703.488673:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21000/0x99288105fd38e454 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e45b expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271703.488681:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e21000 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:0.0:1788271703.488684:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21000/0x99288105fd38e454 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e45b expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271703.488692:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21000/0x99288105fd38e454 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e45b expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788271703.488699:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21000/0x99288105fd38e454 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e45b expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271703.488705:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788271703.488914:0:8412:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20a00/0x99288105fd38e4b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e4bd expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271703.488922:0:8412:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788271703.488931:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20a00/0x99288105fd38e4b6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e4bd expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271703.488937:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20a00/0x99288105fd38e4b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e4bd expref: -99 pid: 8389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271703.488947:0:8412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271703.488950:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6e92d32600/0x99288105fd38e400 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e407 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271703.488955:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e92d32600 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:2.0:1788271703.488958:0:8412:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6e92d32600/0x99288105fd38e400 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e407 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271703.488977:0:8412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6e92d32600/0x99288105fd38e400 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e407 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788271703.488983:0:8412:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6e92d32600/0x99288105fd38e400 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e407 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271703.488989:0:8412:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788271703.489003:0:8412:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6e92d32600/0x99288105fd38e400 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e407 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271703.489010:0:8412:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788271703.489542:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590080384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788271703.489688:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271703.489753:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590080384 00000100:00100000:3.0:1788271703.489760:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590080384 00010000:00010000:3.0:1788271703.489789:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6e813a1a00/0x99288105fd38e407 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e400 expref: 24 pid: 6477 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271703.489898:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788271703.489908:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3608:x1875138590080384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788271703.489920:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271703.489927:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6e813a1a00/0x99288105fd38e407 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e400 expref: 24 pid: 6477 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271703.489938:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6e813a1a00/0x99288105fd38e407 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e400 expref: 24 pid: 6477 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271703.489954:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6e813a1a00/0x99288105fd38e407 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e400 expref: 24 pid: 6477 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271703.489968:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271703.490001:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:3608:x1875138590080384:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271703.490007:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788271703.490058:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590080384:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788271703.490253:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6e92d32600/0x99288105fd38e400 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e407 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271703.490263:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6e92d32600/0x99288105fd38e400 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e407 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271703.490275:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271703.490277:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271703.490279:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271703.490286:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271703.490297:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590080128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788271703.490339:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271703.490370:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788271703.490376:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590080256:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788271703.490396:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271703.490425:0:9486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590080128 00000100:00100000:2.0:1788271703.490429:0:9486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590080128 00010000:00010000:2.0:1788271703.490446:0:9486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6ec21de000/0x99288105fd38e5e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e5dc expref: 23 pid: 6477 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271703.490475:0:9486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590080256 00000100:00100000:2.0:1788271703.490479:0:9486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590080256 00010000:00010000:2.0:1788271703.490491:0:9486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6eb4079000/0x99288105fd38e4bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e4b6 expref: 24 pid: 6476 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271703.490505:0:9486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788271703.490511:0:9486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4fb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3606:x1875138590080128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788271703.490520:0:9486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271703.490525:0:9486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6ec21de000/0x99288105fd38e5e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e5dc expref: 24 pid: 6477 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271703.490534:0:9486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6ec21de000/0x99288105fd38e5e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e5dc expref: 24 pid: 6477 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271703.492299:0:9486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6ec21de000/0x99288105fd38e5e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e5dc expref: 24 pid: 6477 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271703.492324:0:9486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271703.492410:0:9486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4fb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:3606:x1875138590080128:12345-0@lo:103:ldlm_bl.0 Request processed in 1896us (2080us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271703.492419:0:9486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788271703.492454:0:9486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788271703.492466:0:9486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4fb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:3606:x1875138590080256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788271703.492482:0:9486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271703.492489:0:9486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6eb4079000/0x99288105fd38e4bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e4b6 expref: 22 pid: 6476 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271703.492500:0:9486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6eb4079000/0x99288105fd38e4bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e4b6 expref: 22 pid: 6476 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271703.492530:0:9486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4079000/0x99288105fd38e4bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e4b6 expref: 22 pid: 6476 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271703.492540:0:9486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271703.492563:0:9486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4fb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:3606:x1875138590080256:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (2166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271703.492570:0:9486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788271703.492704:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590080256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788271703.492716:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590080128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788271703.492929:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271703.492953:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577439104 00000100:00100000:3.0:1788271703.492960:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577439104 00010000:00010000:3.0:1788271703.492986:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6eb4e21600/0x99288105fd38e6fb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd2df expref: 10 pid: 6477 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271703.493006:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 38 00000100:00100000:3.0:1788271703.493011:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:2398:x1875138577439104:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788271703.493089:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271703.493096:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6eb4e21600/0x99288105fd38e6fb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd2df expref: 10 pid: 6477 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271703.493108:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6eb4e21600/0x99288105fd38e6fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd2df expref: 10 pid: 6477 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271703.493119:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788271703.493274:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21000/0x99288105fd38e454 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e45b expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271703.493283:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788271703.493312:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21000/0x99288105fd38e454 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e45b expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271703.493320:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21000/0x99288105fd38e454 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e45b expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271703.493349:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271703.493351:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271703.493353:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271703.493360:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271703.493469:0:10359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4e21600/0x99288105fd38e6fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd2df expref: 10 pid: 6477 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271703.493481:0:10359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfba8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10359:1875138590079488:192.168.201.3@tcp:104: 00010000:00010000:1.0:1788271703.493514:0:10359:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f6eb4079e00/0x99288105fd38e7bf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271703.493674:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a94beb9-7f16-4b5a-842a-fac2e5234617+9:2398:x1875138577439104:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 661us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271703.493683:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 38 00000100:00100000:3.0:1788271703.493709:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590080512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788271703.493747:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271703.493795:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590080512 00000100:00100000:3.0:1788271703.493799:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590080512 00010000:00010000:3.0:1788271703.494681:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6eb4079800/0x99288105fd38e45b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e454 expref: 21 pid: 6476 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271703.494718:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788271703.494727:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:3609:x1875138590080512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788271703.494750:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271703.494756:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6eb4079800/0x99288105fd38e45b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e454 expref: 21 pid: 6476 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271703.494768:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6eb4079800/0x99288105fd38e45b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e454 expref: 21 pid: 6476 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271703.494784:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4079800/0x99288105fd38e45b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e454 expref: 21 pid: 6476 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271703.494798:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f6eb4079e00/0x99288105fd38e7bf lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271703.495345:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4079e00/0x99288105fd38e7bf lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271703.495364:0:6469:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f6eb4079e00/0x99288105fd38e7bf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271703.495371:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f6eb4079e00/0x99288105fd38e7bf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271703.495377:0:6469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f6eb4079e00/0x99288105fd38e7bf lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271703.495384:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f6eb4079e00/0x99288105fd38e7bf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271703.495390:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4079e00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:3.0:1788271703.495395:0:6469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f6eb4079e00/0x99288105fd38e7bf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271703.495413:0:6469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f6eb4079e00/0x99288105fd38e7bf lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271703.495546:0:10359:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f6eb4079e00/0x99288105fd38e7bf lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271703.495555:0:10359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f6eb4079e00/0x99288105fd38e7bf lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271703.496912:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f6eb4079e00/0x99288105fd38e7bf lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271703.496929:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4079e00/0x99288105fd38e7bf lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271703.496951:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271703.497132:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:3609:x1875138590080512:12345-0@lo:103:ldlm_bl.0 Request processed in 2403us (3381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271703.497151:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788271703.499435:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590080512:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788271704.284019:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271704.284097:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577439232 00000100:00100000:2.0:1788271704.284107:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577439232 00000100:00100000:2.0:1788271704.284166:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 250 00000100:00100000:2.0:1788271704.284176:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+9:6170:x1875138577439232:12345-192.168.201.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788271704.284193:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271704.284210:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4e20a00/0x99288105fd38e7c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd325 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271704.284237:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4e20a00/0x99288105fd38e7c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd325 expref: 10 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271704.284248:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4e20a00/0x99288105fd38e7c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd325 expref: 10 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271704.284257:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e20a00, rc 0) 00000100:00100000:2.0:1788271704.284332:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:6170:x1875138577439232:12345-192.168.201.3@tcp:101:ll_cfg_requeue.0 Request processed in 157us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271704.284339:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 250 00000100:00100000:3.0:1788271704.287813:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271704.287948:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577439360 00000100:00100000:1.0:1788271704.287961:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577439360 00000100:00100000:1.0:1788271704.288025:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 251 00000100:00100000:1.0:1788271704.288036:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:6170:x1875138577439360:12345-192.168.201.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271704.288200:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:6170:x1875138577439360:12345-192.168.201.3@tcp:501:ll_cfg_requeue.0 Request processed in 165us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271704.288209:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 251 00000100:00100000:1.0:1788271704.298818:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271704.298969:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577439488 00000100:00100000:2.0:1788271704.298980:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577439488 00000100:00100000:2.0:1788271704.299044:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 252 00000100:00100000:2.0:1788271704.299054:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:6170:x1875138577439488:12345-192.168.201.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788271704.299186:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:6170:x1875138577439488:12345-192.168.201.3@tcp:503:ll_cfg_requeue.0 Request processed in 133us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271704.299194:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 252 00000100:00100000:1.0:1788271704.302552:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271704.302769:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577439616 00000100:00100000:3.0:1788271704.302778:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577439616 00000100:00100000:3.0:1788271704.302838:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 253 00000100:00100000:3.0:1788271704.302857:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:6703:x1875138577439616:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788271704.302992:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:6703:x1875138577439616:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 137us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271704.303002:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 253 00000100:00100000:3.0:1788271704.308687:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271704.312824:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577439744 00000100:00100000:1.0:1788271704.312838:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577439744 00000100:00100000:1.0:1788271704.314207:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 254 00000100:00100000:1.0:1788271704.314228:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:6703:x1875138577439744:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788271704.314398:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:6703:x1875138577439744:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 171us (5721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271704.314407:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 254 10000000:01000000:3.0:1788271704.351697:0:6480:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788271704.351706:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f6d820cc800 from 4 10000000:01000000:3.0:1788271704.351711:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788271704.351751:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e80031e00/0x99288105fd38e7cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271704.351774:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6e80031e00/0x99288105fd38e7cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271704.351787:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6e80031e00/0x99288105fd38e7cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271704.351812:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590080640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788271704.354805:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271704.354921:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9828ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788271704.357764:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590080640 00000100:00100000:2.0:1788271704.357777:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590080640 00000100:00100000:2.0:1788271704.358780:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788271704.358795:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:6480:x1875138590080640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788271704.358813:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271704.358832:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4e21000/0x99288105fd38e7d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e7cd expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271704.358872:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4e21000/0x99288105fd38e7d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e7cd expref: 21 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271704.358883:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4e21000/0x99288105fd38e7d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e7cd expref: 21 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271704.358892:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e21000, rc 0) 00000100:00100000:2.0:1788271704.358974:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:6480:x1875138590080640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (4177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271704.358982:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788271704.359066:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590080640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788271704.359085:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6e80031e00/0x99288105fd38e7cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e7d4 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271704.359094:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6e80031e00/0x99288105fd38e7cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e7d4 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271704.359167:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590080768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788271704.359196:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271704.360156:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9828ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1788271704.360221:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590080768 00000100:00100000:0.0:1788271704.360228:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590080768 00000100:00100000:0.0:1788271704.360341:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788271704.360351:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:6480:x1875138590080768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271704.360591:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:6480:x1875138590080768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 241us (1393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271704.360599:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788271704.363830:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590080768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788271704.364405:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590080896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788271704.364792:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271704.365377:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9828ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788271704.366959:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590080896 00000100:00100000:1.0:1788271704.366972:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590080896 00000100:00100000:1.0:1788271704.367041:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788271704.367052:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:6480:x1875138590080896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271704.367205:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:6480:x1875138590080896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (2643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271704.367213:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788271704.367382:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590080896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271704.375031:0:10389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83250000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10389:1875138590081024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271704.375110:0:10389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271704.375145:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590081024 00000100:00100000:1.0:1788271704.375151:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590081024 00000100:00100000:1.0:1788271704.375189:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788271704.375198:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:10389:x1875138590081024:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271704.375953:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:10389:x1875138590081024:12345-0@lo:502:llog_process_th.0 Request processed in 754us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271704.375962:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788271704.376097:0:10389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4f0a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788271704.376119:0:10389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83250000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10389:1875138590081024:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788271704.376146:0:10389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788271704.376156:0:10389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271704.376158:0:10389:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788271704.376170:0:10389:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f6d820cc800 00000020:00000080:1.0:1788271704.376173:0:10389:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788271704.376241:0:10389:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83250000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10389:1875138590081152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271704.376469:0:10389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271704.376499:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590081152 00000100:00100000:1.0:1788271704.376503:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590081152 00000100:00100000:1.0:1788271704.376531:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788271704.376539:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:10389:x1875138590081152:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271704.376689:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:10389:x1875138590081152:12345-0@lo:502:llog_process_th.0 Request processed in 150us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271704.376696:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788271704.376723:0:10389:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4f0a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788271704.376735:0:10389:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83250000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10389:1875138590081152:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788271704.376752:0:10389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788271704.376756:0:10389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271704.376757:0:10389:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788271704.376761:0:10389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788271704.376815:0:6480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788271704.376831:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788271704.376961:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e80031e00/0x99288105fd38e7cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e7d4 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271704.376973:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6e80031e00/0x99288105fd38e7cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e7d4 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271704.376984:0:6480:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788271704.376987:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f6eb4b8b800 from 4 10000000:01000000:1.0:1788271704.376990:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788271704.377026:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4c00/0x99288105fd38e7db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271704.377040:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4c00/0x99288105fd38e7db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271704.377050:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4c00/0x99288105fd38e7db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271704.377065:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83250000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590081280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788271704.377092:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271704.377967:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4f0a300 going to sleep for 11 seconds 00000100:00100000:3.0:1788271704.380324:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590081280 00000100:00100000:3.0:1788271704.380342:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590081280 00000100:00100000:3.0:1788271704.381497:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788271704.381518:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:6480:x1875138590081280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788271704.381540:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271704.381569:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6e80030e00/0x99288105fd38e7e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e7db expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271704.381598:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6e80030e00/0x99288105fd38e7e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e7db expref: 22 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271704.381609:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6e80030e00/0x99288105fd38e7e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e7db expref: 22 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271704.381634:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e80030e00, rc 0) 00000100:00100000:3.0:1788271704.381715:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:6480:x1875138590081280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 203us (4621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271704.385729:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83250000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590081280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788271704.385758:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4c00/0x99288105fd38e7db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e7e2 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271704.385783:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4c00/0x99288105fd38e7db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e7e2 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271704.385941:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590081408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788271704.386009:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271704.386052:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e83e9e600 going to sleep for 11 seconds 00000100:00100000:2.0:1788271704.386071:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590081408 00000100:00100000:2.0:1788271704.386076:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590081408 00000100:00100000:3.0:1788271704.389391:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788271704.395039:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788271704.395058:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:6480:x1875138590081408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788271704.395223:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:6480:x1875138590081408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 170us (9213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271704.395231:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788271704.396692:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590081408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788271704.396748:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590081536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788271704.396807:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271704.396883:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e83e9e600 going to sleep for 11 seconds 00000100:00100000:3.0:1788271704.402496:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590081536 00000100:00100000:3.0:1788271704.402508:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590081536 00000100:00100000:2.0:1788271704.402717:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788271704.402727:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:6480:x1875138590081536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788271704.402885:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:6480:x1875138590081536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (6078us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271704.402892:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788271704.402943:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590081536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271704.405400:0:10393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83252d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10393:1875138590081664:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271704.405554:0:10393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271704.406004:0:10393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4f0ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788271704.407441:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590081664 00000100:00100000:2.0:1788271704.407454:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590081664 00000100:00100000:3.0:1788271704.407875:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788271704.407886:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:10393:x1875138590081664:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271704.408039:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:10393:x1875138590081664:12345-0@lo:502:llog_process_th.0 Request processed in 155us (2485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271704.408046:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788271704.408393:0:10393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83252d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10393:1875138590081664:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788271704.408849:0:10393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788271704.408859:0:10393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271704.408861:0:10393:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788271704.408868:0:10393:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f6eb4b8b800 00000020:00000080:1.0:1788271704.408871:0:10393:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788271704.408997:0:10393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83252d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10393:1875138590081792:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271704.409044:0:10393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271704.409085:0:10393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4f0ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788271704.409130:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590081792 00000100:00100000:3.0:1788271704.409136:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590081792 00000100:00100000:3.0:1788271704.409174:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788271704.409182:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:10393:x1875138590081792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271704.409288:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:10393:x1875138590081792:12345-0@lo:502:llog_process_th.0 Request processed in 106us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271704.409295:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788271704.410263:0:10393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83252d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10393:1875138590081792:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788271704.410291:0:10393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788271704.410298:0:10393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271704.410300:0:10393:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788271704.410304:0:10393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788271704.411524:0:6480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788271704.411570:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788271704.411583:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4c00/0x99288105fd38e7db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e7e2 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271704.411599:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4c00/0x99288105fd38e7db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e7e2 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271704.411610:0:6480:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788271704.411613:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f6eb0cef800 from 4 10000000:01000000:0.0:1788271704.411639:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788271704.411685:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079200/0x99288105fd38e7e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271704.411706:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079200/0x99288105fd38e7e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271704.411717:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079200/0x99288105fd38e7e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271704.411739:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816ce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590081920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788271704.411797:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271704.411838:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84cca480 going to sleep for 11 seconds 00000100:00100000:1.0:1788271704.411942:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590081920 00000100:00100000:1.0:1788271704.411949:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590081920 00000100:00100000:1.0:1788271704.412002:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788271704.412012:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:6480:x1875138590081920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788271704.412025:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271704.412040:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4ed5400/0x99288105fd38e7f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e7e9 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271704.412063:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4ed5400/0x99288105fd38e7f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e7e9 expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271704.412073:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4ed5400/0x99288105fd38e7f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e7e9 expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271704.412082:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4ed5400, rc 0) 00000100:00100000:1.0:1788271704.412127:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:6480:x1875138590081920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271704.412134:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788271704.412212:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816ce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590081920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788271704.412224:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079200/0x99288105fd38e7e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e7f0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271704.412234:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079200/0x99288105fd38e7e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e7f0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271704.412303:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816ce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590082048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271704.412341:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271704.412363:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84cca480 going to sleep for 11 seconds 00000100:00100000:1.0:1788271704.412520:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590082048 00000100:00100000:1.0:1788271704.412525:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590082048 00000100:00100000:1.0:1788271704.412564:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788271704.412571:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:6480:x1875138590082048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271704.412695:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:6480:x1875138590082048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271704.412702:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788271704.412826:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816ce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590082048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271704.412853:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816ce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590082176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788271704.412894:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271704.412916:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84cca480 going to sleep for 11 seconds 00000100:00100000:1.0:1788271704.412954:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590082176 00000100:00100000:1.0:1788271704.412959:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590082176 00000100:00100000:1.0:1788271704.412987:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788271704.412993:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:6480:x1875138590082176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271704.413071:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:6480:x1875138590082176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271704.413077:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788271704.413146:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816ce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590082176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788271704.413656:0:10394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816ce680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10394:1875138590082304:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788271704.413701:0:10394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271704.413721:0:10394:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84ccaa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788271704.413830:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590082304 00000100:00100000:1.0:1788271704.413835:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590082304 00000100:00100000:1.0:1788271704.413870:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788271704.413878:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:10394:x1875138590082304:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271704.413961:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:10394:x1875138590082304:12345-0@lo:502:llog_process_th.0 Request processed in 83us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271704.413967:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788271704.414009:0:10394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816ce680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10394:1875138590082304:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788271704.414031:0:10394:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788271704.414040:0:10394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271704.414042:0:10394:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788271704.414049:0:10394:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f6eb0cef800 00000020:00000080:1.0:1788271704.414052:0:10394:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788271704.417746:0:10394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83252d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10394:1875138590082432:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271704.417825:0:10394:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271704.417865:0:10394:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4f0a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788271704.418524:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590082432 00000100:00100000:0.0:1788271704.418533:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590082432 00000100:00100000:0.0:1788271704.418583:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788271704.418592:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:10394:x1875138590082432:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788271704.418748:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:10394:x1875138590082432:12345-0@lo:502:llog_process_th.0 Request processed in 156us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271704.418757:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788271704.419108:0:10394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83252d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10394:1875138590082432:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788271704.419142:0:10394:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788271704.419149:0:10394:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271704.419152:0:10394:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788271704.419156:0:10394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788271704.419544:0:6480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788271704.419576:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788271704.419586:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079200/0x99288105fd38e7e9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e7f0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271704.419598:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079200/0x99288105fd38e7e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e7f0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271704.419608:0:6480:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788271704.419610:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f6e91513000 from 4 10000000:01000000:0.0:1788271704.419613:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788271704.419682:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079a00/0x99288105fd38e7f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271704.419691:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079a00/0x99288105fd38e7f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271704.419701:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079a00/0x99288105fd38e7f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271704.419720:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816ce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590082560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788271704.419768:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271704.419798:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8219af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788271704.419831:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590082560 00000100:00100000:0.0:1788271704.419836:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590082560 00000100:00100000:0.0:1788271704.419869:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788271704.419877:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:6480:x1875138590082560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788271704.419887:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271704.419900:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4078400/0x99288105fd38e7fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e7f7 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271704.419926:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4078400/0x99288105fd38e7fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e7f7 expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271704.419939:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4078400/0x99288105fd38e7fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e7f7 expref: 24 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271704.419950:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4078400, rc 0) 00000100:00100000:0.0:1788271704.419982:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:6480:x1875138590082560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271704.419990:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788271704.420025:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816ce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590082560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788271704.420037:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079a00/0x99288105fd38e7f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e7fe expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271704.420046:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079a00/0x99288105fd38e7f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e7fe expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271704.420105:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816ce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590082688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271704.420144:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271704.420156:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8219af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788271704.420168:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590082688 00000100:00100000:0.0:1788271704.420171:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590082688 00000100:00100000:0.0:1788271704.420191:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788271704.420196:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:6480:x1875138590082688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271704.420299:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:6480:x1875138590082688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271704.420307:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788271704.420346:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816ce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590082688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271704.420368:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816ce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590082816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788271704.420403:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271704.420791:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8219af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788271704.420804:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590082816 00000100:00100000:0.0:1788271704.420807:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590082816 00000100:00100000:0.0:1788271704.420830:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788271704.420837:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:6480:x1875138590082816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788271704.420912:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:6480:x1875138590082816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271704.420919:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788271704.420955:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816ce680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590082816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788271704.423456:0:10396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f3a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10396:1875138590082944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271704.423539:0:10396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271704.423597:0:10396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9828e540 going to sleep for 11 seconds 00000100:00100000:0.0:1788271704.424026:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590082944 00000100:00100000:0.0:1788271704.424033:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590082944 00000100:00100000:0.0:1788271704.424110:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788271704.424119:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:10396:x1875138590082944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788271704.424236:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:10396:x1875138590082944:12345-0@lo:502:llog_process_th.0 Request processed in 118us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271704.424243:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788271704.424332:0:10396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f3a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10396:1875138590082944:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788271704.424360:0:10396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788271704.424370:0:10396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271704.424373:0:10396:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788271704.424380:0:10396:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f6e91513000 00000020:00000080:3.0:1788271704.424383:0:10396:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788271704.424734:0:10396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f3a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10396:1875138590083072:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271704.424774:0:10396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271704.425284:0:10396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9828e540 going to sleep for 11 seconds 00000100:00100000:1.0:1788271704.425485:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590083072 00000100:00100000:1.0:1788271704.425491:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590083072 00000100:00100000:1.0:1788271704.425525:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788271704.425541:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:10396:x1875138590083072:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271704.425670:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:10396:x1875138590083072:12345-0@lo:502:llog_process_th.0 Request processed in 130us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271704.425678:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788271704.425820:0:10396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f3a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:10396:1875138590083072:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788271704.425843:0:10396:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788271704.425849:0:10396:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271704.425851:0:10396:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788271704.425855:0:10396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788271704.426005:0:6480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788271704.426027:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788271704.426037:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079a00/0x99288105fd38e7f7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e7fe expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271704.426049:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079a00/0x99288105fd38e7f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e7fe expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271704.485044:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271705.505250:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271705.630164:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788271705.631925:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590083456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788271705.632019:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271705.632104:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590083456 00000100:00100000:2.0:1788271705.632112:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590083456 00000100:00100000:2.0:1788271705.632174:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788271705.632185:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590083456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788271705.632213:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788271705.632259:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590083456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271705.632267:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1788271705.632301:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788271705.632336:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4fb5880 x1875138590083456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271721 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271705.632356:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590083456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788271705.637067:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83252d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590083328:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788271705.637146:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271705.637199:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590083200:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788271705.637227:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271705.637309:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590083200 00000100:00100000:0.0:1788271705.637317:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590083200 00000100:00100000:0.0:1788271705.637366:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788271705.637376:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590083200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788271705.637414:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788271705.637462:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590083200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271705.637471:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788271705.637519:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590083200:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788271705.638219:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590083328 00000100:00100000:0.0:1788271705.638226:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590083328 00000100:00100000:0.0:1788271705.639260:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788271705.639271:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590083328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788271705.639308:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788271705.639378:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590083328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (2232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271705.639386:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788271705.639437:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83252d80 x1875138590083328/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271721 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271705.639457:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83252d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590083328:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788271705.640927:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788271706.532715:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271706.656595:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83250e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590083584:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788271706.656689:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271706.656774:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590083584 00000100:00100000:1.0:1788271706.656782:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590083584 00000100:00100000:1.0:1788271706.657023:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788271706.657047:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590083584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788271706.657085:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788271706.657138:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590083584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271706.657560:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788271706.657668:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83250e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590083584:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788271707.167751:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590083712:0@lo:400:kworker.0 00000100:00100000:1.0:1788271707.167853:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271707.167924:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590084224:0@lo:400:kworker.0 00000100:00100000:1.0:1788271707.167955:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271707.167976:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590084736:0@lo:400:kworker.0 00000100:00100000:1.0:1788271707.168002:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271707.168032:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788271707.168038:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875138590083840:0@lo:400:kworker.0 00000100:00100000:1.0:1788271707.168064:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271707.168083:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3606:1875138590084352:0@lo:400:kworker.0 00000100:00100000:2.0:1788271707.168231:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590085376:0@lo:400:kworker.0 00000100:00100000:1.0:1788271707.168274:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271707.174733:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271707.174827:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788271707.174846:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590085248:0@lo:400:kworker.0 00000100:00100000:2.0:1788271707.174887:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271707.174939:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590084736 00000100:00100000:2.0:1788271707.174949:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590084736 00000100:00100000:2.0:1788271707.175033:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590085376 00000100:00100000:2.0:1788271707.175037:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590085376 00000100:00100000:2.0:1788271707.175053:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590085248 00000100:00100000:2.0:1788271707.175065:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590085248 00000100:00100000:2.0:1788271707.175089:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788271707.175100:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590084736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271707.175165:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590084736:12345-0@lo:400:kworker.0 Request processed in 66us (7161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271707.175173:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788271707.175192:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788271707.175198:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfba8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590085376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271707.175233:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfba8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590085376:12345-0@lo:400:kworker.0 Request processed in 35us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271707.175240:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788271707.175252:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788271707.175258:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfba9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590085248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271707.175298:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfba9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590085248:12345-0@lo:400:kworker.0 Request processed in 40us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271707.175304:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1788271707.175353:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4fb7800 x1875138590085248/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271707.175372:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590085248:0@lo:400:kworker.0 00010000:00080000:2.0:1788271707.175386:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4fb6300 x1875138590085376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271707.175394:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590085376:0@lo:400:kworker.0 00000100:00100000:1.0:1788271707.176886:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590083968:0@lo:400:kworker.0 00000100:00100000:1.0:1788271707.176968:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271707.177012:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3608:1875138590084480:0@lo:400:kworker.0 00000100:00100000:1.0:1788271707.177038:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271707.177068:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83250e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590084992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788271707.177107:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271707.177127:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590085504:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788271707.177151:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271707.177180:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788271707.177188:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875138590084096:0@lo:400:kworker.0 00000100:00100000:1.0:1788271707.177211:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271707.177231:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590084608:0@lo:400:kworker.0 00000100:00100000:1.0:1788271707.177295:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271707.177316:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3608:1875138590085120:0@lo:400:kworker.0 00000100:00100000:1.0:1788271707.177341:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271707.177397:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590083712 00000100:00100000:1.0:1788271707.177407:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590083712 00000100:00100000:1.0:1788271707.177471:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788271707.177482:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3606:x1875138590083712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271707.177753:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3606:x1875138590083712:12345-0@lo:400:kworker.0 Request processed in 271us (9900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271707.177762:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788271707.177805:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590084224 00000100:00100000:1.0:1788271707.177811:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590084224 00000100:00100000:1.0:1788271707.177829:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590083968 00000100:00100000:1.0:1788271707.177832:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590083968 00000100:00100000:1.0:1788271707.177846:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788271707.177852:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590084224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271707.177891:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590084224:12345-0@lo:400:kworker.0 Request processed in 40us (9935us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271707.177898:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788271707.177909:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788271707.177915:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590083968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271707.177943:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590083968:12345-0@lo:400:kworker.0 Request processed in 29us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271707.177949:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788271707.177966:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590084608 00000100:00100000:1.0:1788271707.177970:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590084608 00000100:00100000:1.0:1788271707.178002:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788271707.178009:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590084608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271707.178041:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590084608:12345-0@lo:400:kworker.0 Request processed in 33us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271707.178058:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788271707.178079:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590083840 00000100:00100000:1.0:1788271707.178083:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590083840 00000100:00100000:1.0:1788271707.178159:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590084352 00000100:00100000:1.0:1788271707.178163:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590084352 00000100:00100000:1.0:1788271707.178181:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590084480 00000100:00100000:1.0:1788271707.178184:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590084480 00000100:00100000:1.0:1788271707.178196:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590084096 00000100:00100000:1.0:1788271707.178199:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590084096 00000100:00100000:1.0:1788271707.178210:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590085120 00000100:00100000:1.0:1788271707.178212:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590085120 00000100:00100000:1.0:1788271707.178226:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788271707.178233:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875138590083840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271707.178281:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875138590083840:12345-0@lo:400:kworker.0 Request processed in 48us (10215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271707.178288:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788271707.178301:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788271707.178307:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1875138590084352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271707.178337:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1875138590084352:12345-0@lo:400:kworker.0 Request processed in 30us (10062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271707.178343:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788271707.178354:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788271707.178360:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875138590084480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271707.178404:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875138590084480:12345-0@lo:400:kworker.0 Request processed in 44us (1364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271707.178411:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788271707.178423:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788271707.178435:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875138590084096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271707.178465:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875138590084096:12345-0@lo:400:kworker.0 Request processed in 31us (1254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271707.178471:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788271707.178482:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788271707.178730:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590084992 00000100:00100000:0.0:1788271707.178736:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590084992 00000100:00100000:0.0:1788271707.178765:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590085504 00000100:00100000:0.0:1788271707.178768:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590085504 00000100:00100000:0.0:1788271707.178782:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788271707.178788:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8233a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590084992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788271707.178816:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788271707.178857:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8233a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590084992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (1760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271707.178864:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788271707.178877:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788271707.178882:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590085504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788271707.178891:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788271707.178912:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590085504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 31us (1761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271707.178918:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788271707.179827:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875138590085120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271707.179887:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875138590085120:12345-0@lo:400:kworker.0 Request processed in 1399us (2544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271707.179896:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788271707.179979:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875138590084096:0@lo:400:kworker.0 00010000:00080000:1.0:1788271707.180001:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4fb6a00 x1875138590084608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271707.180014:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590084608:0@lo:400:kworker.0 00010000:00080000:1.0:1788271707.180026:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4fb4e00 x1875138590085120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271707.180035:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3608:1875138590085120:0@lo:400:kworker.0 00000100:00100000:1.0:1788271707.180050:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590083968:0@lo:400:kworker.0 00010000:00080000:1.0:1788271707.180062:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4fb7480 x1875138590084480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271707.180071:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3608:1875138590084480:0@lo:400:kworker.0 00010000:00080000:1.0:1788271707.180085:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83250e00 x1875138590084992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271723 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788271707.181791:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788271707.181803:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788271707.181808:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788271707.181838:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788271707.181922:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83250e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590084992:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788271707.181974:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4f3a300 x1875138590085504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271723 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271707.181998:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590085504:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788271707.182083:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3606:1875138590084352:0@lo:400:kworker.0 00000100:00100000:1.0:1788271707.182096:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3606:1875138590084864:0@lo:400:kworker.0 00000100:00100000:1.0:1788271707.183795:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271707.183868:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590083712:0@lo:400:kworker.0 00000100:00100000:1.0:1788271707.183884:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590084224:0@lo:400:kworker.0 00010000:00080000:1.0:1788271707.183900:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4fb5c00 x1875138590084736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271707.183912:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590084736:0@lo:400:kworker.0 00000100:00100000:1.0:1788271707.183945:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875138590083840:0@lo:400:kworker.0 00000100:00100000:1.0:1788271707.183993:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590084864 00000100:00100000:1.0:1788271707.184000:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590084864 00000100:00100000:1.0:1788271707.184090:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1788271707.184662:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271707.186333:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3606:x1875138590084864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271707.186713:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3606:1875138590084864:0@lo:400:kworker.0 00000100:00100000:1.0:1788271707.188685:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3606:x1875138590084864:12345-0@lo:400:kworker.0 Request processed in 4571us (4879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271707.188703:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00010000:0.0:1788271707.549974:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271707.574748:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271707.574879:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271707.574921:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271707.574949:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271707.574977:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271707.575015:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577440384 00000100:00100000:0.0:1788271707.575041:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577440384 00000100:00100000:1.0:1788271707.576231:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577440128 00000100:00100000:1.0:1788271707.576245:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577440128 00000100:00100000:1.0:1788271707.576335:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577440000 00000100:00100000:1.0:1788271707.576339:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577440000 00000100:00100000:1.0:1788271707.576383:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 71 00000100:00100000:1.0:1788271707.576396:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2397:x1875138577440128:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271707.576518:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2397:x1875138577440128:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 125us (1638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271707.576528:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 71 00000100:00100000:1.0:1788271707.576550:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 72 00000100:00100000:1.0:1788271707.576557:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2397:x1875138577440000:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271707.576583:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2397:x1875138577440000:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 27us (1634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271707.576590:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 72 00000100:00100000:1.0:1788271707.576616:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577440256 00000100:00100000:1.0:1788271707.576652:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577440256 00000100:00100000:0.0:1788271707.576737:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 26 00000100:00100000:0.0:1788271707.576747:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2397:x1875138577440384:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788271707.576782:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2397:x1875138577440384:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 38us (1860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271707.576790:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 26 00000100:00100000:1.0:1788271707.590038:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 27 00000100:00100000:1.0:1788271707.590079:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2397:x1875138577440256:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271707.590202:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2397:x1875138577440256:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 146us (15223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271707.590211:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 27 00000100:00080000:1.0:1788271707.590509:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788271707.590518:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788271707.590522:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788271707.590526:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788271707.590922:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577439872 00000100:00100000:3.0:1788271707.590938:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577439872 00000100:00100000:3.0:1788271707.591002:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 276 00000100:00100000:3.0:1788271707.591013:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:2397:x1875138577439872:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271707.591068:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:2397:x1875138577439872:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 57us (16335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271707.591105:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 276 00010000:00010000:2.0:1788271708.575244:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271709.598013:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788271709.698522:0:10659:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg103-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1788271710.621806:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271710.756794:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590085632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788271710.756867:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271710.757234:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590085632 00000100:00100000:3.0:1788271710.757243:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590085632 00000100:00100000:3.0:1788271710.757304:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788271710.757315:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82eced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590085632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788271710.757347:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271710.757397:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82eced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590085632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271710.757405:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1788271710.757444:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4f3a300 x1875138590085632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271726 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271710.757464:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590085632:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788271710.758388:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788271710.763898:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590085760:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788271710.763973:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271710.764033:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788271710.764041:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590085888:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788271710.764079:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271710.764138:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590085888 00000100:00100000:2.0:1788271710.764146:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590085888 00000100:00100000:2.0:1788271710.764197:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788271710.764220:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfba8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590085888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788271710.764244:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788271710.764286:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfba8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590085888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271710.764292:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1788271710.764330:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82ecce00 x1875138590085888/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271726 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271710.764348:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590085888:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788271710.764372:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788271710.769822:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590085760 00000100:00100000:1.0:1788271710.769841:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590085760 00000100:00100000:1.0:1788271710.769904:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788271710.769914:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfbabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590085760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788271710.769948:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788271710.770032:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfbabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590085760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (6059us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271710.770039:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788271710.770870:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590085760:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788271711.645857:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271711.779046:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590086016:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788271711.779134:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271711.779779:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590086016 00000100:00100000:0.0:1788271711.779797:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590086016 00000100:00100000:0.0:1788271711.779904:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788271711.779918:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590086016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788271711.779976:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788271711.780075:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590086016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 160us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271711.780083:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788271711.780243:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590086016:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788271712.286414:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfba9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590086400:0@lo:400:kworker.0 00000100:00100000:3.0:1788271712.286565:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfbab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590086144:0@lo:400:kworker.0 00000100:00100000:3.0:1788271712.286657:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271712.286722:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590086656:0@lo:400:kworker.0 00000100:00100000:3.0:1788271712.286751:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271712.286769:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590087168:0@lo:400:kworker.0 00000100:00100000:3.0:1788271712.286790:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271712.286810:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590087680:0@lo:400:kworker.0 00000100:00100000:3.0:1788271712.286828:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271712.286866:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788271712.286872:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875138590086528:0@lo:400:kworker.0 00000100:00100000:3.0:1788271712.286895:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271712.286913:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590087040:0@lo:400:kworker.0 00000100:00100000:3.0:1788271712.286932:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271712.286945:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590087552:0@lo:400:kworker.0 00000100:00100000:3.0:1788271712.286964:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271712.286993:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590087168 00000100:00100000:3.0:1788271712.287000:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590087168 00000100:00100000:3.0:1788271712.287044:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590087680 00000100:00100000:3.0:1788271712.287182:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590087680 00000100:00100000:3.0:1788271712.287202:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590087040 00000100:00100000:3.0:1788271712.287205:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590087040 00000100:00100000:3.0:1788271712.287216:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590087552 00000100:00100000:3.0:1788271712.287218:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590087552 00000100:00100000:3.0:1788271712.287232:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788271712.287241:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590087168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271712.287410:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590086144 00000100:00100000:0.0:1788271712.287414:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590086144 00000100:00100000:0.0:1788271712.287461:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788271712.287469:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3609:x1875138590086144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271712.287510:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3609:x1875138590086144:12345-0@lo:400:kworker.0 Request processed in 41us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271712.287518:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788271712.287553:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590086656 00000100:00100000:0.0:1788271712.287556:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590086656 00000100:00100000:0.0:1788271712.287581:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788271712.287587:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590086656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271712.287653:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590086656:12345-0@lo:400:kworker.0 Request processed in 66us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271712.287659:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788271712.287680:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788271712.287699:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590087680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271712.287729:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590087680:12345-0@lo:400:kworker.0 Request processed in 32us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271712.287735:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788271712.287751:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788271712.287757:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590087040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271712.287784:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590087040:12345-0@lo:400:kworker.0 Request processed in 28us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271712.287790:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788271712.287801:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788271712.287807:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590087552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271712.287831:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590087552:12345-0@lo:400:kworker.0 Request processed in 25us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271712.287837:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1788271712.287882:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4fb4a80 x1875138590087040/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271712.287897:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590087040:0@lo:400:kworker.0 00010000:00080000:0.0:1788271712.287908:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4fb5500 x1875138590087552/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271712.287915:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590087552:0@lo:400:kworker.0 00000100:00100000:0.0:1788271712.287932:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfbab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590086144:0@lo:400:kworker.0 00000100:00100000:0.0:1788271712.287942:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590086656:0@lo:400:kworker.0 00010000:00080000:0.0:1788271712.287951:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4fb4e00 x1875138590087680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271712.287959:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590087680:0@lo:400:kworker.0 00000100:00100000:0.0:1788271712.288006:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590086528 00000100:00100000:0.0:1788271712.288010:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590086528 00000100:00100000:0.0:1788271712.288039:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788271712.288045:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875138590086528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271712.288096:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875138590086528:12345-0@lo:400:kworker.0 Request processed in 50us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271712.288103:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788271712.288135:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875138590086528:0@lo:400:kworker.0 00000100:00100000:3.0:1788271712.288794:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590087168:12345-0@lo:400:kworker.0 Request processed in 1551us (2000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271712.288802:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788271712.288834:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788271712.288839:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788271712.288956:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271712.288993:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3607:1875138590086912:0@lo:400:kworker.0 00000100:00100000:2.0:1788271712.289018:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271712.289037:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3607:1875138590087424:0@lo:400:kworker.0 00000100:00100000:2.0:1788271712.289138:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271712.289163:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788271712.289170:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfba8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875138590086272:0@lo:400:kworker.0 00000100:00100000:2.0:1788271712.289203:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271712.289220:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3607:1875138590086784:0@lo:400:kworker.0 00000100:00100000:2.0:1788271712.289242:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271712.289259:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3607:1875138590087296:0@lo:400:kworker.0 00000100:00100000:1.0:1788271712.289432:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590086912 00000100:00100000:1.0:1788271712.289438:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590086912 00000100:00100000:1.0:1788271712.289470:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590087424 00000100:00100000:1.0:1788271712.289472:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590087424 00000100:00100000:1.0:1788271712.289485:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590086272 00000100:00100000:1.0:1788271712.289487:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590086272 00000100:00100000:1.0:1788271712.289496:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590086784 00000100:00100000:1.0:1788271712.289498:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590086784 00000100:00100000:1.0:1788271712.289511:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788271712.289519:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4fb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875138590086912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271712.289558:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4fb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875138590086912:12345-0@lo:400:kworker.0 Request processed in 41us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271712.289564:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788271712.289577:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788271712.289583:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4fb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875138590087424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271712.289608:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4fb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875138590087424:12345-0@lo:400:kworker.0 Request processed in 26us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271712.289613:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788271712.289641:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788271712.289648:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4fb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875138590086272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271712.289673:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4fb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875138590086272:12345-0@lo:400:kworker.0 Request processed in 26us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271712.289699:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788271712.289712:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788271712.289719:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875138590086784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271712.289747:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875138590086784:12345-0@lo:400:kworker.0 Request processed in 30us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271712.289753:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788271712.289806:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ecf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590087808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788271712.289829:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788271712.290028:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788271712.290032:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788271712.290040:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590086400 00000100:00100000:3.0:1788271712.290043:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590086400 00000100:00100000:3.0:1788271712.290501:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788271712.290509:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590086400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271712.290550:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590086400:12345-0@lo:400:kworker.0 Request processed in 42us (1594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271712.290564:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788271712.290614:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590087808 00000100:00100000:3.0:1788271712.290636:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590087808 00000100:00100000:3.0:1788271712.290661:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788271712.290667:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590087808:12345-0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788271712.290817:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4fb5880 x1875138590087168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271712.290831:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590087168:0@lo:400:kworker.0 00000100:00100000:2.0:1788271712.290912:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271712.290948:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfba9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590086400:0@lo:400:kworker.0 00010000:00080000:2.0:1788271712.290960:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4fb5c00 x1875138590086912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271712.290967:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3607:1875138590086912:0@lo:400:kworker.0 00010000:00080000:2.0:1788271712.290976:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4fb7480 x1875138590087424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271712.290983:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3607:1875138590087424:0@lo:400:kworker.0 00000100:00100000:2.0:1788271712.291002:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590087936:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788271712.291029:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271712.291793:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590087296 00000100:00100000:0.0:1788271712.291801:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590087296 00000100:00100000:0.0:1788271712.291857:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788271712.291865:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4fb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875138590087296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271712.291930:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4fb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875138590087296:12345-0@lo:400:kworker.0 Request processed in 65us (2650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271712.291937:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788271712.292149:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfba8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875138590086272:0@lo:400:kworker.0 00000100:00100000:2.0:1788271712.292169:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3607:1875138590086784:0@lo:400:kworker.0 00000100:00100000:2.0:1788271712.292199:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3607:1875138590087296:0@lo:400:kworker.0 00000100:00100000:2.0:1788271712.292228:0:8399:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788271712.292234:0:8399:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:3.0:1788271712.292370:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271712.292418:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590087808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1751us (2587us total) trans 0 rc 0/0 00000100:00080000:1.0:1788271712.292785:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788271712.293160:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788271712.293193:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590087936 00000100:00100000:3.0:1788271712.293197:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590087936 00000100:00100000:3.0:1788271712.293223:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788271712.293230:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4fb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590087936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788271712.293250:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:2.0:1788271712.293407:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82ecf800 x1875138590087808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271728 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271712.294393:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ecf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590087808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788271712.296871:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4fb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590087936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3629us (5828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271712.296888:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1788271712.297008:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb0c61c00 x1875138590087936/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271728 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271712.297030:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590087936:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788271712.671477:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271712.684562:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271712.684648:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271712.684779:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577440512 00000100:00100000:2.0:1788271712.684789:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577440512 00000100:00100000:2.0:1788271712.684845:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 278 00000100:00100000:2.0:1788271712.684856:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:2395:x1875138577440512:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788271712.684927:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:2395:x1875138577440512:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 73us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271712.684934:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 278 00000100:00100000:3.0:1788271712.685656:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577440640 00000100:00100000:3.0:1788271712.685663:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577440640 00000100:00100000:3.0:1788271712.685795:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 79 00000100:00100000:3.0:1788271712.685805:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2395:x1875138577440640:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271712.685858:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2395:x1875138577440640:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 55us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271712.685864:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 79 00000100:00080000:0.0:1788271712.686884:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788271712.691478:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271712.691536:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271712.691576:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271712.691608:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577440896 00000100:00100000:0.0:1788271712.691639:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577440896 00000100:00100000:0.0:1788271712.691698:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577441024 00000100:00100000:0.0:1788271712.691702:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577441024 00000100:00100000:0.0:1788271712.691728:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 32 00000100:00100000:0.0:1788271712.691739:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2396:x1875138577440896:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788271712.691810:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2396:x1875138577440896:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 74us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271712.691818:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 32 00000100:00100000:0.0:1788271712.691833:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 33 00000100:00100000:0.0:1788271712.691839:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfba9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2396:x1875138577441024:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788271712.691863:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfba9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2396:x1875138577441024:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 24us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271712.691870:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 33 00000100:00080000:0.0:1788271712.691887:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788271712.691891:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788271712.692155:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577440768 00000100:00100000:3.0:1788271712.692160:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577440768 00000100:00100000:3.0:1788271712.692230:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 80 00000100:00100000:3.0:1788271712.692237:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2396:x1875138577440768:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271712.692276:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfba8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2396:x1875138577440768:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 39us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271712.692283:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 80 00000100:00080000:0.0:1788271712.692401:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788271713.705416:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271714.717881:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788271715.115822:0:10904:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg103-server.virtnet: executing yml_node 00010000:00010000:0.0:1788271715.741790:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271715.869804:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590088064:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788271715.869879:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271715.869952:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590088064 00000100:00100000:3.0:1788271715.869959:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590088064 00000100:00100000:3.0:1788271715.870007:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788271715.870017:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590088064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788271715.870051:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788271715.870096:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590088064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271715.870103:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788271715.870165:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590088064:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788271715.872907:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590088192:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788271715.872980:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271715.873049:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590088192 00000100:00100000:3.0:1788271715.873056:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590088192 00000100:00100000:3.0:1788271715.873123:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788271715.873134:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83276a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590088192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788271715.873164:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271715.873207:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83276a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590088192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271715.873224:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1788271715.873245:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788271715.873274:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb0c60000 x1875138590088192/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271731 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271715.873292:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590088192:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788271715.876125:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590088320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788271715.876200:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271715.878027:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590088320 00000100:00100000:3.0:1788271715.878043:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590088320 00000100:00100000:3.0:1788271715.878124:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788271715.878135:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590088320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788271715.878169:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271715.878263:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590088320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (2062us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271715.878270:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1788271715.878293:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788271715.878324:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4fb4380 x1875138590088320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271731 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271715.878346:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590088320:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788271716.769020:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271716.896200:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788271716.898789:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590088448:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788271716.898885:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271716.899217:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590088448 00000100:00100000:3.0:1788271716.899228:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590088448 00000100:00100000:3.0:1788271716.899292:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788271716.899302:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590088448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788271716.899344:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788271716.899408:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590088448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271716.899416:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788271716.899538:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590088448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788271717.405980:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875138590088960:0@lo:400:kworker.0 00000100:00100000:2.0:1788271717.406054:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271717.406140:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590089472:0@lo:400:kworker.0 00000100:00100000:2.0:1788271717.406176:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271717.406199:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590089984:0@lo:400:kworker.0 00000100:00100000:2.0:1788271717.406222:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271717.406257:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788271717.406263:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590088832:0@lo:400:kworker.0 00000100:00100000:2.0:1788271717.406289:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271717.406306:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3f66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3607:1875138590089344:0@lo:400:kworker.0 00000100:00100000:2.0:1788271717.406329:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271717.406346:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3f65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3607:1875138590089856:0@lo:400:kworker.0 00000100:00100000:2.0:1788271717.406365:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271717.406393:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590088960 00000100:00100000:2.0:1788271717.406401:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590088960 00000100:00100000:2.0:1788271717.406439:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590089344 00000100:00100000:2.0:1788271717.406442:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590089344 00000100:00100000:2.0:1788271717.406461:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590089856 00000100:00100000:2.0:1788271717.406464:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590089856 00000100:00100000:2.0:1788271717.406478:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788271717.406486:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875138590088960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271717.406538:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875138590088960:12345-0@lo:400:kworker.0 Request processed in 53us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271717.406546:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788271717.406562:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788271717.406568:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3f66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875138590089344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271717.406595:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3f66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875138590089344:12345-0@lo:400:kworker.0 Request processed in 28us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271717.406600:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788271717.406611:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788271717.406616:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875138590089856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271717.406663:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875138590089856:12345-0@lo:400:kworker.0 Request processed in 47us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271717.406679:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:2.0:1788271717.406716:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb3f66680 x1875138590089344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271717.406730:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3f66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3607:1875138590089344:0@lo:400:kworker.0 00010000:00080000:2.0:1788271717.406740:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb3f65500 x1875138590089856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271717.406747:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3f65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3607:1875138590089856:0@lo:400:kworker.0 00000100:00100000:2.0:1788271717.406755:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875138590088960:0@lo:400:kworker.0 00000100:00100000:0.0:1788271717.407113:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875138590088704:0@lo:400:kworker.0 00000100:00100000:0.0:1788271717.407148:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271717.407245:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788271717.407253:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3f65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590090368:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788271717.407279:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271717.407327:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590089472 00000100:00100000:2.0:1788271717.407332:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590089472 00000100:00100000:2.0:1788271717.407362:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590089984 00000100:00100000:2.0:1788271717.407366:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590089984 00000100:00100000:2.0:1788271717.407387:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788271717.407394:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebcb80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590089472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271717.407434:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebcb80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590089472:12345-0@lo:400:kworker.0 Request processed in 40us (1257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271717.407441:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788271717.407585:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788271717.407592:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590089984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271717.407637:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590089984:12345-0@lo:400:kworker.0 Request processed in 46us (1414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271717.407655:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1788271717.407694:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb3f67480 x1875138590089472/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271717.407706:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590089472:0@lo:400:kworker.0 00010000:00080000:2.0:1788271717.407716:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb3f64380 x1875138590089984/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271717.407725:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590089984:0@lo:400:kworker.0 00000100:00100000:0.0:1788271717.407820:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3609:1875138590089216:0@lo:400:kworker.0 00000100:00100000:0.0:1788271717.407847:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271717.407940:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590088576:0@lo:400:kworker.0 00000100:00100000:3.0:1788271717.407976:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271717.408001:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590089088:0@lo:400:kworker.0 00000100:00100000:3.0:1788271717.408025:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271717.408044:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590089600:0@lo:400:kworker.0 00000100:00100000:3.0:1788271717.408065:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271717.408093:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590090112:0@lo:400:kworker.0 00000100:00100000:3.0:1788271717.408117:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271717.408187:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590088576 00000100:00100000:2.0:1788271717.408193:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590088576 00000100:00100000:2.0:1788271717.408223:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788271717.408230:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3608:x1875138590088576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271717.408267:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3608:x1875138590088576:12345-0@lo:400:kworker.0 Request processed in 37us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271717.408273:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788271717.408312:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590090368 00000100:00100000:2.0:1788271717.408316:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590090368 00000100:00100000:2.0:1788271717.408340:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788271717.408346:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3f66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590090368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788271717.408371:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788271717.408408:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3f66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590090368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271717.408415:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1788271717.408431:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788271717.408435:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788271717.408438:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788271717.408660:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3f67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3609:1875138590089728:0@lo:400:kworker.0 00000100:00100000:0.0:1788271717.408688:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271717.413275:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590088704 00000100:00100000:1.0:1788271717.413292:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590088704 00000100:00100000:1.0:1788271717.413363:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590089216 00000100:00100000:1.0:1788271717.413367:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590089216 00000100:00100000:1.0:1788271717.413411:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788271717.413422:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfbab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875138590088704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271717.413518:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfbab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875138590088704:12345-0@lo:400:kworker.0 Request processed in 98us (6369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271717.413525:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788271717.413544:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788271717.413550:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfbab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875138590089216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271717.413603:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfbab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875138590089216:12345-0@lo:400:kworker.0 Request processed in 53us (5755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271717.413609:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1788271717.413647:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271717.413697:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590089600 00000100:00100000:1.0:1788271717.413702:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590089600 00000100:00100000:1.0:1788271717.413734:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590090112 00000100:00100000:1.0:1788271717.413738:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590090112 00000100:00100000:1.0:1788271717.413753:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788271717.413759:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83277100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590089600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271717.413790:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83277100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590089600:12345-0@lo:400:kworker.0 Request processed in 32us (5725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271717.413796:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788271717.413807:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788271717.413812:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83275500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590090112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271717.413839:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83275500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590090112:12345-0@lo:400:kworker.0 Request processed in 27us (5721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271717.413844:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788271717.413871:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590088832 00000100:00100000:1.0:1788271717.413875:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590088832 00000100:00100000:1.0:1788271717.413892:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590089088 00000100:00100000:1.0:1788271717.413895:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590089088 00000100:00100000:1.0:1788271717.413908:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788271717.413914:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3f64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590088832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271717.413951:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3f64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590088832:12345-0@lo:400:kworker.0 Request processed in 38us (7661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271717.413957:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788271717.413976:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788271717.413983:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83275880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590089088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271717.414012:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83275880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590089088:12345-0@lo:400:kworker.0 Request processed in 31us (5987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271717.414017:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1788271717.414031:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788271717.414034:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788271717.414118:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb3f65500 x1875138590090368/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271733 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271717.414143:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3f65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590090368:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788271717.414157:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590088832:0@lo:400:kworker.0 00000100:00100000:1.0:1788271717.414204:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590088576:0@lo:400:kworker.0 00000100:00100000:1.0:1788271717.414216:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590089088:0@lo:400:kworker.0 00010000:00080000:1.0:1788271717.414227:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb3f65f80 x1875138590089600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271717.414236:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590089600:0@lo:400:kworker.0 00010000:00080000:1.0:1788271717.414248:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb3f67100 x1875138590090112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271717.414257:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590090112:0@lo:400:kworker.0 00000100:00100000:0.0:1788271717.418828:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590090240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788271717.418899:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271717.418969:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875138590088704:0@lo:400:kworker.0 00000100:00100000:0.0:1788271717.418984:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3609:1875138590089216:0@lo:400:kworker.0 00000100:00100000:0.0:1788271717.419044:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590090240 00000100:00100000:0.0:1788271717.419052:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590090240 00000100:00100000:0.0:1788271717.419116:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788271717.419127:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfba9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590090240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788271717.419150:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788271717.419190:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfba9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590090240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271717.419197:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1788271717.419234:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82ecea00 x1875138590090240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271733 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271717.419251:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590090240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788271717.419354:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590089728 00000100:00100000:1.0:1788271717.419359:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590089728 00000100:00100000:1.0:1788271717.419408:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788271717.419415:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875138590089728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271717.419471:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfba9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875138590089728:12345-0@lo:400:kworker.0 Request processed in 57us (10782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271717.419478:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1788271717.419606:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788271717.419665:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3f67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3609:1875138590089728:0@lo:400:kworker.0 00010000:00010000:1.0:1788271717.789873:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271717.798106:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271717.798163:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271717.798334:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577441280 00000100:00100000:1.0:1788271717.798350:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577441280 00000100:00100000:1.0:1788271717.798455:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 87 00000100:00100000:1.0:1788271717.798466:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfbaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2396:x1875138577441280:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271717.798568:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfbaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2396:x1875138577441280:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 104us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271717.798576:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 87 00000100:00080000:0.0:1788271717.798705:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788271717.798894:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577441152 00000100:00100000:2.0:1788271717.798900:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577441152 00000100:00100000:2.0:1788271717.798944:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 280 00000100:00100000:2.0:1788271717.798956:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:2396:x1875138577441152:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788271717.798999:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:2396:x1875138577441152:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 44us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271717.799009:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 280 00000100:00100000:0.0:1788271717.805468:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271717.805650:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577441408 00000100:00100000:3.0:1788271717.805666:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577441408 00000100:00100000:3.0:1788271717.805762:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 88 00000100:00100000:3.0:1788271717.805775:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2397:x1875138577441408:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271717.805899:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfba8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2397:x1875138577441408:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 127us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271717.805918:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 88 00000100:00080000:0.0:1788271717.806112:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788271717.815729:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271717.815770:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271717.815916:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577441536 00000100:00100000:2.0:1788271717.815927:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577441536 00000100:00100000:2.0:1788271717.815992:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577441664 00000100:00100000:2.0:1788271717.815995:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577441664 00000100:00100000:2.0:1788271717.816016:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 18 00000100:00100000:2.0:1788271717.816025:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83275f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2394:x1875138577441536:12345-192.168.201.3@tcp:9:kworker.0 00000020:00000080:2.0:1788271717.816063:0:8398:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e710 00000100:00080000:2.0:1788271717.816074:0:8398:0:(import.c:65:import_set_state_nolock()) ffff8f6d81dd3000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788271717.816154:0:8398:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788271717.816314:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83275f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+2:2394:x1875138577441536:12345-192.168.201.3@tcp:9:kworker.0 Request processed in 288us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271717.816322:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 18 00000100:00080000:0.0:1788271717.817520:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788271717.817527:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788271717.829449:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 19 00000100:00100000:0.0:1788271717.829480:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83276680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2394:x1875138577441664:12345-192.168.201.3@tcp:9:kworker.0 00000020:00000080:0.0:1788271717.829521:0:8397:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e717 00000100:00080000:0.0:1788271717.831469:0:8397:0:(import.c:65:import_set_state_nolock()) ffff8f6d81dd6800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788271717.831546:0:8397:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788271717.831737:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83276680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+2:2394:x1875138577441664:12345-192.168.201.3@tcp:9:kworker.0 Request processed in 2270us (15961us total) trans 0 rc 0/0 00010000:00010000:2.0:1788271717.832594:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271717.832826:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271717.835013:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 19 00010000:00010000:2.0:1788271718.815431:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788271719.433782:0:11087:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.64 00010000:00010000:1.0:1788271719.838180:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271720.865306:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271720.990338:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788271720.990367:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590090624:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788271720.990453:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271720.990654:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83275c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590090496:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788271720.990666:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590090624 00000100:00100000:3.0:1788271720.990676:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590090624 00000100:00100000:1.0:1788271720.990694:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271720.990728:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590090496 00000100:00100000:2.0:1788271720.990734:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590090496 00000100:00100000:1.0:1788271720.990745:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788271720.990755:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788271720.990757:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590090752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788271720.990770:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590090624:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788271720.990785:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:3.0:1788271720.990819:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788271720.990863:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590090624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271720.990871:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1788271720.990923:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788271720.990935:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590090752 00000100:00100000:0.0:1788271720.990940:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590090752 00000100:00080000:1.0:1788271720.991007:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788271720.991009:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788271720.991029:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ece680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590090496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788271720.991052:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788271720.991066:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590090624:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788271720.991112:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ece680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590090496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271720.991120:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1788271720.991127:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83275c00 x1875138590090496/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271736 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271720.991142:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83275c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590090496:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788271720.993908:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788271720.993929:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590090752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788271720.993956:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788271720.994050:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590090752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (3264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271720.994071:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1788271720.997310:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb3f64380 x1875138590090752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271736 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271720.997340:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3f64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590090752:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788271721.867603:0:11185:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.64 00010000:00010000:3.0:1788271721.885848:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271722.016060:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788271722.016083:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590090880:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788271722.016151:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271722.016221:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590090880 00000100:00100000:2.0:1788271722.016228:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590090880 00000100:00100000:2.0:1788271722.017382:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788271722.017398:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590090880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788271722.017432:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788271722.017487:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590090880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (1335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271722.017494:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788271722.017544:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590090880:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788271722.525860:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788271722.525895:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590091008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788271722.525969:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271722.526045:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875138590091392:0@lo:400:kworker.0 00000100:00100000:2.0:1788271722.526072:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271722.526100:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590091904:0@lo:400:kworker.0 00000100:00100000:2.0:1788271722.526125:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271722.526139:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590091392 00000100:00100000:2.0:1788271722.526142:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590092416:0@lo:400:kworker.0 00000100:00100000:0.0:1788271722.526148:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590091392 00000100:00100000:2.0:1788271722.526161:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271722.526176:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788271722.526181:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590091520:0@lo:400:kworker.0 00000100:00100000:0.0:1788271722.526200:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788271722.526209:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1875138590091392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271722.526211:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271722.526227:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590092032:0@lo:400:kworker.0 00000100:00100000:2.0:1788271722.526244:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271722.526256:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1875138590091392:12345-0@lo:400:kworker.0 Request processed in 48us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271722.526262:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788271722.526275:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875138590091392:0@lo:400:kworker.0 00000100:00100000:2.0:1788271722.526302:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590091008 00000100:00100000:2.0:1788271722.526305:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590091008 00000100:00100000:2.0:1788271722.526351:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788271722.526358:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590091008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788271722.526382:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788271722.526418:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590091008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271722.526424:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788271722.526441:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590091904 00000100:00100000:2.0:1788271722.526444:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590091904 00000100:00100000:2.0:1788271722.526465:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590092416 00000100:00100000:2.0:1788271722.526467:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590092416 00000100:00100000:2.0:1788271722.526478:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590092032 00000100:00100000:2.0:1788271722.526481:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590092032 00000100:00100000:2.0:1788271722.526493:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788271722.526499:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3f65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590091904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271722.526529:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3f65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590091904:12345-0@lo:400:kworker.0 Request processed in 30us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271722.526535:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788271722.526547:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788271722.526552:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3f65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590092416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271722.526578:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3f65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590092416:12345-0@lo:400:kworker.0 Request processed in 26us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271722.526590:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788271722.526602:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788271722.526607:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3f67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590092032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271722.526653:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3f67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590092032:12345-0@lo:400:kworker.0 Request processed in 45us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271722.526658:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1788271722.526675:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788271722.526677:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590091520 00000100:00100000:2.0:1788271722.526680:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590091520 00000100:00080000:0.0:1788271722.526680:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788271722.526714:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788271722.526720:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590091520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271722.526752:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590091520:12345-0@lo:400:kworker.0 Request processed in 32us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271722.526758:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788271722.526787:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590091520:0@lo:400:kworker.0 00010000:00080000:2.0:1788271722.526799:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82ec4a80 x1875138590092032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271722.526808:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590092032:0@lo:400:kworker.0 00010000:00080000:2.0:1788271722.526816:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82ec4700 x1875138590091904/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271722.526824:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590091904:0@lo:400:kworker.0 00010000:00080000:2.0:1788271722.526832:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82ec6d80 x1875138590092416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271722.526840:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590092416:0@lo:400:kworker.0 00010000:00080000:2.0:1788271722.526861:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb3f67480 x1875138590091008/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271738 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271722.526874:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590091008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788271722.526963:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590091136:0@lo:400:kworker.0 00000100:00100000:1.0:1788271722.527007:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271722.527039:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3608:1875138590091648:0@lo:400:kworker.0 00000100:00100000:1.0:1788271722.527060:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271722.527086:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3608:1875138590092160:0@lo:400:kworker.0 00000100:00100000:1.0:1788271722.527107:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271722.527127:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590091648 00000100:00100000:1.0:1788271722.527128:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788271722.527131:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590091648 00000100:00100000:1.0:1788271722.527133:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875138590091264:0@lo:400:kworker.0 00000100:00100000:1.0:1788271722.527154:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271722.527157:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590092160 00000100:00100000:0.0:1788271722.527159:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590092160 00000100:00100000:1.0:1788271722.527164:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3608:1875138590091776:0@lo:400:kworker.0 00000100:00100000:0.0:1788271722.527171:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590091264 00000100:00100000:0.0:1788271722.527173:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590091264 00000100:00100000:1.0:1788271722.527181:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271722.527183:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788271722.527189:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875138590091648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271722.527190:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3608:1875138590092288:0@lo:400:kworker.0 00000100:00100000:1.0:1788271722.527207:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271722.527215:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875138590091648:12345-0@lo:400:kworker.0 Request processed in 27us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271722.527221:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788271722.527222:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3608:1875138590091648:0@lo:400:kworker.0 00000100:00100000:0.0:1788271722.527229:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590091776 00000100:00100000:0.0:1788271722.527232:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590091776 00000100:00100000:1.0:1788271722.527242:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590092288 00000100:00100000:1.0:1788271722.527245:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590092288 00000100:00100000:0.0:1788271722.527246:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788271722.527250:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875138590092160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271722.527263:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788271722.527269:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875138590091264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271722.527280:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875138590092160:12345-0@lo:400:kworker.0 Request processed in 30us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271722.527286:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788271722.527294:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875138590091264:12345-0@lo:400:kworker.0 Request processed in 25us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271722.527299:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788271722.527303:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788271722.527307:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788271722.527308:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875138590091776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271722.527312:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875138590092288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271722.527334:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875138590091776:12345-0@lo:400:kworker.0 Request processed in 26us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271722.527339:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875138590092288:12345-0@lo:400:kworker.0 Request processed in 27us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271722.527339:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788271722.527344:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:0.0:1788271722.527352:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788271722.527355:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271722.527405:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875138590091264:0@lo:400:kworker.0 00010000:00080000:1.0:1788271722.527414:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82ec5880 x1875138590091776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271722.527422:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3608:1875138590091776:0@lo:400:kworker.0 00010000:00080000:1.0:1788271722.527431:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82ec4000 x1875138590092288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271722.527438:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3608:1875138590092288:0@lo:400:kworker.0 00000100:00100000:1.0:1788271722.527447:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3608:1875138590092160:0@lo:400:kworker.0 00000100:00100000:0.0:1788271722.527453:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788271722.527460:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590092544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788271722.527501:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590091136 00000100:00100000:2.0:1788271722.527505:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590091136 00000100:00100000:2.0:1788271722.527536:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788271722.527542:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3608:x1875138590091136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271722.527577:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3608:x1875138590091136:12345-0@lo:400:kworker.0 Request processed in 35us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271722.527583:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788271722.527611:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271722.527612:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfba8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590091136:0@lo:400:kworker.0 00000100:00100000:0.0:1788271722.527726:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590092544 00000100:00100000:0.0:1788271722.527731:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590092544 00000100:00100000:0.0:1788271722.527759:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788271722.527766:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590092544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788271722.527776:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788271722.530207:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590092544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2428us (2582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271722.530223:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1788271722.531165:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82ecd880 x1875138590092544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271738 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271722.531194:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ecd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590092544:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788271722.911162:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271722.926846:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271722.926910:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271722.926943:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271722.926979:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577441792 00000100:00100000:1.0:1788271722.926999:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577441792 00000100:00100000:3.0:1788271722.927026:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577441920 00000100:00100000:3.0:1788271722.927030:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577441920 00000100:00100000:1.0:1788271722.927056:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 282 00000100:00100000:1.0:1788271722.927067:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:2397:x1875138577441792:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271722.927070:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577442048 00000100:00100000:3.0:1788271722.927073:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577442048 00000100:00100000:3.0:1788271722.927096:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 95 00000100:00100000:3.0:1788271722.927103:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2398:x1875138577441920:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271722.927138:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2398:x1875138577441920:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 36us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271722.927146:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 95 00000100:00100000:3.0:1788271722.927165:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 96 00000100:00100000:3.0:1788271722.927172:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2397:x1875138577442048:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271722.927532:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:2397:x1875138577441792:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 466us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271722.927539:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 282 00000100:00080000:1.0:1788271722.928450:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788271722.928456:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788271722.930458:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2397:x1875138577442048:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 3275us (3504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271722.930473:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 96 00010000:00010000:1.0:1788271723.934655:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788271724.066163:0:8391:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ef8df183-a1b1-4e56-bce5-924a894c4a71 00000020:00000080:2.0:1788271724.066173:0:8391:0:(genops.c:885:class_export_put()) final put ffff8f6d81dd6000/ef8df183-a1b1-4e56-bce5-924a894c4a71 00000020:00000080:2.0:1788271724.066209:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6d81dd6000/ef8df183-a1b1-4e56-bce5-924a894c4a71 for lustre-OST0000 00000020:00000080:2.0:1788271724.066281:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f6d81dd3000 for lustre-OST0000 00000001:00100000:3.0:1788271724.077215:0:9475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ef8df183-a1b1-4e56-bce5-924a894c4a71 00000020:00000080:3.0:1788271724.077223:0:9475:0:(genops.c:885:class_export_put()) final put ffff8f6d81dd2800/ef8df183-a1b1-4e56-bce5-924a894c4a71 00000020:00000080:1.0:1788271724.077276:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6d81dd2800/ef8df183-a1b1-4e56-bce5-924a894c4a71 for lustre-OST0001 00000020:00000080:1.0:1788271724.077323:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f6d81dd6800 for lustre-OST0001 00000001:02000400:1.0:1788271724.433048:0:11282:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.64 00010000:00010000:2.0:1788271724.957907:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271725.984057:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271726.112332:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83277480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590092672:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788271726.112401:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271726.112472:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590092672 00000100:00100000:3.0:1788271726.112479:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590092672 00000100:00100000:3.0:1788271726.112532:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788271726.112542:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83277b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590092672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788271726.112582:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271726.112641:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83277b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590092672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271726.112649:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1788271726.112670:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788271726.112700:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83277480 x1875138590092672/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271742 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271726.112718:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83277480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590092672:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788271726.113911:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590092800:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788271726.113977:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271726.114029:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590092800 00000100:00100000:3.0:1788271726.114036:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590092800 00000100:00100000:3.0:1788271726.114077:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788271726.114086:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83277480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590092800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788271726.114121:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788271726.114163:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83277480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590092800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271726.114170:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788271726.114211:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590092800:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788271726.117090:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590092928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788271726.117153:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271726.117217:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590092928 00000100:00100000:2.0:1788271726.117225:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590092928 00000100:00100000:2.0:1788271726.117281:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788271726.117290:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3f66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590092928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788271726.117313:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788271726.117361:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3f66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590092928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271726.117369:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1788271726.117387:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788271726.117412:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb3f67480 x1875138590092928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271742 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271726.117432:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590092928:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788271726.157286:0:11330:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 1 10:08:44 EDT 2026 00010000:00010000:2.0:1788271727.006027:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271727.136855:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590093056:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788271727.136944:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271727.137497:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590093056 00000100:00100000:2.0:1788271727.137506:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590093056 00000100:00100000:2.0:1788271727.137563:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788271727.137572:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ec5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590093056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788271727.137606:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788271727.137684:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ec5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590093056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271727.137692:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788271727.137738:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590093056:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788271727.647017:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875138590093440:0@lo:400:kworker.0 00000100:00100000:0.0:1788271727.647122:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271727.647181:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590093952:0@lo:400:kworker.0 00000100:00100000:0.0:1788271727.647208:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271727.647230:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590094464:0@lo:400:kworker.0 00000100:00100000:0.0:1788271727.647265:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271727.647294:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788271727.647300:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590093568:0@lo:400:kworker.0 00000100:00100000:0.0:1788271727.647323:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271727.647339:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590094080:0@lo:400:kworker.0 00000100:00100000:0.0:1788271727.647375:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271727.647393:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590094592:0@lo:400:kworker.0 00000100:00100000:0.0:1788271727.647417:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271727.647448:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590093440 00000100:00100000:0.0:1788271727.647455:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590093440 00000100:00100000:0.0:1788271727.647499:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788271727.647508:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1875138590093440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271727.647556:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ec4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1875138590093440:12345-0@lo:400:kworker.0 Request processed in 48us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271727.647563:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788271727.647585:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590093952 00000100:00100000:0.0:1788271727.647588:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590093952 00000100:00100000:0.0:1788271727.647605:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590094464 00000100:00100000:0.0:1788271727.647607:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590094464 00000100:00100000:0.0:1788271727.648761:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590094080 00000100:00100000:0.0:1788271727.648769:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590094080 00000100:00100000:0.0:1788271727.648784:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590094592 00000100:00100000:0.0:1788271727.648786:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590094592 00000100:00100000:0.0:1788271727.648800:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788271727.648808:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590093952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271727.648860:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590093952:12345-0@lo:400:kworker.0 Request processed in 53us (1651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271727.648868:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788271727.648888:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788271727.648894:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590094464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271727.648938:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590094464:12345-0@lo:400:kworker.0 Request processed in 44us (1672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271727.648944:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788271727.648955:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788271727.648961:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590094080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271727.648988:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590094080:12345-0@lo:400:kworker.0 Request processed in 27us (1612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271727.648993:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788271727.649004:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788271727.649010:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590094592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271727.649037:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590094592:12345-0@lo:400:kworker.0 Request processed in 27us (1619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271727.649043:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1788271727.650236:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82ec6300 x1875138590094080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271727.650252:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590094080:0@lo:400:kworker.0 00010000:00080000:0.0:1788271727.650266:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82ec6d80 x1875138590094592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271727.650274:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590094592:0@lo:400:kworker.0 00000100:00100000:0.0:1788271727.650287:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875138590093440:0@lo:400:kworker.0 00010000:00080000:0.0:1788271727.650297:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82ec7800 x1875138590093952/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271727.650326:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590093952:0@lo:400:kworker.0 00010000:00080000:0.0:1788271727.650338:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82ec7100 x1875138590094464/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271727.650346:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590094464:0@lo:400:kworker.0 00000100:00100000:3.0:1788271727.650501:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590093184:0@lo:400:kworker.0 00000100:00100000:3.0:1788271727.650558:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271727.650597:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3608:1875138590093696:0@lo:400:kworker.0 00000100:00100000:3.0:1788271727.650652:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271727.650672:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3608:1875138590094208:0@lo:400:kworker.0 00000100:00100000:3.0:1788271727.650702:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271727.650724:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788271727.650730:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875138590093312:0@lo:400:kworker.0 00000100:00100000:3.0:1788271727.650750:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271727.650766:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3608:1875138590093824:0@lo:400:kworker.0 00000100:00100000:3.0:1788271727.650784:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271727.650797:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3608:1875138590094336:0@lo:400:kworker.0 00000100:00100000:3.0:1788271727.650813:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271727.650886:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590093184 00000100:00100000:3.0:1788271727.650892:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590093184 00000100:00100000:3.0:1788271727.650937:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788271727.650945:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3608:x1875138590093184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271727.650990:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3608:x1875138590093184:12345-0@lo:400:kworker.0 Request processed in 45us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271727.650997:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788271727.651027:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590093696 00000100:00100000:3.0:1788271727.651031:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590093696 00000100:00100000:3.0:1788271727.651051:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590094208 00000100:00100000:3.0:1788271727.651053:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590094208 00000100:00100000:3.0:1788271727.651063:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590093312 00000100:00100000:3.0:1788271727.651065:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590093312 00000100:00100000:3.0:1788271727.651075:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590093824 00000100:00100000:3.0:1788271727.651077:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590093824 00000100:00100000:3.0:1788271727.651099:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590094336 00000100:00100000:3.0:1788271727.651102:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590094336 00000100:00100000:3.0:1788271727.651114:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788271727.651120:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83274380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875138590093696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271727.651151:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83274380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875138590093696:12345-0@lo:400:kworker.0 Request processed in 31us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271727.651163:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788271727.651177:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788271727.651183:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83275c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875138590094208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271727.651211:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83275c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875138590094208:12345-0@lo:400:kworker.0 Request processed in 28us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271727.651216:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788271727.651226:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788271727.651231:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875138590093312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271727.651255:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875138590093312:12345-0@lo:400:kworker.0 Request processed in 24us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271727.651260:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788271727.651269:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788271727.651274:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875138590093824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271727.651299:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875138590093824:12345-0@lo:400:kworker.0 Request processed in 25us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271727.651304:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788271727.651313:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788271727.651318:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875138590094336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271727.651341:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875138590094336:12345-0@lo:400:kworker.0 Request processed in 22us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271727.651345:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788271727.651671:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875138590093312:0@lo:400:kworker.0 00010000:00080000:3.0:1788271727.651684:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82ec7b80 x1875138590093824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271727.651769:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3608:1875138590093824:0@lo:400:kworker.0 00010000:00080000:3.0:1788271727.651784:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82ec5880 x1875138590094336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271727.651793:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3608:1875138590094336:0@lo:400:kworker.0 00000100:00100000:3.0:1788271727.651802:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590093184:0@lo:400:kworker.0 00000100:00100000:3.0:1788271727.651811:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3608:1875138590093696:0@lo:400:kworker.0 00000100:00100000:3.0:1788271727.651820:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3608:1875138590094208:0@lo:400:kworker.0 00000100:00080000:3.0:1788271727.652193:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788271727.652198:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788271727.652201:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788271727.652213:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590093568 00000100:00100000:3.0:1788271727.652218:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590093568 00000100:00100000:3.0:1788271727.652251:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788271727.652258:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590093568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271727.652313:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590093568:12345-0@lo:400:kworker.0 Request processed in 55us (4988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271727.652318:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788271727.652346:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590093568:0@lo:400:kworker.0 00000100:00100000:0.0:1788271727.652705:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788271727.652716:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590094720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788271727.652752:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271727.652784:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590094720 00000100:00100000:0.0:1788271727.652788:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590094720 00000100:00100000:0.0:1788271727.652818:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788271727.652824:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590094720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788271727.652846:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788271727.652880:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590094720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271727.652886:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1788271727.652927:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d8313f100 x1875138590094720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271743 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271727.652942:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590094720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788271727.663277:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590094848:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788271727.663358:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271727.663459:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590094848 00000100:00100000:2.0:1788271727.663467:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590094848 00000100:00100000:2.0:1788271727.663520:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788271727.663529:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590094848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788271727.663552:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788271727.663601:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590094848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271727.663608:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1788271727.663779:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82ecea00 x1875138590094848/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271743 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271727.663798:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590094848:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788271728.028021:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271728.028081:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271728.028114:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271728.028217:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577442176 00000100:00100000:1.0:1788271728.028227:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577442176 00000100:00100000:1.0:1788271728.028292:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 284 00000100:00100000:1.0:1788271728.028302:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:2398:x1875138577442176:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271728.028377:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:2398:x1875138577442176:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 76us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271728.028384:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 284 00000100:00100000:0.0:1788271728.028591:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577442432 00000100:00100000:0.0:1788271728.028596:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577442432 00000100:00100000:0.0:1788271728.028675:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577442304 00000100:00100000:0.0:1788271728.028679:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577442304 00000100:00100000:0.0:1788271728.028700:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 103 00000100:00100000:0.0:1788271728.028708:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2398:x1875138577442432:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788271728.028746:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2398:x1875138577442432:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 39us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271728.028752:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 103 00000100:00100000:0.0:1788271728.028767:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 104 00000100:00100000:0.0:1788271728.028773:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2398:x1875138577442304:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788271728.028795:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2398:x1875138577442304:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 23us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271728.028801:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 104 00000100:00080000:1.0:1788271728.028855:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788271728.028860:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788271728.029853:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271729.053922:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271730.078008:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271731.107317:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271731.229956:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788271731.230887:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788271731.230912:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590095104:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788271731.230985:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271731.234800:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590094976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788271731.234891:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271731.234983:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590094976 00000100:00100000:1.0:1788271731.234991:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590094976 00000100:00100000:1.0:1788271731.235065:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788271731.235076:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590094976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788271731.235109:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788271731.235162:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590094976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271731.235170:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1788271731.235221:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6e85809f80 x1875138590094976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271747 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271731.235242:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85809f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590094976:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788271731.235484:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788271731.235789:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788271731.235799:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590095232:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788271731.235826:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271731.235877:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590095232 00000100:00100000:3.0:1788271731.235888:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590095232 00000100:00100000:2.0:1788271731.235948:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590095104 00000100:00100000:2.0:1788271731.235954:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590095104 00000100:00100000:2.0:1788271731.235989:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788271731.235996:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590095104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788271731.236022:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788271731.236061:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590095104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (5075us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271731.236068:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788271731.237322:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788271731.237333:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e85809500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590095232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788271731.237354:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271731.237403:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e85809500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590095232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (1576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271731.237410:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1788271731.237432:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788271731.237461:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6e85808e00 x1875138590095232/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271747 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271731.237480:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590095232:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788271731.237516:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590095104:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788271732.128261:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271732.265578:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788271732.265610:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ecf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590095360:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788271732.265777:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271732.271919:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590095360 00000100:00100000:1.0:1788271732.271943:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590095360 00000100:00100000:1.0:1788271732.272031:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788271732.272057:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590095360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788271732.272118:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788271732.272241:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590095360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 199us (6463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271732.272253:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788271732.272394:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ecf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590095360:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788271732.766885:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590095488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788271732.766956:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271732.767255:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590095488 00000100:00100000:1.0:1788271732.767262:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590095488 00000100:00100000:1.0:1788271732.767317:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788271732.767327:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590095488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788271732.767353:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788271732.767393:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590095488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271732.767399:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1788271732.767420:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788271732.767449:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d8313c700 x1875138590095488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271748 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271732.767467:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590095488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788271732.767481:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788271732.767486:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590095616:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788271732.767509:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271732.767538:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590095616 00000100:00100000:1.0:1788271732.767542:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590095616 00000100:00100000:1.0:1788271732.767574:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788271732.767579:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590095616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788271732.767589:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788271732.767616:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590095616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271732.767642:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1788271732.767656:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788271732.767672:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82ecce00 x1875138590095616/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271748 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271732.767684:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ecce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590095616:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788271732.768248:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590095744:0@lo:400:kworker.0 00000100:00100000:0.0:1788271732.768287:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271732.768355:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590095744 00000100:00100000:1.0:1788271732.768360:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590095744 00000100:00100000:1.0:1788271732.768394:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788271732.768402:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3608:x1875138590095744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271732.768504:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3608:x1875138590095744:12345-0@lo:400:kworker.0 Request processed in 102us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271732.768511:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788271732.768665:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875138590095872:0@lo:400:kworker.0 00000100:00100000:2.0:1788271732.768696:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271732.768717:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3609:1875138590096384:0@lo:400:kworker.0 00000100:00100000:2.0:1788271732.768739:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271732.768756:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3609:1875138590096896:0@lo:400:kworker.0 00000100:00100000:2.0:1788271732.768774:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271732.768795:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788271732.768810:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8223a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3609:1875138590096256:0@lo:400:kworker.0 00000100:00100000:2.0:1788271732.768849:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271732.768866:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82238380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3609:1875138590096768:0@lo:400:kworker.0 00000100:00100000:2.0:1788271732.768886:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271732.768906:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590095872 00000100:00100000:2.0:1788271732.768910:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590095872 00000100:00100000:2.0:1788271732.768931:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590096384 00000100:00100000:2.0:1788271732.768934:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590096384 00000100:00100000:2.0:1788271732.768952:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590096896 00000100:00100000:2.0:1788271732.768955:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590096896 00000100:00100000:2.0:1788271732.768966:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590096256 00000100:00100000:2.0:1788271732.768968:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590096256 00000100:00100000:2.0:1788271732.768978:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590096768 00000100:00100000:2.0:1788271732.768980:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590096768 00000100:00100000:2.0:1788271732.768993:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788271732.768998:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8233ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875138590095872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271732.769053:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8233ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875138590095872:12345-0@lo:400:kworker.0 Request processed in 54us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271732.769059:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:1.0:1788271732.769169:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788271732.769173:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788271732.769183:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0ccfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875138590096000:0@lo:400:kworker.0 00000100:00100000:1.0:1788271732.769209:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271732.769221:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8223b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590096512:0@lo:400:kworker.0 00000100:00100000:1.0:1788271732.769242:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271732.769262:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788271732.769268:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590096128:0@lo:400:kworker.0 00000100:00100000:1.0:1788271732.769292:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271732.769319:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82239f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590096640:0@lo:400:kworker.0 00000100:00100000:1.0:1788271732.769341:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271732.769366:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590096512 00000100:00100000:1.0:1788271732.769369:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590096512 00000100:00100000:1.0:1788271732.769394:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590096640 00000100:00100000:1.0:1788271732.769396:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590096640 00000100:00100000:1.0:1788271732.769415:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788271732.769422:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590096512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271732.769455:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590096512:12345-0@lo:400:kworker.0 Request processed in 34us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271732.769461:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788271732.769473:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788271732.769479:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfba9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590096640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271732.769505:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfba9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590096640:12345-0@lo:400:kworker.0 Request processed in 26us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271732.769510:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788271732.769526:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590096128 00000100:00100000:1.0:1788271732.769529:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590096128 00000100:00100000:1.0:1788271732.769552:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788271732.769558:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfba8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590096128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271732.769588:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfba8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590096128:12345-0@lo:400:kworker.0 Request processed in 31us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271732.769595:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788271732.769653:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590096128:0@lo:400:kworker.0 00010000:00080000:1.0:1788271732.769664:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82239f80 x1875138590096640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271732.769673:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82239f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590096640:0@lo:400:kworker.0 00010000:00080000:1.0:1788271732.769692:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d8223b480 x1875138590096512/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271732.769700:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8223b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590096512:0@lo:400:kworker.0 00000100:00100000:2.0:1788271732.769770:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590096000 00000100:00100000:2.0:1788271732.769774:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590096000 00000100:00100000:2.0:1788271732.769789:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788271732.769795:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875138590096384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271732.769838:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875138590096384:12345-0@lo:400:kworker.0 Request processed in 43us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271732.769845:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788271732.769857:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788271732.769862:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875138590096896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271732.769901:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875138590096896:12345-0@lo:400:kworker.0 Request processed in 38us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271732.769906:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788271732.769918:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788271732.769925:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4ec9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875138590096256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271732.769951:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4ec9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875138590096256:12345-0@lo:400:kworker.0 Request processed in 27us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271732.769957:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788271732.769967:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788271732.769973:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4ec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875138590096768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271732.770000:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4ec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875138590096768:12345-0@lo:400:kworker.0 Request processed in 27us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271732.770005:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788271732.770016:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788271732.770022:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1875138590096000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271732.770061:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1875138590096000:12345-0@lo:400:kworker.0 Request processed in 39us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271732.770138:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788271732.770177:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8223a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3609:1875138590096256:0@lo:400:kworker.0 00000100:00100000:2.0:1788271732.770187:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82238380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3609:1875138590096768:0@lo:400:kworker.0 00000100:00100000:2.0:1788271732.770196:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875138590095872:0@lo:400:kworker.0 00010000:00080000:2.0:1788271732.770206:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82239c00 x1875138590096384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271732.770228:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3609:1875138590096384:0@lo:400:kworker.0 00010000:00080000:2.0:1788271732.770242:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82339500 x1875138590096896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271732.770250:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3609:1875138590096896:0@lo:400:kworker.0 00000100:00100000:1.0:1788271732.770436:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0ccfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875138590096000:0@lo:400:kworker.0 00000100:00100000:0.0:1788271732.770884:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590095744:0@lo:400:kworker.0 00000100:00100000:0.0:1788271733.149611:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271733.149980:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271733.150029:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271733.150283:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577442560 00000100:00100000:2.0:1788271733.150293:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577442560 00000100:00100000:2.0:1788271733.150342:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 286 00000100:00100000:2.0:1788271733.150353:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:2398:x1875138577442560:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788271733.150420:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:2398:x1875138577442560:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 70us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271733.150427:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 286 00010000:00010000:2.0:1788271733.155116:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271733.156040:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577442688 00000100:00100000:3.0:1788271733.156055:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577442688 00000100:00100000:0.0:1788271733.156180:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577442816 00000100:00100000:0.0:1788271733.156184:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577442816 00000100:00100000:0.0:1788271733.156366:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 111 00000100:00100000:0.0:1788271733.156387:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2398:x1875138577442816:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788271733.156475:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2398:x1875138577442816:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 89us (6444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271733.156482:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 111 00000100:00080000:3.0:1788271733.156713:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788271733.156717:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788271733.157933:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 112 00000100:00100000:2.0:1788271733.157944:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2398:x1875138577442688:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788271733.157995:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2398:x1875138577442688:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 53us (8392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271733.158002:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 112 00010000:00010000:2.0:1788271734.186908:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271735.198244:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271736.221782:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271736.349796:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590097024:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788271736.349874:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271736.349900:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590097024 00000100:00100000:2.0:1788271736.349919:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590097024 00000100:00100000:2.0:1788271736.349973:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788271736.349983:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82239c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590097024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788271736.350016:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788271736.350078:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82239c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590097024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271736.350085:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788271736.350127:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85808a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590097024:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788271736.350197:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788271736.350357:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788271736.350368:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590097280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788271736.350401:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271736.350436:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590097280 00000100:00100000:3.0:1788271736.350440:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590097280 00000100:00100000:3.0:1788271736.350477:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788271736.350484:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e85808a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590097280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788271736.350503:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271736.350532:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e85808a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590097280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271736.350538:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1788271736.350561:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788271736.350584:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6e85808e00 x1875138590097280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271752 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271736.350598:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85808e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590097280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788271736.353149:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590097152:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788271736.353223:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271736.353360:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590097152 00000100:00100000:1.0:1788271736.353367:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590097152 00000100:00100000:1.0:1788271736.353521:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788271736.353532:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4ecad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590097152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788271736.353558:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788271736.353616:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4ecad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590097152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271736.353645:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1788271736.353727:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d8313ed80 x1875138590097152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271752 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271736.353747:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590097152:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788271736.353812:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788271737.247477:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271737.374813:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590097408:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788271737.374888:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271737.375011:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590097408 00000100:00100000:2.0:1788271737.375019:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590097408 00000100:00100000:2.0:1788271737.375071:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788271737.375080:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e85808e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590097408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788271737.375114:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788271737.375165:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e85808e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590097408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271737.375172:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788271737.375212:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590097408:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788271737.885916:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82238380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590097536:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788271737.886012:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271737.886203:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590097536 00000100:00100000:1.0:1788271737.886211:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590097536 00000100:00100000:1.0:1788271737.886275:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788271737.886286:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e85809f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590097536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788271737.886317:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788271737.886369:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e85809f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590097536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271737.886377:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1788271737.886433:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788271737.886465:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82238380 x1875138590097536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271753 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271737.886487:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82238380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590097536:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788271737.886933:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590097664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788271737.887060:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271737.887124:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590097664 00000100:00100000:1.0:1788271737.887130:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590097664 00000100:00100000:1.0:1788271737.887176:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788271737.887184:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590097664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788271737.887198:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788271737.887393:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590097792:0@lo:400:kworker.0 00000100:00100000:0.0:1788271737.887431:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271737.887459:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788271737.887465:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875138590097920:0@lo:400:kworker.0 00000100:00100000:0.0:1788271737.887491:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271737.887516:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590097792 00000100:00100000:0.0:1788271737.887519:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590097792 00000100:00100000:0.0:1788271737.887549:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788271737.887556:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3608:x1875138590097792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271737.887589:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3608:x1875138590097792:12345-0@lo:400:kworker.0 Request processed in 33us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271737.887596:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788271737.887641:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590097920 00000100:00100000:0.0:1788271737.887644:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590097920 00000100:00100000:0.0:1788271737.887680:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788271737.887687:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875138590097920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271737.887715:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875138590097920:12345-0@lo:400:kworker.0 Request processed in 29us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271737.887721:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788271737.887761:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875138590097920:0@lo:400:kworker.0 00000100:00100000:0.0:1788271737.887770:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ec8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590097792:0@lo:400:kworker.0 00000100:00100000:1.0:1788271737.888100:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590097664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 916us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271737.888108:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788271737.888389:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfb84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3608:1875138590098304:0@lo:400:kworker.0 00000100:00100000:0.0:1788271737.888420:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271737.888482:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590098304 00000100:00100000:1.0:1788271737.888488:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590098304 00000100:00100000:1.0:1788271737.888521:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788271737.888529:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875138590098304:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788271737.888613:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d8313ce00 x1875138590097664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271753 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271737.888645:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590097664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788271737.888673:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590098176:0@lo:400:kworker.0 00000100:00100000:3.0:1788271737.888701:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271737.888721:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788271737.888738:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875138590098048:0@lo:400:kworker.0 00000100:00100000:3.0:1788271737.888758:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271737.888784:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590098176 00000100:00100000:3.0:1788271737.888796:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590098176 00000100:00100000:3.0:1788271737.888827:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788271737.888834:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590098176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271737.888870:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590098176:12345-0@lo:400:kworker.0 Request processed in 37us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271737.888876:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788271737.888893:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590098048 00000100:00100000:3.0:1788271737.888896:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590098048 00000100:00100000:3.0:1788271737.888918:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788271737.888925:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875138590098048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271737.888959:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875138590098048:12345-0@lo:400:kworker.0 Request processed in 34us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271737.888964:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:3.0:1788271737.888997:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788271737.889002:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788271737.889024:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875138590098048:0@lo:400:kworker.0 00000100:00100000:3.0:1788271737.889033:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590098176:0@lo:400:kworker.0 00000100:00100000:1.0:1788271737.889299:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875138590098304:12345-0@lo:400:kworker.0 Request processed in 771us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271737.889306:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788271737.889358:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfb84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3608:1875138590098304:0@lo:400:kworker.0 00000100:00100000:0.0:1788271737.889369:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788271737.889375:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfb87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3608:1875138590098432:0@lo:400:kworker.0 00000100:00100000:0.0:1788271737.889400:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271737.889435:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590098432 00000100:00100000:0.0:1788271737.889439:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590098432 00000100:00100000:0.0:1788271737.889475:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788271737.889482:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875138590098432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271737.889518:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875138590098432:12345-0@lo:400:kworker.0 Request processed in 37us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271737.889523:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00010000:00080000:0.0:1788271737.889549:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6ebfb87100 x1875138590098432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271737.889559:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfb87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3608:1875138590098432:0@lo:400:kworker.0 00000100:00080000:1.0:1788271737.889614:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788271737.891098:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfb84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590098560:0@lo:400:kworker.0 00000100:00100000:3.0:1788271737.891148:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271737.891212:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590098560 00000100:00100000:1.0:1788271737.891218:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590098560 00000100:00100000:1.0:1788271737.891263:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788271737.891272:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590098560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271737.894662:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590098560:12345-0@lo:400:kworker.0 Request processed in 3370us (3492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271737.894677:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788271737.895066:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfb84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3609:1875138590098944:0@lo:400:kworker.0 00000100:00100000:1.0:1788271737.895130:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271737.895161:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788271737.895167:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfb87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3609:1875138590098816:0@lo:400:kworker.0 00000100:00100000:1.0:1788271737.895189:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271737.895216:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590098944 00000100:00100000:1.0:1788271737.895232:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590098944 00000100:00100000:1.0:1788271737.895286:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590098816 00000100:00100000:1.0:1788271737.895290:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590098816 00000100:00100000:1.0:1788271737.895312:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788271737.895321:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8223a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875138590098944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271737.895368:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8223a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875138590098944:12345-0@lo:400:kworker.0 Request processed in 48us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271737.895374:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788271737.895388:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788271737.895394:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8223b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875138590098816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271737.895421:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8223b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875138590098816:12345-0@lo:400:kworker.0 Request processed in 28us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271737.895426:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:1.0:1788271737.895441:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788271737.895445:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788271737.895471:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfb87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3609:1875138590098816:0@lo:400:kworker.0 00010000:00080000:1.0:1788271737.895484:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6ebfb84380 x1875138590098944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271737.895495:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfb84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3609:1875138590098944:0@lo:400:kworker.0 00010000:00080000:3.0:1788271737.895775:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6ebfb84700 x1875138590098560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271737.895786:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfb84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590098560:0@lo:400:kworker.0 00000100:00100000:3.0:1788271737.895800:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788271737.895870:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfb84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590098688:0@lo:400:kworker.0 00000100:00100000:3.0:1788271737.895901:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271737.897310:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590098688 00000100:00100000:0.0:1788271737.897320:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590098688 00000100:00100000:0.0:1788271737.897372:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788271737.897381:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590098688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271737.897523:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590098688:12345-0@lo:400:kworker.0 Request processed in 143us (1620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271737.897531:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1788271737.897849:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6ebfb84a80 x1875138590098688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271737.897864:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfb84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590098688:0@lo:400:kworker.0 00000100:00100000:0.0:1788271738.267412:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271738.267543:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577442944 00000100:00100000:2.0:1788271738.267641:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577442944 00000100:00100000:2.0:1788271738.267712:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 288 00000100:00100000:2.0:1788271738.267737:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:2398:x1875138577442944:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788271738.267819:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:2398:x1875138577442944:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 98us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271738.267826:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 288 00010000:00010000:2.0:1788271738.271136:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271738.271971:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271738.272209:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271738.278046:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577443072 00000100:00100000:1.0:1788271738.278065:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577443072 00000100:00100000:1.0:1788271738.278337:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577443200 00000100:00100000:1.0:1788271738.278341:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577443200 00000100:00100000:2.0:1788271738.278525:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 119 00000100:00100000:2.0:1788271738.278539:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2397:x1875138577443072:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788271738.278654:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2397:x1875138577443072:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 118us (6690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271738.278661:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 119 00000100:00080000:3.0:1788271738.278981:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788271738.278986:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271738.279119:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 120 00000100:00100000:1.0:1788271738.279129:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2398:x1875138577443200:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271738.279350:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2398:x1875138577443200:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 223us (7140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271738.279370:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 120 00010000:00010000:1.0:1788271739.294112:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788271740.121904:0:11959:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 10:08:58 (1788271738) === 00010000:00010000:2.0:1788271740.317751:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271740.453991:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271740.455392:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577443328 00000100:00100000:2.0:1788271740.455420:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577443328 00000100:00100000:2.0:1788271740.455492:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 289 00000100:00100000:2.0:1788271740.455503:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:8717:x1875138577443328:12345-192.168.201.3@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788271740.455520:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271740.455536:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4e21600/0x99288105fd38e805 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd32c expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271740.455562:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4e21600/0x99288105fd38e805 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd32c expref: 11 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271740.455573:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4e21600/0x99288105fd38e805 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd32c expref: 11 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271740.455601:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e21600, rc 0) 00000100:00100000:2.0:1788271740.455976:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+11:8717:x1875138577443328:12345-192.168.201.3@tcp:101:mount.lustre.0 Request processed in 474us (2120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271740.455983:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 289 00000100:00100000:3.0:1788271740.461553:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271740.461655:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577443456 00000100:00100000:0.0:1788271740.461667:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577443456 00000100:00100000:0.0:1788271740.461728:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 290 00000100:00100000:0.0:1788271740.461739:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+11:8717:x1875138577443456:12345-192.168.201.3@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788271740.462514:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+11:8717:x1875138577443456:12345-192.168.201.3@tcp:501:mount.lustre.0 Request processed in 773us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271740.462524:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 290 00000100:00100000:3.0:1788271740.464996:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271740.465381:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577443584 00000100:00100000:2.0:1788271740.465390:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577443584 00000100:00100000:2.0:1788271740.465449:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 291 00000100:00100000:2.0:1788271740.465459:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+11:8717:x1875138577443584:12345-192.168.201.3@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788271740.465659:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+11:8717:x1875138577443584:12345-192.168.201.3@tcp:503:mount.lustre.0 Request processed in 201us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271740.465667:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 291 00000100:00100000:2.0:1788271740.474356:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271740.474916:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577443712 00000100:00100000:0.0:1788271740.474927:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577443712 00000100:00100000:0.0:1788271740.474994:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 292 00000100:00100000:0.0:1788271740.475004:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+11:8721:x1875138577443712:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788271740.475170:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+11:8721:x1875138577443712:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 166us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271740.475178:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 292 00000100:00100000:0.0:1788271740.506332:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271740.506451:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577443840 00000100:00100000:1.0:1788271740.506462:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577443840 00000100:00100000:1.0:1788271740.506521:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 293 00000100:00100000:1.0:1788271740.506532:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+11:8721:x1875138577443840:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788271740.506857:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+11:8721:x1875138577443840:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 327us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271740.506866:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 293 00000100:00100000:3.0:1788271740.513286:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271740.513579:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577443968 00000100:00100000:2.0:1788271740.513589:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577443968 00000100:00100000:2.0:1788271740.513746:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 294 00000100:00100000:2.0:1788271740.513757:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+11:8721:x1875138577443968:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788271740.513914:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+11:8721:x1875138577443968:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 159us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271740.513922:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 294 00000100:00100000:2.0:1788271740.518109:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271740.518879:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577444096 00000100:00100000:1.0:1788271740.518991:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577444096 00000100:00100000:1.0:1788271740.519059:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 295 00000100:00100000:1.0:1788271740.519070:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+11:8717:x1875138577444096:12345-192.168.201.3@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788271740.519086:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271740.519103:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4ed5a00/0x99288105fd38e80c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd35d expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271740.519138:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4ed5a00/0x99288105fd38e80c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd35d expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271740.519150:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4ed5a00/0x99288105fd38e80c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd35d expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271740.519159:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4ed5a00, rc 0) 00000100:00100000:1.0:1788271740.519231:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+12:8717:x1875138577444096:12345-192.168.201.3@tcp:101:mount.lustre.0 Request processed in 162us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271740.519252:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 295 00000100:00100000:1.0:1788271740.522353:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271740.522468:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577444224 00000100:00100000:2.0:1788271740.522480:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577444224 00000100:00100000:2.0:1788271740.522539:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 296 00000100:00100000:2.0:1788271740.522550:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+12:8717:x1875138577444224:12345-192.168.201.3@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788271740.522602:0:6476:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788271740.522648:0:6476:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788271740.522655:0:6476:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788271740.522658:0:6476:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788271740.522661:0:6476:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788271740.522664:0:6476:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1788271740.525328:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+12:8717:x1875138577444224:12345-192.168.201.3@tcp:256:mount.lustre.0 Request processed in 2768us (2972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271740.525341:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 296 00000100:00100000:1.0:1788271740.528505:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271740.528645:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577444352 00000100:00100000:0.0:1788271740.528656:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577444352 00000100:00100000:0.0:1788271740.528728:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 297 00000100:00100000:0.0:1788271740.528739:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+12:8717:x1875138577444352:12345-192.168.201.3@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788271740.528757:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271740.528777:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4078e00/0x99288105fd38e813 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd364 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271740.528805:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4078e00/0x99288105fd38e813 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd364 expref: 13 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271740.528837:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4078e00/0x99288105fd38e813 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd364 expref: 13 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271740.528848:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4078e00, rc 0) 00000100:00100000:0.0:1788271740.529032:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:8717:x1875138577444352:12345-192.168.201.3@tcp:101:mount.lustre.0 Request processed in 294us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271740.529040:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 297 00000100:00100000:1.0:1788271740.531037:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271740.534804:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577444480 00000100:00100000:2.0:1788271740.534836:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577444480 00000100:00100000:2.0:1788271740.534984:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 298 00000100:00100000:2.0:1788271740.534995:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:8717:x1875138577444480:12345-192.168.201.3@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788271740.535238:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:8717:x1875138577444480:12345-192.168.201.3@tcp:501:mount.lustre.0 Request processed in 244us (4208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271740.535246:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 298 00000100:00100000:3.0:1788271740.538689:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271740.538953:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577444608 00000100:00100000:2.0:1788271740.538963:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577444608 00000100:00100000:2.0:1788271740.539018:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 299 00000100:00100000:2.0:1788271740.539029:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:8717:x1875138577444608:12345-192.168.201.3@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788271740.540164:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:8717:x1875138577444608:12345-192.168.201.3@tcp:503:mount.lustre.0 Request processed in 149us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271740.540185:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 299 00000100:00100000:1.0:1788271740.543207:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271740.543665:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577444736 00000100:00100000:0.0:1788271740.543676:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577444736 00000100:00100000:0.0:1788271740.543749:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 300 00000100:00100000:0.0:1788271740.543761:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:8725:x1875138577444736:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788271740.544269:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:8725:x1875138577444736:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 509us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271740.544278:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 300 00000100:00100000:1.0:1788271740.554439:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271740.555338:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577444864 00000100:00100000:2.0:1788271740.555349:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577444864 00000100:00100000:2.0:1788271740.555417:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 301 00000100:00100000:2.0:1788271740.555442:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:8725:x1875138577444864:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788271740.555705:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:8725:x1875138577444864:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 264us (1275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271740.555714:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 301 00000100:00100000:2.0:1788271740.573098:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271740.573142:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271740.573169:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271740.573205:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271740.573237:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577444992 00000100:00100000:2.0:1788271740.573247:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577444992 00000100:00100000:2.0:1788271740.573276:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577445248 00000100:00100000:2.0:1788271740.573279:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577445248 00000100:00100000:2.0:1788271740.573286:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577445504 00000100:00100000:2.0:1788271740.573289:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577445504 00000100:00100000:2.0:1788271740.573332:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577445632 00000100:00100000:2.0:1788271740.573335:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577445632 00000100:00100000:2.0:1788271740.573353:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 121 00000100:00100000:2.0:1788271740.573363:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2396:x1875138577445504:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788271740.573492:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2396:x1875138577445504:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 82us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271740.573500:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 121 00000100:00100000:2.0:1788271740.573516:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 122 00000100:00100000:2.0:1788271740.573523:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2396:x1875138577445632:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788271740.573549:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83155180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2396:x1875138577445632:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 27us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271740.573554:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 122 00000100:00100000:2.0:1788271740.573695:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 16 00000100:00100000:2.0:1788271740.573700:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1875138577444992:12345-192.168.201.3@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788271740.573723:0:6484:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 956fb91b-4885-4e88-90fb-3061936b51ca@192.168.201.3@tcp t0 exp 0000000000000000 cur 301 last 0 00000020:00000080:2.0:1788271740.573756:0:6484:0:(genops.c:1385:class_connect()) connect: client 956fb91b-4885-4e88-90fb-3061936b51ca, cookie 0x99288105fd38e81a 00000004:00100000:2.0:1788271740.573782:0:6484:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788271740.573890:0:6484:0:(import.c:65:import_set_state_nolock()) ffff8f6ebfbe1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788271740.573921:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:956fb91b-4885-4e88-90fb-3061936b51ca+6:2394:x1875138577444992:12345-192.168.201.3@tcp:38:mount.lustre.0 Request processed in 219us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271740.574101:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 16 00000100:00100000:3.0:1788271740.578142:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 17 00000100:00100000:3.0:1788271740.578157:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2394:x1875138577445248:12345-192.168.201.3@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788271740.578192:0:6485:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 956fb91b-4885-4e88-90fb-3061936b51ca@192.168.201.3@tcp t0 exp 0000000000000000 cur 301 last 0 00000020:00000080:3.0:1788271740.578230:0:6485:0:(genops.c:1385:class_connect()) connect: client 956fb91b-4885-4e88-90fb-3061936b51ca, cookie 0x99288105fd38e821 00000004:00100000:3.0:1788271740.578257:0:6485:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788271740.578379:0:6485:0:(import.c:65:import_set_state_nolock()) ffff8f6ebfc07800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788271740.578549:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:956fb91b-4885-4e88-90fb-3061936b51ca+6:2394:x1875138577445248:12345-192.168.201.3@tcp:38:mount.lustre.0 Request processed in 393us (5405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271740.578558:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 17 00000100:00080000:3.0:1788271740.578598:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788271740.578603:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271740.582048:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271740.582094:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271740.582116:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271740.582144:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577445376 00000100:00100000:1.0:1788271740.582153:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577445376 00000100:00080000:1.0:1788271740.582182:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788271740.582212:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577445120 00000100:00100000:1.0:1788271740.582215:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577445120 00000100:00080000:1.0:1788271740.582227:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271740.582237:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577445760 00000100:00100000:1.0:1788271740.582239:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577445760 00000100:00100000:1.0:1788271740.582253:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 18 00000100:00100000:1.0:1788271740.582263:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:956fb91b-4885-4e88-90fb-3061936b51ca+6:0:x1875138577445376:12345-192.168.201.3@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788271740.582301:0:6483:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788271740.582379:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82239f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:956fb91b-4885-4e88-90fb-3061936b51ca+6:0:x1875138577445376:12345-192.168.201.3@tcp:41:mount.lustre.0 Request processed in 117us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271740.582387:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 18 00000100:00100000:1.0:1788271740.582403:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 19 00000100:00100000:1.0:1788271740.582409:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:956fb91b-4885-4e88-90fb-3061936b51ca+7:0:x1875138577445120:12345-192.168.201.3@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788271740.582423:0:6483:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788271740.582454:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:956fb91b-4885-4e88-90fb-3061936b51ca+7:0:x1875138577445120:12345-192.168.201.3@tcp:41:mount.lustre.0 Request processed in 46us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271740.582472:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 19 00000100:00100000:1.0:1788271740.582484:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 20 00000100:00100000:1.0:1788271740.582490:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:956fb91b-4885-4e88-90fb-3061936b51ca+6:8717:x1875138577445760:12345-192.168.201.3@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788271740.582499:0:6483:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788271740.582517:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:956fb91b-4885-4e88-90fb-3061936b51ca+6:8717:x1875138577445760:12345-192.168.201.3@tcp:41:mount.lustre.0 Request processed in 27us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271740.582523:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 20 00000100:00100000:3.0:1788271740.585932:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271740.586041:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577445888 00000100:00100000:1.0:1788271740.586063:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577445888 00000100:00100000:1.0:1788271740.586114:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 21 00000100:00100000:1.0:1788271740.586124:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:956fb91b-4885-4e88-90fb-3061936b51ca+6:8717:x1875138577445888:12345-192.168.201.3@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788271740.586214:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:956fb91b-4885-4e88-90fb-3061936b51ca+6:8717:x1875138577445888:12345-192.168.201.3@tcp:40:mount.lustre.0 Request processed in 91us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271740.586222:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 21 00000100:00100000:3.0:1788271740.589746:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271740.589790:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271740.589874:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271740.590084:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577446272 00000100:00100000:0.0:1788271740.590094:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577446272 00000100:00100000:0.0:1788271740.590149:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 5 00000100:00100000:0.0:1788271740.590161:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:956fb91b-4885-4e88-90fb-3061936b51ca+6:8717:x1875138577446272:12345-192.168.201.3@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788271740.590241:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:956fb91b-4885-4e88-90fb-3061936b51ca+6:8717:x1875138577446272:12345-192.168.201.3@tcp:900:mount.lustre.0 Request processed in 82us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271740.590249:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 5 00000100:00100000:3.0:1788271740.592226:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271740.592343:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577446400 00000100:00100000:0.0:1788271740.592350:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577446400 00000100:00100000:0.0:1788271740.592402:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 1 00000100:00100000:0.0:1788271740.592413:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:956fb91b-4885-4e88-90fb-3061936b51ca+6:8717:x1875138577446400:12345-192.168.201.3@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788271740.592518:0:6486:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788271740.592601:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:956fb91b-4885-4e88-90fb-3061936b51ca+6:8717:x1875138577446400:12345-192.168.201.3@tcp:33:mount.lustre.0 Request processed in 190us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271740.592609:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 1 00000100:00100000:2.0:1788271740.594362:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577446016 00000100:00100000:2.0:1788271740.594373:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577446016 00000100:00100000:2.0:1788271740.594414:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577446144 00000100:00100000:2.0:1788271740.594417:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577446144 00000100:00100000:2.0:1788271740.594437:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 20 00000100:00100000:2.0:1788271740.594444:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2394:x1875138577446016:12345-192.168.201.3@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788271740.594477:0:8452:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 956fb91b-4885-4e88-90fb-3061936b51ca@192.168.201.3@tcp t0 exp 0000000000000000 cur 301 last 0 00000020:00000080:2.0:1788271740.594507:0:8452:0:(genops.c:1385:class_connect()) connect: client 956fb91b-4885-4e88-90fb-3061936b51ca, cookie 0x99288105fd38e828 00002000:00100000:2.0:1788271740.594518:0:8452:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 956fb91b-4885-4e88-90fb-3061936b51ca/ffff8f6ebfbe6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788271740.594536:0:8452:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788271740.594606:0:8452:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788271740.594655:0:8452:0:(import.c:65:import_set_state_nolock()) ffff8f6ebfbe2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788271740.594672:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 21 00000100:00100000:0.0:1788271740.594689:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2394:x1875138577446144:12345-192.168.201.3@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788271740.594708:0:8396:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 956fb91b-4885-4e88-90fb-3061936b51ca@192.168.201.3@tcp t0 exp 0000000000000000 cur 301 last 0 00000100:00100000:2.0:1788271740.594722:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:956fb91b-4885-4e88-90fb-3061936b51ca+6:2394:x1875138577446016:12345-192.168.201.3@tcp:8:mount.lustre.0 Request processed in 275us (4930us total) trans 0 rc 0/0 00000020:00000080:0.0:1788271740.594727:0:8396:0:(genops.c:1385:class_connect()) connect: client 956fb91b-4885-4e88-90fb-3061936b51ca, cookie 0x99288105fd38e82f 00000100:00100000:2.0:1788271740.594733:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 20 00002000:00100000:0.0:1788271740.594734:0:8396:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 956fb91b-4885-4e88-90fb-3061936b51ca/ffff8f6d832b7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788271740.594748:0:8396:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788271740.594788:0:8396:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788271740.594802:0:8396:0:(import.c:65:import_set_state_nolock()) ffff8f6d832b0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788271740.594825:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:956fb91b-4885-4e88-90fb-3061936b51ca+6:2394:x1875138577446144:12345-192.168.201.3@tcp:8:mount.lustre.0 Request processed in 146us (4952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271740.594831:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 21 00010000:00010000:2.0:1788271741.342063:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271741.470424:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788271741.470449:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfb58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590099072:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788271741.470519:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271741.470589:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590099072 00000100:00100000:3.0:1788271741.470609:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590099072 00000100:00100000:3.0:1788271741.470680:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788271741.470689:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590099072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788271741.470723:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788271741.470766:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590099072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271741.470774:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788271741.470819:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfb58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590099072:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788271741.471056:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788271741.471068:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590099200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788271741.471101:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271741.471295:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590099200 00000100:00100000:2.0:1788271741.471300:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590099200 00000100:00100000:2.0:1788271741.471347:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788271741.471355:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0cce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590099200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788271741.471369:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788271741.471408:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0cce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590099200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271741.471415:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1788271741.471447:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83157b80 x1875138590099200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271757 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271741.471461:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590099200:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788271741.471517:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788271741.471764:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590099328:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788271741.471792:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271741.471883:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590099328 00000100:00100000:0.0:1788271741.471888:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590099328 00000100:00100000:0.0:1788271741.471929:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788271741.471937:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590099328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788271741.471948:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788271741.471995:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590099328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271741.472002:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1788271741.472027:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d8313e680 x1875138590099328/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271757 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271741.472059:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590099328:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788271741.472190:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788271742.365870:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271742.504040:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfb58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590099456:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788271742.504107:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271742.504594:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590099456 00000100:00100000:3.0:1788271742.504603:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590099456 00000100:00100000:3.0:1788271742.504683:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788271742.504693:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590099456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788271742.504725:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788271742.504774:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590099456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271742.504781:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788271742.504923:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfb58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590099456:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788271743.006029:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788271743.006053:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590099584:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788271743.006131:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271743.006363:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590099584 00000100:00100000:2.0:1788271743.006371:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590099584 00000100:00100000:2.0:1788271743.006428:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788271743.006437:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590099584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788271743.006468:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788271743.006515:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590099584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271743.006522:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1788271743.006542:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788271743.006603:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83253b80 x1875138590099584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271759 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271743.006648:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590099584:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788271743.007811:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875138590100096:0@lo:400:kworker.0 00000100:00100000:1.0:1788271743.007830:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875138590099840:0@lo:400:kworker.0 00000100:00100000:1.0:1788271743.012029:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271743.012093:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83189500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3608:1875138590100352:0@lo:400:kworker.0 00000100:00100000:1.0:1788271743.012123:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271743.012148:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3608:1875138590100864:0@lo:400:kworker.0 00000100:00100000:1.0:1788271743.012168:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271743.012194:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788271743.012200:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8318b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590099968:0@lo:400:kworker.0 00000100:00100000:1.0:1788271743.012226:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271743.012244:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83188380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3608:1875138590100480:0@lo:400:kworker.0 00000100:00100000:1.0:1788271743.012264:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271743.012280:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83188a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3608:1875138590100992:0@lo:400:kworker.0 00000100:00100000:1.0:1788271743.012300:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271743.012329:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590099840 00000100:00100000:1.0:1788271743.012336:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590099840 00000100:00100000:1.0:1788271743.012372:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590100352 00000100:00100000:1.0:1788271743.012375:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590100352 00000100:00100000:1.0:1788271743.012394:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590100864 00000100:00100000:1.0:1788271743.012397:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590100864 00000100:00100000:1.0:1788271743.012408:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590100480 00000100:00100000:1.0:1788271743.012410:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590100480 00000100:00100000:1.0:1788271743.012421:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590100992 00000100:00100000:1.0:1788271743.012423:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590100992 00000100:00100000:1.0:1788271743.012437:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788271743.012445:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83188000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875138590099840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271743.012496:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83188000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875138590099840:12345-0@lo:400:kworker.0 Request processed in 52us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271743.012510:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788271743.012530:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788271743.012535:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8318ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875138590100352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271743.012564:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8318ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875138590100352:12345-0@lo:400:kworker.0 Request processed in 29us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271743.012570:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788271743.012581:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788271743.012586:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83188e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875138590100864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271743.012611:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83188e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875138590100864:12345-0@lo:400:kworker.0 Request processed in 25us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271743.012616:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788271743.012668:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788271743.012674:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83189180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875138590100480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271743.012699:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83189180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875138590100480:12345-0@lo:400:kworker.0 Request processed in 26us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271743.012705:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788271743.012715:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788271743.012720:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83189c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875138590100992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271743.012743:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83189c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875138590100992:12345-0@lo:400:kworker.0 Request processed in 24us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271743.012748:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788271743.012766:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590099968 00000100:00100000:1.0:1788271743.012769:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590099968 00000100:00100000:1.0:1788271743.012792:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788271743.012798:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8318b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590099968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271743.012833:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8318b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590099968:12345-0@lo:400:kworker.0 Request processed in 36us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271743.012839:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1788271743.012860:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788271743.012864:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271743.013023:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8318b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590099968:0@lo:400:kworker.0 00010000:00080000:1.0:1788271743.013041:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83188380 x1875138590100480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271743.013051:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83188380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3608:1875138590100480:0@lo:400:kworker.0 00010000:00080000:1.0:1788271743.013060:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83188a80 x1875138590100992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271743.013067:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83188a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3608:1875138590100992:0@lo:400:kworker.0 00000100:00100000:1.0:1788271743.013077:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875138590099840:0@lo:400:kworker.0 00000100:00100000:1.0:1788271743.013085:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83189500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3608:1875138590100352:0@lo:400:kworker.0 00000100:00100000:1.0:1788271743.013105:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3608:1875138590100864:0@lo:400:kworker.0 00000100:00100000:2.0:1788271743.013420:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271743.013456:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8318b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590100608:0@lo:400:kworker.0 00000100:00100000:2.0:1788271743.013484:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271743.013519:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8318a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590101120:0@lo:400:kworker.0 00000100:00100000:2.0:1788271743.013541:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271743.013543:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590100096 00000100:00100000:1.0:1788271743.013547:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590100096 00000100:00100000:2.0:1788271743.013561:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1788271743.013571:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788271743.013578:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1875138590100096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271743.013611:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83157100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1875138590100096:12345-0@lo:400:kworker.0 Request processed in 33us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271743.013652:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788271743.013671:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590100608 00000100:00100000:0.0:1788271743.013675:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590100608 00000100:00100000:0.0:1788271743.013714:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590101120 00000100:00100000:0.0:1788271743.013717:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590101120 00000100:00100000:0.0:1788271743.013736:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788271743.013741:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590100608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271743.013771:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590100608:12345-0@lo:400:kworker.0 Request processed in 31us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271743.013777:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788271743.013787:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788271743.013792:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590101120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271743.013813:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590101120:12345-0@lo:400:kworker.0 Request processed in 22us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271743.013819:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788271743.013876:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83250e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590099712:0@lo:400:kworker.0 00000100:00100000:2.0:1788271743.013905:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788271743.013977:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788271743.013986:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788271743.014163:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8318bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590100224:0@lo:400:kworker.0 00000100:00100000:2.0:1788271743.014188:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271743.014213:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83189880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590100736:0@lo:400:kworker.0 00000100:00100000:2.0:1788271743.014233:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271743.014249:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590101248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788271743.014268:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788271743.014291:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d8318a300 x1875138590101120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271743.014301:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8318a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590101120:0@lo:400:kworker.0 00000100:00100000:2.0:1788271743.014312:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875138590100096:0@lo:400:kworker.0 00010000:00080000:2.0:1788271743.014320:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d8318b100 x1875138590100608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271743.014328:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8318b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590100608:0@lo:400:kworker.0 00000100:00100000:2.0:1788271743.014355:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590100736 00000100:00100000:2.0:1788271743.014364:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590100736 00000100:00100000:2.0:1788271743.014394:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788271743.014399:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590100736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271743.014430:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590100736:12345-0@lo:400:kworker.0 Request processed in 30us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271743.014435:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788271743.014452:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590101248 00000100:00100000:2.0:1788271743.014455:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590101248 00000100:00100000:2.0:1788271743.014472:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788271743.014477:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590101248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788271743.014489:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788271743.014515:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590101248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271743.014521:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1788271743.014542:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83189880 x1875138590100736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271743.014550:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83189880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590100736:0@lo:400:kworker.0 00010000:00080000:2.0:1788271743.014557:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d8313e680 x1875138590101248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271759 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271743.014671:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590101248:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788271743.014690:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788271743.015020:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590099712 00000100:00100000:0.0:1788271743.015025:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590099712 00000100:00100000:0.0:1788271743.015056:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788271743.015060:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590100224 00000100:00100000:0.0:1788271743.015063:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3606:x1875138590099712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271743.015064:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590100224 00000100:00100000:1.0:1788271743.015089:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788271743.015095:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590100224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271743.015105:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3606:x1875138590099712:12345-0@lo:400:kworker.0 Request processed in 43us (1200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271743.015111:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788271743.015141:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590100224:12345-0@lo:400:kworker.0 Request processed in 46us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271743.015145:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83250e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590099712:0@lo:400:kworker.0 00000100:00100000:1.0:1788271743.015147:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788271743.015153:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8318bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590100224:0@lo:400:kworker.0 00010000:00010000:1.0:1788271743.390801:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271744.414250:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788271745.195094:0:12152:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg103-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1788271745.438139:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271745.948965:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271745.949015:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271745.949058:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271745.949093:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271745.949310:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577446528 00000100:00100000:0.0:1788271745.949325:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577446528 00000100:00100000:3.0:1788271745.949363:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271745.949383:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 303 00000100:00100000:3.0:1788271745.949388:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271745.949398:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2396:x1875138577446528:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271745.949411:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271745.949449:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577447168 00000100:00100000:3.0:1788271745.949453:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577447168 00000100:00100000:0.0:1788271745.949471:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2396:x1875138577446528:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 78us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271745.949480:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 303 00000100:00100000:3.0:1788271745.949488:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577447296 00000100:00100000:3.0:1788271745.949504:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577447296 00000100:00100000:3.0:1788271745.949536:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 52 00000100:00100000:2.0:1788271745.949537:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577446656 00000100:00100000:2.0:1788271745.949543:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577446656 00000100:00100000:3.0:1788271745.949547:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:956fb91b-4885-4e88-90fb-3061936b51ca+6:2395:x1875138577447168:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788271745.949580:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577446912 00000100:00100000:2.0:1788271745.949594:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577446912 00000100:00100000:3.0:1788271745.949598:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:956fb91b-4885-4e88-90fb-3061936b51ca+6:2395:x1875138577447168:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 39us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271745.949607:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 52 00000100:00100000:3.0:1788271745.949656:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 53 00000100:00100000:2.0:1788271745.949657:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577446784 00000100:00100000:3.0:1788271745.949665:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:956fb91b-4885-4e88-90fb-3061936b51ca+6:2395:x1875138577447296:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788271745.949669:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577446784 00000100:00080000:0.0:1788271745.949677:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788271745.949683:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788271745.949687:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788271745.949690:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788271745.949695:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577447040 00000100:00100000:2.0:1788271745.949699:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577447040 00000100:00100000:3.0:1788271745.949703:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:956fb91b-4885-4e88-90fb-3061936b51ca+6:2395:x1875138577447296:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 37us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271745.949710:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 53 00000100:00100000:2.0:1788271745.949741:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 129 00000100:00100000:2.0:1788271745.949751:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2396:x1875138577446656:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271745.949758:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 130 00000100:00100000:1.0:1788271745.949772:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:956fb91b-4885-4e88-90fb-3061936b51ca+6:2395:x1875138577446912:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788271745.949789:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2396:x1875138577446656:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 40us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271745.949797:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 129 00000100:00100000:2.0:1788271745.949816:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 131 00000100:00100000:2.0:1788271745.949824:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577446784:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788271745.949921:0:6483:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1788271745.949929:0:6483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1788271745.949945:0:6485:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1788271745.949954:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 132 00000100:00100000:0.0:1788271745.949961:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:956fb91b-4885-4e88-90fb-3061936b51ca+6:2395:x1875138577447040:12345-192.168.201.3@tcp:400:kworker.0 00000100:00080000:3.0:1788271745.951150:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788271745.951740:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577446784:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 1911us (2372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271745.951752:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 131 00000100:00100000:1.0:1788271745.951791:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:956fb91b-4885-4e88-90fb-3061936b51ca+6:2395:x1875138577446912:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 2021us (2731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271745.951801:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 130 00000100:00100000:0.0:1788271745.953390:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:956fb91b-4885-4e88-90fb-3061936b51ca+6:2395:x1875138577447040:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 3419us (3993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271745.953579:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 132 00000001:00100000:3.0:1788271746.087452:0:8391:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 956fb91b-4885-4e88-90fb-3061936b51ca 00000001:00100000:3.0:1788271746.089890:0:6462:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 956fb91b-4885-4e88-90fb-3061936b51ca 00000001:00100000:0.0:1788271746.090139:0:9475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 956fb91b-4885-4e88-90fb-3061936b51ca 00000001:00100000:1.0:1788271746.092394:0:7414:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 956fb91b-4885-4e88-90fb-3061936b51ca 00010000:00010000:2.0:1788271746.462340:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271746.593670:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590101376:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788271746.593755:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271746.593846:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590101376 00000100:00100000:2.0:1788271746.593855:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590101376 00000100:00100000:2.0:1788271746.593915:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788271746.593925:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590101376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788271746.593956:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788271746.594003:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590101376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271746.594010:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1788271746.594030:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788271746.594062:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4f3a300 x1875138590101376/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271762 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271746.594087:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590101376:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788271746.597709:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfb58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590101504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788271746.597793:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271746.597866:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590101504 00000100:00100000:3.0:1788271746.597874:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590101504 00000100:00100000:3.0:1788271746.597932:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788271746.597941:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590101504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788271746.597963:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271746.598010:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590101504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271746.598017:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1788271746.598037:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788271746.598075:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6ebfb58000 x1875138590101504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271762 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271746.598092:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfb58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590101504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788271746.598697:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590101632:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788271746.598733:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271746.598808:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590101632 00000100:00100000:1.0:1788271746.598813:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590101632 00000100:00100000:1.0:1788271746.598851:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788271746.598859:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590101632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788271746.598890:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788271746.598933:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590101632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271746.598940:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788271746.599149:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590101632:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788271747.488743:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271747.615142:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788271747.615174:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfb58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590101760:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788271747.615269:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271747.615395:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590101760 00000100:00100000:3.0:1788271747.615405:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590101760 00000100:00100000:3.0:1788271747.615467:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788271747.615479:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83189500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590101760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788271747.615522:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788271747.615592:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83189500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590101760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271747.615600:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788271747.615714:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfb58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590101760:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788271748.125901:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590101888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788271748.125975:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271748.126018:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83188a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590102016:0@lo:400:kworker.0 00000100:00100000:3.0:1788271748.126044:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8318aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875138590102400:0@lo:400:kworker.0 00000100:00100000:1.0:1788271748.126054:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271748.126074:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8318a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590102528:0@lo:400:kworker.0 00000100:00100000:3.0:1788271748.126088:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271748.126104:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271748.126105:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83189880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590102912:0@lo:400:kworker.0 00000100:00100000:1.0:1788271748.126122:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8318b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590103040:0@lo:400:kworker.0 00000100:00100000:3.0:1788271748.126127:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271748.126142:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271748.126144:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83250e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590103424:0@lo:400:kworker.0 00000100:00100000:1.0:1788271748.126154:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590103552:0@lo:400:kworker.0 00000100:00100000:3.0:1788271748.126160:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271748.126171:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271748.126201:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590101888 00000100:00100000:1.0:1788271748.126206:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590102912 00000100:00100000:3.0:1788271748.126212:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590101888 00000100:00100000:1.0:1788271748.126212:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590102912 00000100:00100000:0.0:1788271748.126305:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590102016 00000100:00100000:0.0:1788271748.126309:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590102016 00000100:00100000:1.0:1788271748.126325:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590103040 00000100:00100000:1.0:1788271748.126328:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590103040 00000100:00100000:0.0:1788271748.126337:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1788271748.126358:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3609:x1875138590102016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271748.126377:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83188380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875138590102144:0@lo:400:kworker.0 00000100:00100000:2.0:1788271748.126413:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271748.126421:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3609:x1875138590102016:12345-0@lo:400:kworker.0 Request processed in 76us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271748.126429:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3606:1875138590102656:0@lo:400:kworker.0 00000100:00100000:0.0:1788271748.126429:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788271748.126448:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271748.126462:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3606:1875138590103168:0@lo:400:kworker.0 00000100:00100000:0.0:1788271748.126463:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590103424 00000100:00100000:0.0:1788271748.126466:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590103424 00000100:00100000:0.0:1788271748.126479:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590103552 00000100:00100000:2.0:1788271748.126481:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271748.126481:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590103552 00000100:00100000:2.0:1788271748.126495:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590103680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788271748.127326:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271748.127359:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788271748.127366:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8318b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590102272:0@lo:400:kworker.0 00000100:00100000:2.0:1788271748.127402:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271748.127419:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8318bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3606:1875138590102784:0@lo:400:kworker.0 00000100:00100000:2.0:1788271748.127437:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271748.127452:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8318a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3606:1875138590103296:0@lo:400:kworker.0 00000100:00100000:2.0:1788271748.127468:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271748.127497:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590102400 00000100:00100000:2.0:1788271748.127501:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590102400 00000100:00100000:2.0:1788271748.127525:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590102144 00000100:00100000:2.0:1788271748.127527:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590102144 00000100:00100000:2.0:1788271748.127535:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590102656 00000100:00100000:2.0:1788271748.127537:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590102656 00000100:00100000:3.0:1788271748.130930:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590103680 00000100:00100000:1.0:1788271748.130935:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788271748.130941:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590103680 00000100:00100000:1.0:1788271748.130948:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83291500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590102912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271748.130956:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788271748.130962:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3608:x1875138590101888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788271748.130983:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788271748.131068:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788271748.131076:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83290380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3608:x1875138590103424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271748.132081:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590103168 00000100:00100000:2.0:1788271748.132088:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590103168 00000100:00100000:2.0:1788271748.132121:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590102784 00000100:00100000:2.0:1788271748.132124:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590102784 00000100:00100000:2.0:1788271748.132135:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590103296 00000100:00100000:2.0:1788271748.132138:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590103296 00000100:00100000:2.0:1788271748.132149:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788271748.132155:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875138590102400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271748.133712:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3608:x1875138590101888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2739us (7725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271748.133725:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788271748.133763:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788271748.133775:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3606:x1875138590103680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788271748.133799:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271748.133997:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3606:x1875138590103680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 227us (6675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271748.134000:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83291500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590102912:12345-0@lo:400:kworker.0 Request processed in 3055us (7871us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271748.134004:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788271748.134009:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788271748.134025:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788271748.134029:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788271748.134033:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83032680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590103040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271748.134036:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83033480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590103552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271748.134067:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83033480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590103552:12345-0@lo:400:kworker.0 Request processed in 31us (7895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271748.134067:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83032680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590103040:12345-0@lo:400:kworker.0 Request processed in 35us (7924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271748.134073:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788271748.134080:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788271748.134092:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590102528 00000100:00100000:1.0:1788271748.134098:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590102528 00000100:00080000:3.0:1788271748.134099:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788271748.134103:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788271748.134106:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788271748.134108:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788271748.134120:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788271748.134122:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590102272 00000100:00100000:1.0:1788271748.134124:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590102272 00000100:00100000:3.0:1788271748.134126:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875138590102144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271748.134135:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788271748.134154:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83032a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590102528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271748.134157:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875138590102144:12345-0@lo:400:kworker.0 Request processed in 32us (7745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271748.134168:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788271748.134185:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83032a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590102528:12345-0@lo:400:kworker.0 Request processed in 32us (8080us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271748.134191:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788271748.134202:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788271748.134208:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590102272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271748.134235:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590102272:12345-0@lo:400:kworker.0 Request processed in 28us (6832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271748.134241:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788271748.134321:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788271748.134331:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1875138590102656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271748.134487:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1875138590102656:12345-0@lo:400:kworker.0 Request processed in 158us (8038us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271748.134579:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83290380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590103424:12345-0@lo:400:kworker.0 Request processed in 3502us (8416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271748.134587:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788271748.135013:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788271748.135026:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788271748.135029:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3606:x1875138590103168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271748.135041:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788271748.135048:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1875138590102784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271748.135064:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3606:x1875138590103168:12345-0@lo:400:kworker.0 Request processed in 43us (8583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271748.135070:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788271748.135073:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1875138590102784:12345-0@lo:400:kworker.0 Request processed in 26us (7635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271748.135078:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788271748.135083:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788271748.135089:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4fb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1875138590103296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271748.135116:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4fb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1875138590103296:12345-0@lo:400:kworker.0 Request processed in 28us (7646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271748.135121:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788271748.135176:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83188a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590102016:0@lo:400:kworker.0 00000100:00100000:1.0:1788271748.135190:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8318a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590102528:0@lo:400:kworker.0 00010000:00080000:1.0:1788271748.135205:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d8318b100 x1875138590103040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271748.135216:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8318b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590103040:0@lo:400:kworker.0 00010000:00080000:1.0:1788271748.135242:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83253b80 x1875138590103552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271748.135250:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590103552:0@lo:400:kworker.0 00000100:00100000:2.0:1788271748.135534:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875138590102400:12345-0@lo:400:kworker.0 Request processed in 3376us (9443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271748.135542:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788271748.135675:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8318b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590102272:0@lo:400:kworker.0 00010000:00080000:2.0:1788271748.135692:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d8318bb80 x1875138590102784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271748.135888:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8318bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3606:1875138590102784:0@lo:400:kworker.0 00010000:00080000:2.0:1788271748.135903:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d8318a300 x1875138590103296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271748.135912:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8318a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3606:1875138590103296:0@lo:400:kworker.0 00000100:00100000:2.0:1788271748.135924:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83188380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875138590102144:0@lo:400:kworker.0 00000100:00100000:2.0:1788271748.135934:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3606:1875138590102656:0@lo:400:kworker.0 00000100:00100000:2.0:1788271748.135944:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3606:1875138590103168:0@lo:400:kworker.0 00010000:00080000:2.0:1788271748.135955:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d8313f480 x1875138590103680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271764 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271748.135971:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590103680:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788271748.136631:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83189880 x1875138590102912/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271748.136644:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83189880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590102912:0@lo:400:kworker.0 00010000:00080000:3.0:1788271748.136662:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83250e00 x1875138590103424/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271748.136671:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83250e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590103424:0@lo:400:kworker.0 00010000:00080000:3.0:1788271748.136682:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4f3a300 x1875138590101888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271764 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271748.136694:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590101888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788271748.136717:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8318aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875138590102400:0@lo:400:kworker.0 00010000:00010000:1.0:1788271748.515042:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271749.536787:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271750.558753:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271751.078292:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271751.078357:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271751.078393:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271751.078442:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271751.078464:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271751.078664:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577447552 00000100:00100000:0.0:1788271751.078675:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577447552 00000100:00100000:0.0:1788271751.078739:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577447808 00000100:00100000:0.0:1788271751.078742:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577447808 00000100:00100000:0.0:1788271751.078775:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577447680 00000100:00100000:0.0:1788271751.078778:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577447680 00000100:00100000:0.0:1788271751.078794:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 139 00000100:00100000:0.0:1788271751.078803:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2398:x1875138577447552:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788271751.078877:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2398:x1875138577447552:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 75us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271751.078885:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 139 00000100:00100000:0.0:1788271751.078901:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 140 00000100:00100000:0.0:1788271751.078908:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:956fb91b-4885-4e88-90fb-3061936b51ca+5:2398:x1875138577447808:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788271751.078932:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:956fb91b-4885-4e88-90fb-3061936b51ca+5:2398:x1875138577447808:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 25us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271751.078938:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 140 00000100:00100000:0.0:1788271751.078949:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 141 00000100:00100000:0.0:1788271751.078955:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2398:x1875138577447680:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788271751.078996:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2398:x1875138577447680:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 41us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271751.079003:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 141 00000100:00100000:0.0:1788271751.079021:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577447424 00000100:00100000:0.0:1788271751.079025:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577447424 00000100:00100000:0.0:1788271751.079048:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 305 00000100:00100000:0.0:1788271751.079055:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2398:x1875138577447424:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788271751.079077:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2398:x1875138577447424:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 22us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271751.079083:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 305 00000100:00100000:2.0:1788271751.079574:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577448064 00000100:00100000:2.0:1788271751.079589:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577448064 00000100:00100000:2.0:1788271751.079666:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 58 00000100:00100000:2.0:1788271751.079674:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:956fb91b-4885-4e88-90fb-3061936b51ca+5:2398:x1875138577448064:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788271751.079712:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:956fb91b-4885-4e88-90fb-3061936b51ca+5:2398:x1875138577448064:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 39us (1318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271751.079719:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 58 00000100:00080000:3.0:1788271751.080151:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788271751.080156:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788271751.080159:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788271751.082123:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271751.082169:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271751.082656:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577448192 00000100:00100000:2.0:1788271751.082667:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577448192 00000100:00100000:2.0:1788271751.082727:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 59 00000100:00100000:2.0:1788271751.082738:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83290000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:956fb91b-4885-4e88-90fb-3061936b51ca+5:2398:x1875138577448192:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271751.083250:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577447936 00000100:00100000:1.0:1788271751.083257:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577447936 00000100:00100000:1.0:1788271751.083296:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 142 00000100:00100000:1.0:1788271751.083313:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:956fb91b-4885-4e88-90fb-3061936b51ca+5:2398:x1875138577447936:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271751.083381:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:956fb91b-4885-4e88-90fb-3061936b51ca+5:2398:x1875138577447936:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 69us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271751.083389:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 142 00000100:00080000:3.0:1788271751.087039:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788271751.087051:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788271751.087385:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83290000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:956fb91b-4885-4e88-90fb-3061936b51ca+5:2398:x1875138577448192:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 4580us (5147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271751.087398:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 59 00010000:00010000:3.0:1788271751.585785:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271751.710026:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788271751.710048:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590103808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788271751.710118:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271751.710237:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590103808 00000100:00100000:3.0:1788271751.710245:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590103808 00000100:00100000:3.0:1788271751.710306:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788271751.710315:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590103808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788271751.710342:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271751.710401:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590103808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271751.710409:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1788271751.710479:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788271751.710520:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83292d80 x1875138590103808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271767 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271751.710546:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590103808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788271751.710764:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590103936:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788271751.710794:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271751.710927:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590103936 00000100:00100000:0.0:1788271751.710932:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590103936 00000100:00100000:0.0:1788271751.710972:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788271751.710978:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83290e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590103936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788271751.710989:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788271751.711022:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83290e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590103936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271751.711028:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:0.0:1788271751.711064:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d8313fb80 x1875138590103936/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271767 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271751.711073:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590103936:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788271751.711142:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788271751.712608:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590104064:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788271751.712676:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271751.712766:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590104064 00000100:00100000:1.0:1788271751.712773:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590104064 00000100:00100000:1.0:1788271751.712812:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788271751.712821:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4fb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590104064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788271751.712850:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788271751.712899:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4fb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590104064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271751.712907:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788271751.712962:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590104064:0@lo:41:osp-pre-1-0.0 00000020:00000004:3.0:1788271752.166038:0:12468:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788271752.166321:0:12468:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788271752.605963:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271752.736164:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83293800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590104192:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788271752.736246:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271752.736531:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590104192 00000100:00100000:1.0:1788271752.736539:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590104192 00000100:00100000:1.0:1788271752.736590:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788271752.736600:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590104192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788271752.736669:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788271752.736717:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590104192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271752.736738:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788271752.736835:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83293800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590104192:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788271753.246105:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83291180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590104320:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788271753.246172:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271753.246242:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590104320 00000100:00100000:2.0:1788271753.246250:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590104320 00000100:00100000:2.0:1788271753.246302:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788271753.246312:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590104320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788271753.246342:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788271753.246387:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590104320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271753.246402:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1788271753.246425:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788271753.246454:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83291180 x1875138590104320/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271769 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271753.246484:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83291180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590104320:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788271753.251114:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590104448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788271753.251180:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271753.251238:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590104448 00000100:00100000:0.0:1788271753.251244:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590104448 00000100:00100000:0.0:1788271753.251295:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788271753.251304:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590104448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788271753.251326:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788271753.251372:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590104448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271753.251380:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1788271753.251399:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788271753.251427:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d8313f480 x1875138590104448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271769 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271753.251444:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590104448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788271753.255647:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590104832:0@lo:400:kworker.0 00000100:00100000:2.0:1788271753.255784:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271753.255832:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83293800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3607:1875138590105344:0@lo:400:kworker.0 00000100:00100000:2.0:1788271753.255977:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271753.256000:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8336b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3607:1875138590105856:0@lo:400:kworker.0 00000100:00100000:2.0:1788271753.256024:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271753.256044:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788271753.256050:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875138590104704:0@lo:400:kworker.0 00000100:00100000:2.0:1788271753.256081:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271753.256106:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83291180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3607:1875138590105216:0@lo:400:kworker.0 00000100:00100000:2.0:1788271753.256127:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271753.256144:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8336a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3607:1875138590105728:0@lo:400:kworker.0 00000100:00100000:2.0:1788271753.256161:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271753.256193:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590105344 00000100:00100000:2.0:1788271753.256201:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590105344 00000100:00100000:2.0:1788271753.256246:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590105856 00000100:00100000:2.0:1788271753.256249:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590105856 00000100:00100000:2.0:1788271753.256263:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590104704 00000100:00100000:2.0:1788271753.256265:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590104704 00000100:00100000:2.0:1788271753.256274:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590105216 00000100:00100000:2.0:1788271753.256282:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590105216 00000100:00100000:2.0:1788271753.256298:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590105728 00000100:00100000:2.0:1788271753.256300:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590105728 00000100:00100000:2.0:1788271753.256317:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788271753.256325:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4fb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875138590105344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271753.256377:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4fb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875138590105344:12345-0@lo:400:kworker.0 Request processed in 53us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271753.256384:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788271753.256402:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788271753.256408:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4fb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875138590105856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271753.256434:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4fb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875138590105856:12345-0@lo:400:kworker.0 Request processed in 26us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271753.256439:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788271753.256450:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788271753.256465:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d833d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875138590104704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271753.256492:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d833d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875138590104704:12345-0@lo:400:kworker.0 Request processed in 36us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271753.256498:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788271753.256640:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83291c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590104576:0@lo:400:kworker.0 00000100:00100000:0.0:1788271753.256679:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271753.256703:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83291f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590105088:0@lo:400:kworker.0 00000100:00100000:0.0:1788271753.256803:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271753.256834:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590105600:0@lo:400:kworker.0 00000100:00100000:0.0:1788271753.256858:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271753.256880:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788271753.256886:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875138590104960:0@lo:400:kworker.0 00000100:00100000:0.0:1788271753.256908:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271753.256919:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590105472:0@lo:400:kworker.0 00000100:00100000:0.0:1788271753.256937:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271753.256967:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590104960 00000100:00100000:0.0:1788271753.256971:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590104960 00000100:00100000:0.0:1788271753.256993:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788271753.257000:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d833d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875138590105216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271753.257031:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d833d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875138590105216:12345-0@lo:400:kworker.0 Request processed in 32us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271753.257037:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788271753.257049:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788271753.257056:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d833d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875138590105728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271753.257082:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d833d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875138590105728:12345-0@lo:400:kworker.0 Request processed in 28us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271753.257089:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788271753.257099:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788271753.257105:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875138590104960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271753.257133:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875138590104960:12345-0@lo:400:kworker.0 Request processed in 28us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271753.257139:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788271753.257160:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590104576 00000100:00100000:0.0:1788271753.257164:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590104576 00000100:00100000:0.0:1788271753.257193:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788271753.257199:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3609:x1875138590104576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271753.257226:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3609:x1875138590104576:12345-0@lo:400:kworker.0 Request processed in 27us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271753.257232:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788271753.257256:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590104832 00000100:00100000:0.0:1788271753.257259:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590104832 00000100:00100000:0.0:1788271753.257274:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590105088 00000100:00100000:0.0:1788271753.257276:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590105088 00000100:00100000:0.0:1788271753.257288:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788271753.257293:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590104832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271753.257322:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590104832:12345-0@lo:400:kworker.0 Request processed in 28us (1539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271753.257327:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788271753.257339:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788271753.257344:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590105088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271753.257368:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590105088:12345-0@lo:400:kworker.0 Request processed in 24us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271753.257373:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788271753.257391:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590105600 00000100:00100000:0.0:1788271753.257395:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590105600 00000100:00100000:0.0:1788271753.257419:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590105472 00000100:00100000:0.0:1788271753.257422:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590105472 00000100:00100000:0.0:1788271753.257442:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788271753.257448:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590105600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271753.257489:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590105600:12345-0@lo:400:kworker.0 Request processed in 41us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271753.259977:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788271753.260968:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788271753.260990:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590105472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271753.261084:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590105472:12345-0@lo:400:kworker.0 Request processed in 104us (4144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271753.261092:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788271753.261232:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875138590104704:0@lo:400:kworker.0 00000100:00100000:2.0:1788271753.261247:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83291180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3607:1875138590105216:0@lo:400:kworker.0 00000100:00100000:2.0:1788271753.261277:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8336a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3607:1875138590105728:0@lo:400:kworker.0 00000100:00100000:2.0:1788271753.261288:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590104832:0@lo:400:kworker.0 00010000:00080000:2.0:1788271753.261301:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83293800 x1875138590105344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271753.261311:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83293800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3607:1875138590105344:0@lo:400:kworker.0 00010000:00080000:2.0:1788271753.261323:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d8336b480 x1875138590105856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271753.261331:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8336b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3607:1875138590105856:0@lo:400:kworker.0 00000100:00100000:0.0:1788271753.261496:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875138590104960:0@lo:400:kworker.0 00010000:00080000:0.0:1788271753.261584:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83292d80 x1875138590105472/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271753.261594:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590105472:0@lo:400:kworker.0 00000100:00100000:0.0:1788271753.261608:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83291c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590104576:0@lo:400:kworker.0 00000100:00100000:0.0:1788271753.261644:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83291f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590105088:0@lo:400:kworker.0 00010000:00080000:0.0:1788271753.261658:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4f3a300 x1875138590105600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271753.261665:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590105600:0@lo:400:kworker.0 00000100:00080000:2.0:1788271753.262671:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788271753.262679:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788271753.262682:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788271753.638034:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788271754.090922:0:12565:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788271754.092356:0:12565:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788271754.654781:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271755.678079:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788271756.117058:0:12663:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788271756.117352:0:12663:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788271756.205376:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271756.205451:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271756.205488:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577448320 00000100:00100000:0.0:1788271756.205497:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271756.205507:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577448320 00000100:00100000:0.0:1788271756.205537:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271756.205570:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271756.205585:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 307 00000100:00100000:0.0:1788271756.205603:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271756.205651:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2398:x1875138577448320:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788271756.205671:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271756.205711:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577448576 00000100:00100000:0.0:1788271756.205720:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577448576 00000100:00100000:2.0:1788271756.205742:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2398:x1875138577448320:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 143us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271756.205752:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 307 00000100:00100000:2.0:1788271756.205805:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577449088 00000100:00100000:2.0:1788271756.205810:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577449088 00000100:00100000:2.0:1788271756.205841:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577448960 00000100:00100000:2.0:1788271756.205844:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577448960 00000100:00100000:2.0:1788271756.205865:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 62 00000100:00100000:2.0:1788271756.205871:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:956fb91b-4885-4e88-90fb-3061936b51ca+5:2398:x1875138577449088:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788271756.205914:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:956fb91b-4885-4e88-90fb-3061936b51ca+5:2398:x1875138577449088:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 42us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271756.205922:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 62 00000100:00100000:2.0:1788271756.205938:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 63 00000100:00100000:2.0:1788271756.205947:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:956fb91b-4885-4e88-90fb-3061936b51ca+5:2398:x1875138577448960:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271756.205948:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577448832 00000100:00100000:3.0:1788271756.205957:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577448832 00000100:00100000:2.0:1788271756.205983:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:956fb91b-4885-4e88-90fb-3061936b51ca+5:2398:x1875138577448960:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 36us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271756.205995:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 63 00000100:00100000:3.0:1788271756.205999:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577448448 00000100:00100000:3.0:1788271756.206004:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577448448 00000100:00100000:3.0:1788271756.206034:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577448704 00000100:00100000:3.0:1788271756.206037:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577448704 00000100:00100000:2.0:1788271756.206040:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 149 00000100:00100000:2.0:1788271756.206054:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2398:x1875138577448576:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271756.206069:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 150 00000100:00100000:3.0:1788271756.206082:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4ec8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:956fb91b-4885-4e88-90fb-3061936b51ca+5:2398:x1875138577448832:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788271756.206092:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2398:x1875138577448576:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 39us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271756.206103:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 149 00000100:00100000:2.0:1788271756.206122:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 151 00000100:00100000:2.0:1788271756.206134:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2398:x1875138577448448:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271756.206166:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4ec8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:956fb91b-4885-4e88-90fb-3061936b51ca+5:2398:x1875138577448832:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 84us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271756.206182:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 150 00000100:00100000:2.0:1788271756.206183:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2398:x1875138577448448:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 45us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271756.206202:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 151 00000100:00100000:3.0:1788271756.206221:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 152 00000100:00100000:3.0:1788271756.206233:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:956fb91b-4885-4e88-90fb-3061936b51ca+5:2398:x1875138577448704:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271756.206272:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:956fb91b-4885-4e88-90fb-3061936b51ca+5:2398:x1875138577448704:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 42us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271756.206283:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 152 00000100:00080000:3.0:1788271756.206347:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788271756.206354:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788271756.206357:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788271756.206360:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788271756.702784:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271756.829955:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590106112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788271756.830125:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271756.830213:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590105984:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788271756.830242:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271756.830361:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590106240:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788271756.830409:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590106112 00000100:00100000:3.0:1788271756.830419:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590106112 00000100:00100000:0.0:1788271756.830472:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271756.830496:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590105984 00000100:00100000:3.0:1788271756.830502:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590105984 00000100:00100000:3.0:1788271756.830545:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788271756.830556:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebcd57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590106112:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788271756.830556:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590106240 00000100:00100000:0.0:1788271756.830566:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590106240 00002000:00000024:3.0:1788271756.830660:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788271756.830666:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788271756.830680:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590106240:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788271756.830718:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebcd57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590106112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 162us (591us total) trans 0 rc 0/0 00000004:00000024:0.0:1788271756.830719:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788271756.830786:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590106240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271756.830795:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788271756.830847:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590106240:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788271756.830913:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788271756.831270:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788271756.831279:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83031f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590105984:12345-0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1788271756.831439:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83369f80 x1875138590106112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271772 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271756.831460:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590106112:0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788271756.831813:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271756.831877:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83031f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590105984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 597us (1631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271756.831889:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1788271756.831919:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788271756.832204:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82ec5c00 x1875138590105984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271772 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271756.832221:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590105984:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788271757.737533:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271757.853914:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788271757.853948:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8336bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590106368:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788271757.854056:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271757.854192:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590106368 00000100:00100000:0.0:1788271757.854202:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590106368 00000100:00100000:0.0:1788271757.854270:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788271757.854281:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e871e7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590106368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788271757.854326:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788271757.854404:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e871e7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590106368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271757.854412:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788271757.854800:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8336bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590106368:0@lo:41:osp-pre-0-1.0 00000020:00000004:2.0:1788271758.186855:0:12761:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788271758.187113:0:12761:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788271758.365988:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788271758.366021:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d833d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590106496:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788271758.366135:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271758.366262:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788271758.366275:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590106624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788271758.368596:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271758.368862:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590107008:0@lo:400:kworker.0 00000100:00100000:0.0:1788271758.368935:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271758.368957:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3607:1875138590107520:0@lo:400:kworker.0 00000100:00100000:0.0:1788271758.368985:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271758.369019:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3607:1875138590108032:0@lo:400:kworker.0 00000100:00100000:0.0:1788271758.369043:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271758.369085:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788271758.369090:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875138590106880:0@lo:400:kworker.0 00000100:00100000:0.0:1788271758.369113:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271758.369131:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3607:1875138590107392:0@lo:400:kworker.0 00000100:00100000:0.0:1788271758.369152:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271758.369174:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3607:1875138590107904:0@lo:400:kworker.0 00000100:00100000:0.0:1788271758.369196:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271758.369229:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590107008 00000100:00100000:0.0:1788271758.369238:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590107008 00000100:00100000:0.0:1788271758.369300:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788271758.369312:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590107008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271758.369391:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590107008:12345-0@lo:400:kworker.0 Request processed in 81us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271758.369399:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788271758.369426:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590107520 00000100:00100000:0.0:1788271758.369431:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590107520 00000100:00100000:0.0:1788271758.369467:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590108032 00000100:00100000:0.0:1788271758.369469:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590108032 00000100:00100000:0.0:1788271758.369485:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590106880 00000100:00100000:0.0:1788271758.369488:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590106880 00000100:00100000:0.0:1788271758.369498:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590107392 00000100:00100000:0.0:1788271758.369500:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590107392 00000100:00100000:0.0:1788271758.369511:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590107904 00000100:00100000:0.0:1788271758.369513:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590107904 00000100:00100000:0.0:1788271758.369525:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788271758.369530:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875138590107520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271758.369571:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875138590107520:12345-0@lo:400:kworker.0 Request processed in 41us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271758.369579:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788271758.369590:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788271758.369595:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875138590108032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271758.369645:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875138590108032:12345-0@lo:400:kworker.0 Request processed in 23us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271758.369652:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788271758.369664:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788271758.369670:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0c63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875138590106880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271758.369696:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0c63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875138590106880:12345-0@lo:400:kworker.0 Request processed in 26us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271758.369701:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788271758.369710:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788271758.369715:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875138590107392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271758.369738:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0c60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875138590107392:12345-0@lo:400:kworker.0 Request processed in 23us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271758.369743:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788271758.369752:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788271758.369757:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875138590107904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271758.369780:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0c60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875138590107904:12345-0@lo:400:kworker.0 Request processed in 23us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271758.369786:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:0.0:1788271758.369820:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788271758.369824:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788271758.369866:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875138590106880:0@lo:400:kworker.0 00000100:00100000:0.0:1788271758.369877:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3607:1875138590107392:0@lo:400:kworker.0 00000100:00100000:0.0:1788271758.369887:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3607:1875138590107904:0@lo:400:kworker.0 00000100:00100000:0.0:1788271758.369896:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590107008:0@lo:400:kworker.0 00010000:00080000:0.0:1788271758.369909:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82ec6680 x1875138590107520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271758.369920:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3607:1875138590107520:0@lo:400:kworker.0 00010000:00080000:0.0:1788271758.369929:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82ec4e00 x1875138590108032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271758.369938:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3607:1875138590108032:0@lo:400:kworker.0 00000100:00100000:0.0:1788271758.370437:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875138590107136:0@lo:400:kworker.0 00000100:00100000:0.0:1788271758.370483:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271758.370513:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590107648:0@lo:400:kworker.0 00000100:00100000:0.0:1788271758.370543:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271758.370562:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590108160:0@lo:400:kworker.0 00000100:00100000:0.0:1788271758.370584:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271758.370613:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788271758.370639:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590106752:0@lo:400:kworker.0 00000100:00100000:0.0:1788271758.370673:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271758.370703:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590107264:0@lo:400:kworker.0 00000100:00100000:0.0:1788271758.370730:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271758.370747:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590107776:0@lo:400:kworker.0 00000100:00100000:0.0:1788271758.370783:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271758.370813:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590107648 00000100:00100000:0.0:1788271758.370820:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590107648 00000100:00100000:0.0:1788271758.370867:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590108160 00000100:00100000:0.0:1788271758.370870:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590108160 00000100:00100000:0.0:1788271758.370884:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590107776 00000100:00100000:0.0:1788271758.370886:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590107776 00000100:00100000:0.0:1788271758.370902:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788271758.370910:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0c61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590107648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271758.370956:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0c61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590107648:12345-0@lo:400:kworker.0 Request processed in 46us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271758.370964:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788271758.370979:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788271758.370986:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590108160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271758.371012:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590108160:12345-0@lo:400:kworker.0 Request processed in 27us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271758.371017:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788271758.371029:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788271758.371035:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ec5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590107776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271758.371060:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ec5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590107776:12345-0@lo:400:kworker.0 Request processed in 25us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271758.371066:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788271758.371245:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590106752 00000100:00100000:0.0:1788271758.371250:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590106752 00000100:00100000:0.0:1788271758.371280:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1788271758.371287:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3608:x1875138590106752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271758.371323:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3608:x1875138590106752:12345-0@lo:400:kworker.0 Request processed in 37us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271758.371337:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00080000:0.0:1788271758.371390:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788271758.371394:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788271758.371406:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590107264 00000100:00100000:0.0:1788271758.371410:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590107264 00000100:00100000:0.0:1788271758.371439:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788271758.371445:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590107264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271758.371476:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590107264:12345-0@lo:400:kworker.0 Request processed in 32us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271758.371482:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788271758.371501:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590107136 00000100:00100000:0.0:1788271758.371504:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590107136 00000100:00100000:0.0:1788271758.371527:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788271758.371532:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875138590107136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271758.371557:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0c61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875138590107136:12345-0@lo:400:kworker.0 Request processed in 25us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271758.371562:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788271758.371595:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590106752:0@lo:400:kworker.0 00000100:00100000:0.0:1788271758.371606:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590107264:0@lo:400:kworker.0 00010000:00080000:0.0:1788271758.371645:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82ec6300 x1875138590107776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271758.371657:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590107776:0@lo:400:kworker.0 00000100:00100000:0.0:1788271758.371669:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875138590107136:0@lo:400:kworker.0 00010000:00080000:0.0:1788271758.371678:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82ec6d80 x1875138590107648/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271758.371694:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590107648:0@lo:400:kworker.0 00010000:00080000:0.0:1788271758.371705:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb0c60e00 x1875138590108160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271758.371714:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0c60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590108160:0@lo:400:kworker.0 00000100:00100000:2.0:1788271758.372433:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590106496 00000100:00100000:2.0:1788271758.372442:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590106496 00000100:00100000:2.0:1788271758.372499:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590106624 00000100:00100000:2.0:1788271758.372502:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590106624 00000100:00100000:2.0:1788271758.372516:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788271758.372531:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83033b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590106496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788271758.372561:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788271758.372607:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83033b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590106496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (6474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271758.372613:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788271758.372648:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788271758.372655:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83031500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590106624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788271758.372665:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788271758.372692:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83031500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590106624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (4108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271758.372697:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1788271758.372796:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788271758.372826:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d833d4000 x1875138590106496/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271774 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271758.372847:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d833d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590106496:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1788271758.372878:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82ec5180 x1875138590106624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271774 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271758.372892:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590106624:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788271758.755875:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271759.776070:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788271760.399377:0:12858:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788271760.399851:0:12858:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788271760.801795:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271761.307373:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271761.307425:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271761.307458:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271761.307491:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271761.307522:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271761.307555:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577449472 00000100:00100000:0.0:1788271761.307577:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577449472 00000100:00100000:0.0:1788271761.307682:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577449728 00000100:00100000:0.0:1788271761.307685:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577449728 00000100:00100000:0.0:1788271761.307702:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577449344 00000100:00100000:0.0:1788271761.307705:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577449344 00000100:00100000:0.0:1788271761.307719:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577449600 00000100:00100000:0.0:1788271761.307721:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577449600 00000100:00100000:0.0:1788271761.307755:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 159 00000100:00100000:0.0:1788271761.307766:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2397:x1875138577449472:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271761.307929:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 160 00000100:00100000:1.0:1788271761.307955:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:956fb91b-4885-4e88-90fb-3061936b51ca+5:2397:x1875138577449728:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788271761.308040:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577449216 00000100:00100000:2.0:1788271761.308044:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577449216 00000100:00100000:2.0:1788271761.308076:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 309 00000100:00100000:2.0:1788271761.308083:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2397:x1875138577449216:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271761.308151:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 161 00000100:00100000:3.0:1788271761.308160:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2397:x1875138577449344:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788271761.308460:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2397:x1875138577449472:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 693us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271761.308469:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 159 00000100:00100000:0.0:1788271761.308490:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 162 00000100:00100000:0.0:1788271761.308505:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:956fb91b-4885-4e88-90fb-3061936b51ca+5:2397:x1875138577449600:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271761.308791:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:956fb91b-4885-4e88-90fb-3061936b51ca+5:2397:x1875138577449728:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 838us (1331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271761.308799:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 160 00000100:00100000:1.0:1788271761.310088:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271761.310261:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271761.312547:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2397:x1875138577449216:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 4442us (5168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271761.312572:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 309 00000100:00080000:1.0:1788271761.313737:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788271761.313751:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788271761.317101:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2397:x1875138577449344:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 8919us (9586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271761.317122:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 161 00000100:00100000:0.0:1788271761.318015:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:956fb91b-4885-4e88-90fb-3061936b51ca+5:2397:x1875138577449600:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 9500us (10482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271761.318030:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 162 00000100:00100000:1.0:1788271761.320987:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577449856 00000100:00100000:1.0:1788271761.321012:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577449856 00000100:00100000:1.0:1788271761.321165:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577449984 00000100:00100000:1.0:1788271761.321169:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577449984 00000100:00100000:3.0:1788271761.321225:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 22 00000100:00100000:3.0:1788271761.321241:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83030380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:956fb91b-4885-4e88-90fb-3061936b51ca+5:2394:x1875138577449856:12345-192.168.201.3@tcp:9:kworker.0 00000020:00000080:3.0:1788271761.321287:0:8452:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e828 00000100:00080000:3.0:1788271761.321300:0:8452:0:(import.c:65:import_set_state_nolock()) ffff8f6ebfbe2000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788271761.321390:0:8452:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788271761.321677:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83030380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:956fb91b-4885-4e88-90fb-3061936b51ca+2:2394:x1875138577449856:12345-192.168.201.3@tcp:9:kworker.0 Request processed in 439us (11597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271761.321686:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 22 00010000:00010000:0.0:1788271761.322979:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788271761.323881:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788271761.323890:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788271761.324238:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 23 00000100:00100000:1.0:1788271761.324254:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:956fb91b-4885-4e88-90fb-3061936b51ca+5:2394:x1875138577449984:12345-192.168.201.3@tcp:9:kworker.0 00000020:00000080:1.0:1788271761.324298:0:8397:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e82f 00000100:00080000:1.0:1788271761.324308:0:8397:0:(import.c:65:import_set_state_nolock()) ffff8f6d832b0800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788271761.324420:0:8397:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788271761.324669:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:956fb91b-4885-4e88-90fb-3061936b51ca+2:2394:x1875138577449984:12345-192.168.201.3@tcp:9:kworker.0 Request processed in 419us (14405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271761.324678:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 23 00010000:00010000:0.0:1788271761.326042:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271761.821999:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271761.949894:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788271761.949923:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590108288:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788271761.950001:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271761.950358:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590108288 00000100:00100000:0.0:1788271761.950367:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590108288 00000100:00100000:0.0:1788271761.950426:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788271761.950436:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d833d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590108288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788271761.950470:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788271761.950533:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d833d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590108288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271761.950540:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788271761.950651:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590108288:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788271761.950944:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788271761.950955:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590108416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788271761.951001:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271761.951086:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590108416 00000100:00100000:3.0:1788271761.951091:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590108416 00000100:00100000:3.0:1788271761.951136:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788271761.951144:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d833d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590108416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788271761.951181:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271761.951215:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d833d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590108416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271761.951222:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1788271761.951386:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788271761.951415:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83369500 x1875138590108416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271761.951431:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590108416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788271761.951605:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590108544:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788271761.951653:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271761.951737:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590108544 00000100:00100000:0.0:1788271761.951742:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590108544 00000100:00100000:0.0:1788271761.951784:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788271761.951793:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d833d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590108544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788271761.951806:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788271761.951846:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d833d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590108544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271761.951852:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:0.0:1788271761.951880:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82ec5c00 x1875138590108544/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271761.951893:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590108544:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788271761.951953:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788271762.851957:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271762.978589:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590108672:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788271762.978739:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271762.979014:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590108672 00000100:00100000:3.0:1788271762.979023:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590108672 00000100:00100000:3.0:1788271762.979079:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788271762.979089:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590108672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788271762.979123:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788271762.979182:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590108672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271762.979189:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788271762.979265:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590108672:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788271763.485821:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788271763.485844:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83030a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875138590109184:0@lo:400:kworker.0 00000100:00100000:1.0:1788271763.485890:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83032d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3606:1875138590109568:0@lo:400:kworker.0 00000100:00100000:0.0:1788271763.485909:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271763.485931:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590109184 00000100:00100000:1.0:1788271763.485937:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590109184 00000100:00100000:0.0:1788271763.485967:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83030700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875138590109056:0@lo:400:kworker.0 00000100:00100000:1.0:1788271763.485982:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788271763.485987:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271763.485990:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875138590109184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271763.486007:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83030e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590109696:0@lo:400:kworker.0 00000100:00100000:0.0:1788271763.486030:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271763.486046:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875138590109184:12345-0@lo:400:kworker.0 Request processed in 56us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271763.486050:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83032a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590110208:0@lo:400:kworker.0 00000100:00100000:1.0:1788271763.486065:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788271763.486068:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271763.486079:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590109056 00000100:00100000:1.0:1788271763.486083:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590109056 00000100:00100000:0.0:1788271763.486099:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83030a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875138590109184:0@lo:400:kworker.0 00000100:00100000:1.0:1788271763.486268:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788271763.486286:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875138590109056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271763.486317:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875138590109056:12345-0@lo:400:kworker.0 Request processed in 42us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271763.486323:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788271763.486346:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271763.486366:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83031c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3606:1875138590110080:0@lo:400:kworker.0 00000100:00100000:1.0:1788271763.486386:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271763.486403:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83030700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875138590109056:0@lo:400:kworker.0 00000100:00100000:1.0:1788271763.486410:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590109568 00000100:00100000:1.0:1788271763.486413:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590109568 00000100:00100000:0.0:1788271763.486420:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590110080 00000100:00100000:0.0:1788271763.486423:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590110080 00000100:00100000:1.0:1788271763.486438:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788271763.486444:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1875138590109568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271763.486451:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788271763.486457:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1875138590110080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271763.486475:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1875138590109568:12345-0@lo:400:kworker.0 Request processed in 31us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271763.486481:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788271763.486482:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1875138590110080:12345-0@lo:400:kworker.0 Request processed in 26us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271763.486487:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788271763.486505:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83032300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590109312:0@lo:400:kworker.0 00010000:00080000:1.0:1788271763.486506:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83032d80 x1875138590109568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271763.486517:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83032d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3606:1875138590109568:0@lo:400:kworker.0 00010000:00080000:1.0:1788271763.486526:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83031c00 x1875138590110080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271763.486534:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83031c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3606:1875138590110080:0@lo:400:kworker.0 00000100:00100000:0.0:1788271763.486680:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271763.486704:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83033800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590109824:0@lo:400:kworker.0 00000100:00100000:1.0:1788271763.486833:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590109312 00000100:00100000:1.0:1788271763.486843:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590109312 00000100:00100000:1.0:1788271763.486869:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788271763.486875:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83030700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590109312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271763.486904:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271763.486906:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83030700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590109312:12345-0@lo:400:kworker.0 Request processed in 32us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271763.486912:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788271763.486929:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590109696 00000100:00100000:0.0:1788271763.486929:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83251180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590110336:0@lo:400:kworker.0 00000100:00100000:1.0:1788271763.486932:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590109696 00000100:00100000:0.0:1788271763.486951:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271763.486952:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590110208 00000100:00100000:1.0:1788271763.486955:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590110208 00000100:00100000:1.0:1788271763.486966:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590109824 00000100:00100000:1.0:1788271763.486968:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590109824 00000100:00100000:0.0:1788271763.486970:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83032300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590109312:0@lo:400:kworker.0 00000100:00100000:1.0:1788271763.486978:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590110336 00000100:00100000:0.0:1788271763.486978:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1788271763.486980:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590110336 00000100:00100000:0.0:1788271763.486983:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590108928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788271763.486992:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788271763.486998:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590109696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271763.487003:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271763.487017:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83031880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590108800:0@lo:400:kworker.0 00000100:00100000:0.0:1788271763.487040:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271763.487060:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3608:1875138590109440:0@lo:400:kworker.0 00000100:00100000:0.0:1788271763.487079:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271763.487095:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83031180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3608:1875138590109952:0@lo:400:kworker.0 00000100:00100000:0.0:1788271763.487182:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271763.487260:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590109440 00000100:00100000:0.0:1788271763.487263:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590109440 00000100:00100000:0.0:1788271763.487295:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590109952 00000100:00100000:0.0:1788271763.487298:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590109952 00000100:00100000:0.0:1788271763.487316:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788271763.487322:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83032d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875138590109440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271763.487354:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83032d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875138590109440:12345-0@lo:400:kworker.0 Request processed in 30us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271763.487359:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788271763.487368:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788271763.487373:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875138590109952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271763.487395:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83157800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875138590109952:12345-0@lo:400:kworker.0 Request processed in 22us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271763.487408:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788271763.487577:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788271763.487586:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0c60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590110208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271763.487687:0:8396:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788271763.487695:0:8396:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00080000:2.0:1788271763.487704:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788271763.487708:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788271763.487720:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788271763.487722:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788271763.487747:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590108928 00000100:00100000:2.0:1788271763.487751:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590108928 00000100:00100000:2.0:1788271763.487795:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788271763.487802:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83032300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3608:x1875138590108928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788271763.487823:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788271763.488006:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83030000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3608:1875138590109440:0@lo:400:kworker.0 00000100:00100000:3.0:1788271763.490300:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0c60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590110208:12345-0@lo:400:kworker.0 Request processed in 2708us (4222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271763.490314:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788271763.490363:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788271763.490374:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83030a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590109824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271763.490422:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83030a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590109824:12345-0@lo:400:kworker.0 Request processed in 52us (3518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271763.490429:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788271763.490453:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788271763.490460:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83031c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3608:x1875138590110336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271763.490487:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83031c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3608:x1875138590110336:12345-0@lo:400:kworker.0 Request processed in 28us (3536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271763.490493:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788271763.490556:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d833d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590110464:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788271763.490593:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271763.490649:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590110464 00000100:00100000:3.0:1788271763.490657:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590110464 00000100:00100000:3.0:1788271763.490685:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788271763.490692:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8336b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590110464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788271763.490706:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271763.492687:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8336b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590110464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1986us (2084us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271763.492700:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:3.0:1788271763.492765:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d833d5180 x1875138590110464/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271779 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271763.492790:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d833d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590110464:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788271763.492906:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83032a00 x1875138590110208/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271763.492935:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83032a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590110208:0@lo:400:kworker.0 00000100:00100000:3.0:1788271763.492987:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590108800 00000100:00100000:3.0:1788271763.492994:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590108800 00000100:00100000:3.0:1788271763.493306:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788271763.493316:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3608:x1875138590108800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271763.493364:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3608:x1875138590108800:12345-0@lo:400:kworker.0 Request processed in 50us (6323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271763.493370:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788271763.495133:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83032300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590108928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7324us (8120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271763.495145:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788271763.495417:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83031180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3608:1875138590109952:0@lo:400:kworker.0 00010000:00080000:0.0:1788271763.495440:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83033800 x1875138590109824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271763.495452:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83033800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590109824:0@lo:400:kworker.0 00010000:00080000:0.0:1788271763.495465:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83251180 x1875138590110336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271763.495473:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83251180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590110336:0@lo:400:kworker.0 00010000:00080000:0.0:1788271763.495503:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82ec7800 x1875138590108928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271779 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271763.495615:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590109696:12345-0@lo:400:kworker.0 Request processed in 8615us (9582us total) trans 0 rc 0/0 00010000:00080000:3.0:1788271763.495756:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83030e00 x1875138590109696/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271763.495766:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83030e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590109696:0@lo:400:kworker.0 00000100:00100000:0.0:1788271763.495975:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590108928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788271763.495990:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83031880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590108800:0@lo:400:kworker.0 00000100:00100000:1.0:1788271763.496086:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:1.0:1788271763.875131:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788271764.345252:0:13004:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788271764.894494:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271765.917876:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271766.429987:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271766.430034:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271766.430066:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271766.430089:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271766.430115:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271766.430142:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577450368 00000100:00100000:1.0:1788271766.430151:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577450368 00000100:00100000:1.0:1788271766.430206:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577450624 00000100:00100000:1.0:1788271766.430210:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577450624 00000100:00100000:1.0:1788271766.430239:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577450240 00000100:00100000:1.0:1788271766.430261:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577450240 00000100:00100000:2.0:1788271766.430270:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577450112 00000100:00100000:2.0:1788271766.430274:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577450112 00000100:00100000:1.0:1788271766.430278:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577450496 00000100:00100000:1.0:1788271766.430280:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577450496 00000100:00100000:1.0:1788271766.430294:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 169 00000100:00100000:2.0:1788271766.430298:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 311 00000100:00100000:2.0:1788271766.430303:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2395:x1875138577450112:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271766.430303:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577450368:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788271766.430430:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2395:x1875138577450112:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 126us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271766.430439:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 311 00000100:00080000:2.0:1788271766.430470:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788271766.430473:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788271766.430802:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577450368:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 499us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271766.430809:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 169 00000100:00100000:1.0:1788271766.430825:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 170 00000100:00100000:1.0:1788271766.430833:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:956fb91b-4885-4e88-90fb-3061936b51ca+5:2395:x1875138577450624:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271766.430860:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:956fb91b-4885-4e88-90fb-3061936b51ca+5:2395:x1875138577450624:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 29us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271766.430866:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 170 00000100:00100000:1.0:1788271766.430877:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 171 00000100:00100000:1.0:1788271766.430883:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2395:x1875138577450240:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271766.430905:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2395:x1875138577450240:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 23us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271766.430911:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 171 00000100:00100000:1.0:1788271766.430923:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 172 00000100:00100000:1.0:1788271766.430929:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:956fb91b-4885-4e88-90fb-3061936b51ca+5:2395:x1875138577450496:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271766.430951:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:956fb91b-4885-4e88-90fb-3061936b51ca+5:2395:x1875138577450496:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 23us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271766.430957:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 172 00010000:00010000:2.0:1788271766.941771:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271767.070375:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d833d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590110592:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788271767.070479:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271767.070658:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590110592 00000100:00100000:2.0:1788271767.070668:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590110592 00000100:00100000:2.0:1788271767.070745:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788271767.070756:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590110592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788271767.070784:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788271767.070831:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590110592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271767.070839:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1788271767.070862:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788271767.070964:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d833d5c00 x1875138590110592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271783 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271767.070984:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d833d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590110592:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788271767.071003:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788271767.071009:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590110720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788271767.071036:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271767.071149:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590110720 00000100:00100000:2.0:1788271767.071155:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590110720 00000100:00100000:2.0:1788271767.071198:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788271767.071205:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590110720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788271767.071228:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788271767.071261:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590110720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271767.071267:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1788271767.071396:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788271767.071417:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83253b80 x1875138590110720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271783 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271767.071430:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590110720:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1788271767.074108:0:9475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 956fb91b-4885-4e88-90fb-3061936b51ca 00000020:00000080:1.0:1788271767.074116:0:9475:0:(genops.c:885:class_export_put()) final put ffff8f6d832b7000/956fb91b-4885-4e88-90fb-3061936b51ca 00000020:00000080:1.0:1788271767.074144:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6d832b7000/956fb91b-4885-4e88-90fb-3061936b51ca for lustre-OST0001 00000020:00000080:1.0:1788271767.074200:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f6d832b0800 for lustre-OST0001 00000100:00100000:1.0:1788271767.080829:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590110848:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788271767.080897:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271767.081018:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590110848 00000100:00100000:0.0:1788271767.081025:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590110848 00000100:00100000:0.0:1788271767.081075:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788271767.081082:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590110848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788271767.081110:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788271767.081147:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590110848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271767.081163:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788271767.081209:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590110848:0@lo:41:osp-pre-1-0.0 00000001:00100000:0.0:1788271767.087894:0:8391:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 956fb91b-4885-4e88-90fb-3061936b51ca 00000020:00000080:0.0:1788271767.087905:0:8391:0:(genops.c:885:class_export_put()) final put ffff8f6ebfbe6800/956fb91b-4885-4e88-90fb-3061936b51ca 00000020:00000080:3.0:1788271767.089300:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6ebfbe6800/956fb91b-4885-4e88-90fb-3061936b51ca for lustre-OST0000 00000020:00000080:3.0:1788271767.089360:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f6ebfbe2000 for lustre-OST0000 00000020:00000080:2.0:1788271767.426114:0:13151:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd72f9e620 20000000:00000080:2.0:1788271767.426133:0:13151:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f6d8312bc00 uarg=0000000000000000 20000000:01000000:2.0:1788271767.426174:0:13151:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788271767.426181:0:13151:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788271767.426192:0:13151:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788271767.426756:0:13152:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1788271767.426879:0:13151:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788271767.430905:0:13151:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788271767.430943:0:13151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f6eb4e20200/0x99288105fd38e836 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271767.430969:0:13151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6eb4e20a00/0x99288105fd38e7c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd325 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271767.430977:0:13151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6eb4e21000/0x99288105fd38e7d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e7cd expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271767.430984:0:13151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6e80030e00/0x99288105fd38e7e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e7db expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271767.430991:0:13151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6eb4ed5400/0x99288105fd38e7f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e7e9 expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271767.430998:0:13151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6eb4078400/0x99288105fd38e7fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e7f7 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271767.431004:0:13151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6eb4078e00/0x99288105fd38e813 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd364 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271767.431011:0:13151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f6eb4e20200/0x99288105fd38e836 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271767.431057:0:13151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6eb4078e00/0x99288105fd38e813 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd364 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271767.431071:0:13151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f6eb4078e00/0x99288105fd38e813 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd364 expref: 12 pid: 6478 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271767.431103:0:13151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d833d6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13151:1875138590110976:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788271767.431298:0:13151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6eb4078400/0x99288105fd38e7fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e7f7 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271767.431307:0:13151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f6eb4078400/0x99288105fd38e7fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e7f7 expref: 23 pid: 6478 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271767.431316:0:13151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d833d6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13151:1875138590111104:0@lo:104: 00000100:00100000:2.0:1788271767.431363:0:13151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788271767.431408:0:13151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6eb4ed5400/0x99288105fd38e7f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e7e9 expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271767.431416:0:13151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f6eb4ed5400/0x99288105fd38e7f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e7e9 expref: 23 pid: 6476 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271767.431424:0:13151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d833d5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13151:1875138590111232:0@lo:104: 00000100:00100000:2.0:1788271767.431450:0:13151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788271767.431545:0:13151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6e80030e00/0x99288105fd38e7e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e7db expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271767.431551:0:13151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f6e80030e00/0x99288105fd38e7e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e7db expref: 23 pid: 6477 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271767.431557:0:13151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d833d5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13151:1875138590111360:0@lo:104: 00000100:00100000:2.0:1788271767.431571:0:13151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788271767.431584:0:13151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6eb4e21000/0x99288105fd38e7d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e7cd expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271767.431600:0:13151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f6eb4e21000/0x99288105fd38e7d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e7cd expref: 23 pid: 6476 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271767.431609:0:13151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d833d7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13151:1875138590111488:0@lo:104: 00000100:00100000:2.0:1788271767.431664:0:13151:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788271767.431690:0:13151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6eb4e20a00/0x99288105fd38e7c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd325 expref: 12 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271767.431699:0:13151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f6eb4e20a00/0x99288105fd38e7c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd325 expref: 12 pid: 6478 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271767.431707:0:13151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d833d5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13151:1875138590111616:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788271767.431730:0:13151:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e82ae93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271767.431852:0:10303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590111104 00000100:00100000:0.0:1788271767.431859:0:10303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590111104 00000100:00100000:0.0:1788271767.431899:0:10303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590111232 00000100:00100000:0.0:1788271767.431902:0:10303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590111232 00000100:00100000:0.0:1788271767.431911:0:10303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590111360 00000100:00100000:0.0:1788271767.431912:0:10303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590111360 00000100:00100000:0.0:1788271767.431920:0:10303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590111488 00000100:00100000:0.0:1788271767.431922:0:10303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590111488 00000100:00100000:0.0:1788271767.431933:0:10303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788271767.431941:0:10303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d833d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f4eab87b-0440-4f90-8c88-4ffaef16406f+6:13151:x1875138590111104:12345-0@lo:104: 00010000:00010000:0.0:1788271767.431953:0:10303:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079a00/0x99288105fd38e7f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e7fe expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271767.432016:0:10303:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788271767.432023:0:10303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d833d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f4eab87b-0440-4f90-8c88-4ffaef16406f+6:13151:x1875138590111104:12345-0@lo:104: Request processed in 83us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271767.432030:0:10303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788271767.432045:0:10303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788271767.432051:0:10303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d833d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f4eab87b-0440-4f90-8c88-4ffaef16406f+5:13151:x1875138590111232:12345-0@lo:104: 00010000:00010000:0.0:1788271767.432058:0:10303:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079200/0x99288105fd38e7e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e7f0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271767.432091:0:10303:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788271767.432103:0:10303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d833d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f4eab87b-0440-4f90-8c88-4ffaef16406f+5:13151:x1875138590111232:12345-0@lo:104: Request processed in 53us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271767.432109:0:10303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788271767.432122:0:10303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788271767.432128:0:10303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d833d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f4eab87b-0440-4f90-8c88-4ffaef16406f+4:13151:x1875138590111360:12345-0@lo:104: 00010000:00010000:0.0:1788271767.432135:0:10303:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4c00/0x99288105fd38e7db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e7e2 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271767.432167:0:10303:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788271767.432172:0:10303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d833d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f4eab87b-0440-4f90-8c88-4ffaef16406f+4:13151:x1875138590111360:12345-0@lo:104: Request processed in 46us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271767.432178:0:10303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788271767.432189:0:10303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788271767.432195:0:10303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d833d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f4eab87b-0440-4f90-8c88-4ffaef16406f+3:13151:x1875138590111488:12345-0@lo:104: 00010000:00010000:0.0:1788271767.432202:0:10303:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6e80031e00/0x99288105fd38e7cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e7d4 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271767.432244:0:10303:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788271767.432250:0:10303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d833d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f4eab87b-0440-4f90-8c88-4ffaef16406f+3:13151:x1875138590111488:12345-0@lo:104: Request processed in 55us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271767.432255:0:10303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1788271767.432276:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788271767.432283:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079a00/0x99288105fd38e7f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e7fe expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271767.432289:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4079a00 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:0.0:1788271767.432293:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079a00/0x99288105fd38e7f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e7fe expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271767.432312:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079a00/0x99288105fd38e7f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e7fe expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788271767.432319:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079a00/0x99288105fd38e7f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e7fe expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271767.432324:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788271767.432351:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079a00/0x99288105fd38e7f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e7fe expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271767.432357:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788271767.432372:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079a00/0x99288105fd38e7f7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e7fe expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271767.432379:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079a00/0x99288105fd38e7f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e7fe expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271767.432390:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788271767.432393:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079200/0x99288105fd38e7e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e7f0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271767.432398:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4079200 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:0.0:1788271767.432400:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079200/0x99288105fd38e7e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e7f0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271767.432406:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079200/0x99288105fd38e7e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e7f0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788271767.432412:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079200/0x99288105fd38e7e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e7f0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271767.432423:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788271767.432436:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079200/0x99288105fd38e7e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e7f0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271767.432442:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788271767.432469:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079200/0x99288105fd38e7e9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e7f0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271767.432477:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079200/0x99288105fd38e7e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e7f0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271767.432487:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788271767.432490:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4c00/0x99288105fd38e7db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e7e2 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271767.432495:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4ed4c00 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:0.0:1788271767.432499:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4c00/0x99288105fd38e7db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e7e2 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271767.432505:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4c00/0x99288105fd38e7db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e7e2 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788271767.432511:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4c00/0x99288105fd38e7db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e7e2 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271767.432516:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788271767.432528:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4c00/0x99288105fd38e7db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e7e2 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271767.432534:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788271767.432547:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4c00/0x99288105fd38e7db lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e7e2 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271767.432553:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4c00/0x99288105fd38e7db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e7e2 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271767.432564:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271767.432566:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6e80031e00/0x99288105fd38e7cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e7d4 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271767.432573:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e80031e00 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:0.0:1788271767.432576:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6e80031e00/0x99288105fd38e7cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e7d4 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271767.432583:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6e80031e00/0x99288105fd38e7cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e7d4 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788271767.432589:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6e80031e00/0x99288105fd38e7cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e7d4 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271767.432594:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788271767.432607:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6e80031e00/0x99288105fd38e7cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e7d4 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271767.432613:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788271767.432652:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6e80031e00/0x99288105fd38e7cd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e7d4 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271767.432658:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6e80031e00/0x99288105fd38e7cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e7d4 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271767.432670:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271767.432677:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271767.432678:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271767.432685:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271767.432690:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271767.432712:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590112128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788271767.432748:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271767.432773:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788271767.432778:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590111744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788271767.432797:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271767.432820:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590111872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788271767.432840:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271767.432858:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788271767.432863:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590112000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788271767.432882:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271767.432908:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590112128 00000100:00100000:0.0:1788271767.432913:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590112128 00010000:00010000:0.0:1788271767.432933:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6eb4e21000/0x99288105fd38e7d4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e7cd expref: 24 pid: 6476 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271767.432954:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590111744 00000100:00100000:0.0:1788271767.432956:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590111744 00010000:00010000:0.0:1788271767.432966:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6eb4078400/0x99288105fd38e7fe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e7f7 expref: 25 pid: 6478 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271767.432976:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590111872 00000100:00100000:0.0:1788271767.432978:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590111872 00010000:00010000:0.0:1788271767.432987:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6eb4ed5400/0x99288105fd38e7f0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e7e9 expref: 26 pid: 6476 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271767.432996:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590112000 00000100:00100000:0.0:1788271767.433005:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590112000 00010000:00010000:0.0:1788271767.433018:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6e80030e00/0x99288105fd38e7e2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e7db expref: 27 pid: 6477 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271767.433030:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788271767.433036:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4eab87b-0440-4f90-8c88-4ffaef16406f+27:3608:x1875138590112128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788271767.433046:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271767.433051:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6eb4e21000/0x99288105fd38e7d4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e7cd expref: 27 pid: 6476 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271767.433061:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6eb4e21000/0x99288105fd38e7d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e7cd expref: 27 pid: 6476 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271767.433076:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271767.433106:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4eab87b-0440-4f90-8c88-4ffaef16406f+27:3608:x1875138590112128:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271767.433112:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788271767.433126:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788271767.433132:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4eab87b-0440-4f90-8c88-4ffaef16406f+26:3608:x1875138590111744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788271767.433139:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271767.433143:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6eb4078400/0x99288105fd38e7fe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e7f7 expref: 26 pid: 6478 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271767.433151:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6eb4078400/0x99288105fd38e7fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e7f7 expref: 26 pid: 6478 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271767.433160:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271767.433182:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4eab87b-0440-4f90-8c88-4ffaef16406f+26:3608:x1875138590111744:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271767.433187:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788271767.433207:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788271767.433230:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4eab87b-0440-4f90-8c88-4ffaef16406f+25:3606:x1875138590111872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788271767.433239:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271767.433243:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6eb4ed5400/0x99288105fd38e7f0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e7e9 expref: 25 pid: 6476 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271767.433252:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6eb4ed5400/0x99288105fd38e7f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e7e9 expref: 25 pid: 6476 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271767.433261:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271767.433288:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4eab87b-0440-4f90-8c88-4ffaef16406f+25:3606:x1875138590111872:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271767.433294:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788271767.433306:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788271767.433312:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3606:x1875138590112000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788271767.433320:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271767.433324:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6e80030e00/0x99288105fd38e7e2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e7db expref: 24 pid: 6477 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271767.433331:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6e80030e00/0x99288105fd38e7e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e7db expref: 24 pid: 6477 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271767.433340:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271767.433362:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3606:x1875138590112000:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271767.433367:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788271767.433409:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83157b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590112000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788271767.433418:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83156680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590111872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788271767.433451:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83154a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590111744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788271767.433459:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590112128:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788271767.433655:0:13151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4078400/0x99288105fd38e7fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e7f7 expref: 23 pid: 6478 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271767.433669:0:13151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d833d6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13151:1875138590111104:0@lo:104: 00010000:00010000:2.0:1788271767.433679:0:13151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4ed5400/0x99288105fd38e7f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e7e9 expref: 22 pid: 6476 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271767.433687:0:13151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d833d5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13151:1875138590111232:0@lo:104: 00010000:00010000:2.0:1788271767.433695:0:13151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6e80030e00/0x99288105fd38e7e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e7db expref: 21 pid: 6477 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271767.433703:0:13151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d833d5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13151:1875138590111360:0@lo:104: 00010000:00010000:2.0:1788271767.433712:0:13151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4e21000/0x99288105fd38e7d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e7cd expref: 20 pid: 6476 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271767.433731:0:13151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d833d7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13151:1875138590111488:0@lo:104: 00010000:00010000:3.0:1788271767.433808:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271767.438125:0:13151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d833d6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13151:1875138590110976:192.168.201.3@tcp:104: 00000100:00100000:1.0:1788271767.438141:0:13151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d833d5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13151:1875138590111616:192.168.201.3@tcp:104: 00010000:00010000:1.0:1788271767.438183:0:13151:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f6eb4e20200/0x99288105fd38e836 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271767.443045:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271767.443136:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271767.443228:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577450752 00000100:00100000:2.0:1788271767.443239:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577450752 00010000:00010000:2.0:1788271767.443278:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6eb4078e00/0x99288105fd38e813 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd364 expref: 13 pid: 6478 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271767.443315:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577450880 00000100:00100000:2.0:1788271767.443319:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577450880 00010000:00010000:2.0:1788271767.443331:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6eb4e20a00/0x99288105fd38e7c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd325 expref: 14 pid: 6478 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271767.443359:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 44 00000100:00100000:2.0:1788271767.443368:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8318b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a94beb9-7f16-4b5a-842a-fac2e5234617+14:2398:x1875138577450752:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271767.443383:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271767.443389:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6eb4078e00/0x99288105fd38e813 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd364 expref: 14 pid: 6478 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271767.443402:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6eb4078e00/0x99288105fd38e813 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd364 expref: 14 pid: 6478 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271767.443420:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4078e00/0x99288105fd38e813 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd364 expref: 14 pid: 6478 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271767.443435:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271767.443491:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8318b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2398:x1875138577450752:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 124us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271767.443499:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 44 00000100:00100000:2.0:1788271767.443516:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 45 00000100:00100000:2.0:1788271767.443531:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3599c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a94beb9-7f16-4b5a-842a-fac2e5234617+12:2398:x1875138577450880:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271767.443539:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271767.443543:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6eb4e20a00/0x99288105fd38e7c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd325 expref: 12 pid: 6478 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271767.443553:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6eb4e20a00/0x99288105fd38e7c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd325 expref: 12 pid: 6478 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271767.443563:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4e20a00/0x99288105fd38e7c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd325 expref: 12 pid: 6478 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271767.443572:0:6468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f6eb4e20200/0x99288105fd38e836 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271767.443578:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4e20200/0x99288105fd38e836 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271767.443588:0:6468:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f6eb4e20200/0x99288105fd38e836 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271767.443593:0:6468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f6eb4e20200/0x99288105fd38e836 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271767.443597:0:6468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f6eb4e20200/0x99288105fd38e836 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271767.443601:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f6eb4e20200/0x99288105fd38e836 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271767.443605:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e20200 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:2.0:1788271767.443608:0:6468:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f6eb4e20200/0x99288105fd38e836 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271767.443649:0:6468:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f6eb4e20200/0x99288105fd38e836 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271767.443658:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f6eb4e20200/0x99288105fd38e836 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271767.443666:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271767.443681:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3599c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8a94beb9-7f16-4b5a-842a-fac2e5234617+11:2398:x1875138577450880:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 153us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271767.443686:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 45 00010000:00010000:1.0:1788271767.444005:0:13151:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f6eb4e20200/0x99288105fd38e836 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271767.444015:0:13151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f6eb4e20200/0x99288105fd38e836 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271767.444022:0:13151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4e20200/0x99288105fd38e836 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271767.967874:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271768.093952:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590112256:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788271768.094076:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271768.097686:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590112256 00000100:00100000:2.0:1788271768.097703:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590112256 00000100:00100000:2.0:1788271768.097791:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788271768.097803:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590112256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788271768.097845:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788271768.097958:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590112256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 157us (3881us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271768.097965:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788271768.100476:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590112256:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788271768.614678:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788271768.614705:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d833d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590112384:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788271768.614776:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1788271768.615093:0:6480:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788271768.615098:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f6d820cc800 from 7 10000000:01000000:0.0:1788271768.615102:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788271768.615138:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079e00/0x99288105fd38e83d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271768.615149:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079e00/0x99288105fd38e83d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271768.615159:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079e00/0x99288105fd38e83d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271768.615176:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfb87480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590112512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788271768.615239:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271768.615262:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e89061d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788271768.615290:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590112512 00000100:00100000:0.0:1788271768.615296:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590112512 00000100:00100000:0.0:1788271768.615445:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788271768.615458:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:6480:x1875138590112512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788271768.615470:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271768.615494:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4079800/0x99288105fd38e844 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e83d expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271768.615518:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4079800/0x99288105fd38e844 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e83d expref: 21 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271768.615529:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4079800/0x99288105fd38e844 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e83d expref: 21 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271768.615538:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4079800, rc 0) 00000100:00100000:0.0:1788271768.615575:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:6480:x1875138590112512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271768.615582:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788271768.615650:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfb87480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590112512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788271768.615664:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079e00/0x99288105fd38e83d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e844 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271768.615673:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079e00/0x99288105fd38e83d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e844 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271768.615852:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfb87480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590112640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271768.615881:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271768.615883:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590112384 00000100:00100000:2.0:1788271768.615890:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590112384 00000100:00100000:0.0:1788271768.615900:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e89061d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788271768.615920:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590112640 00000100:00100000:0.0:1788271768.615924:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590112640 00000100:00100000:2.0:1788271768.615936:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788271768.615946:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83189500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590112384:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788271768.615956:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1788271768.615966:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:6480:x1875138590112640:12345-0@lo:501:ll_cfg_requeue.0 00002000:00000024:2.0:1788271768.615969:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788271768.616013:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83189500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590112384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271768.616020:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788271768.616721:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788271768.616739:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d833d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875138590112768:0@lo:400:kworker.0 00000100:00100000:2.0:1788271768.616774:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271768.616840:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d833d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3606:1875138590113152:0@lo:400:kworker.0 00000100:00100000:2.0:1788271768.616868:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271768.616909:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788271768.616916:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d833d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3606:1875138590113280:0@lo:400:kworker.0 00000100:00100000:2.0:1788271768.616956:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271768.617011:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3606:1875138590113664:0@lo:400:kworker.0 00000100:00100000:2.0:1788271768.617037:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271768.617067:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590112768 00000100:00100000:2.0:1788271768.617072:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590112768 00000100:00100000:2.0:1788271768.617102:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590113152 00000100:00100000:2.0:1788271768.617105:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590113152 00000100:00100000:2.0:1788271768.617119:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590113280 00000100:00100000:2.0:1788271768.617121:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590113280 00000100:00100000:2.0:1788271768.617133:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590113664 00000100:00100000:2.0:1788271768.617135:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590113664 00000100:00100000:2.0:1788271768.617149:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788271768.617156:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d833d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875138590112768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271768.617221:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d833d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875138590112768:12345-0@lo:400:kworker.0 Request processed in 65us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271768.617229:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788271768.617244:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788271768.617252:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d833d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1875138590113152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271768.617281:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d833d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1875138590113152:12345-0@lo:400:kworker.0 Request processed in 31us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271768.617287:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788271768.617307:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788271768.617313:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1875138590113280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271768.617344:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1875138590113280:12345-0@lo:400:kworker.0 Request processed in 32us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271768.617350:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788271768.617362:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788271768.617368:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3606:x1875138590113664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271768.617393:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3606:x1875138590113664:12345-0@lo:400:kworker.0 Request processed in 26us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271768.617399:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788271768.617434:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3606:1875138590113664:0@lo:400:kworker.0 00010000:00080000:2.0:1788271768.617448:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d833d6680 x1875138590113280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271768.617458:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d833d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3606:1875138590113280:0@lo:400:kworker.0 00000100:00100000:2.0:1788271768.617468:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d833d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3606:1875138590113152:0@lo:400:kworker.0 00000100:00100000:2.0:1788271768.617477:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d833d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875138590112768:0@lo:400:kworker.0 00000100:00100000:2.0:1788271768.617518:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788271768.617525:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3606:1875138590113792:0@lo:400:kworker.0 00000100:00100000:2.0:1788271768.617552:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271768.617576:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590113792 00000100:00100000:2.0:1788271768.617580:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590113792 00000100:00100000:2.0:1788271768.617604:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788271768.617610:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1875138590113792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271768.617667:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1875138590113792:12345-0@lo:400:kworker.0 Request processed in 57us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271768.617681:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00010000:00080000:2.0:1788271768.617709:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83292d80 x1875138590113792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271768.617718:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3606:1875138590113792:0@lo:400:kworker.0 00000100:00080000:1.0:1788271768.617858:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788271768.617862:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788271768.617865:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788271768.617886:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d833d5180 x1875138590112384/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271784 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271768.617902:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d833d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590112384:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788271768.617924:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d833d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875138590112896:0@lo:400:kworker.0 00000100:00100000:1.0:1788271768.617952:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271768.617969:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83291f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590113408:0@lo:400:kworker.0 00000100:00100000:1.0:1788271768.617990:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271768.618008:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590113920:0@lo:400:kworker.0 00000100:00100000:1.0:1788271768.618032:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271768.618053:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788271768.618058:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d833d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590113024:0@lo:400:kworker.0 00000100:00100000:1.0:1788271768.618081:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271768.618106:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83291c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590113536:0@lo:400:kworker.0 00000100:00100000:1.0:1788271768.618127:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271768.618144:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8318aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590114048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788271768.618164:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271768.618205:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590112896 00000100:00100000:1.0:1788271768.618209:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590112896 00000100:00100000:1.0:1788271768.618237:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788271768.618243:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83189880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875138590112896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271768.618280:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83189880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875138590112896:12345-0@lo:400:kworker.0 Request processed in 37us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271768.618286:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788271768.618309:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590113408 00000100:00100000:1.0:1788271768.618314:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590113408 00000100:00100000:1.0:1788271768.618340:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590113920 00000100:00100000:0.0:1788271768.618542:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:6480:x1875138590112640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2577us (2659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271768.618556:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1788271768.618590:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590114048 00000100:00100000:0.0:1788271768.618594:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590114048 00000100:00100000:0.0:1788271768.618642:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788271768.618649:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8318bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590114048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788271768.618662:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788271768.618696:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8318bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590114048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271768.618814:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590113536 00000100:00100000:3.0:1788271768.618820:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590113536 00000100:00100000:3.0:1788271768.618852:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788271768.618859:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590113408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271768.618894:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590113408:12345-0@lo:400:kworker.0 Request processed in 36us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271768.618900:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788271768.618913:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788271768.618919:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8318a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590113536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271768.618958:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8318a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590113536:12345-0@lo:400:kworker.0 Request processed in 40us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271768.618965:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788271768.619022:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590113920 00000100:00100000:1.0:1788271768.619054:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788271768.619060:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3608:x1875138590113920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271768.619091:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3608:x1875138590113920:12345-0@lo:400:kworker.0 Request processed in 32us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271768.619097:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788271768.619116:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590113024 00000100:00100000:1.0:1788271768.619119:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590113024 00000100:00100000:1.0:1788271768.619145:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788271768.619152:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590113024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271768.619187:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590113024:12345-0@lo:400:kworker.0 Request processed in 36us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271768.619205:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788271768.619250:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d833d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590113024:0@lo:400:kworker.0 00010000:00080000:1.0:1788271768.619263:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83291c00 x1875138590113536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271768.619272:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83291c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590113536:0@lo:400:kworker.0 00010000:00080000:1.0:1788271768.619281:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d8318aa00 x1875138590114048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271784 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271768.619294:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8318aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590114048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788271768.619305:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d833d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875138590112896:0@lo:400:kworker.0 00010000:00080000:1.0:1788271768.619316:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83291f80 x1875138590113408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271768.619323:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83291f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590113408:0@lo:400:kworker.0 00010000:00080000:1.0:1788271768.619331:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83292d80 x1875138590113920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271768.619338:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590113920:0@lo:400:kworker.0 00000100:00100000:0.0:1788271768.619420:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788271768.620806:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfb87480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590112640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271768.620858:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfb87480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590114176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788271768.620917:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271768.620955:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e89061d80 going to sleep for 11 seconds 00000100:00080000:0.0:1788271768.620971:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788271768.620985:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590114176 00000100:00100000:0.0:1788271768.620990:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590114176 00000100:00100000:0.0:1788271768.621031:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788271768.621041:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:6480:x1875138590114176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788271768.621154:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:6480:x1875138590114176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 115us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271768.621162:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788271768.621226:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfb87480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590114176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788271768.624085:0:13173:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788271768.624207:0:6480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788271768.624231:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788271768.624242:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079e00/0x99288105fd38e83d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e844 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271768.624260:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079e00/0x99288105fd38e83d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e844 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271768.624271:0:6480:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788271768.624274:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f6eb4b8b800 from 7 10000000:01000000:0.0:1788271768.624277:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788271768.624310:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079000/0x99288105fd38e84b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271768.624318:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079000/0x99288105fd38e84b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271768.624329:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079000/0x99288105fd38e84b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271768.624361:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfb87480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590114304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788271768.624421:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271768.624642:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e89061d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788271768.624917:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590114304 00000100:00100000:1.0:1788271768.624923:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590114304 00000100:00100000:2.0:1788271768.625099:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788271768.625110:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:6480:x1875138590114304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788271768.625122:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271768.625136:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4e21000/0x99288105fd38e852 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e84b expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271768.625161:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4e21000/0x99288105fd38e852 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e84b expref: 22 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271768.625172:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4e21000/0x99288105fd38e852 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e84b expref: 22 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271768.625181:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e21000, rc 0) 00000100:00100000:2.0:1788271768.625244:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:6480:x1875138590114304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271768.625251:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1788271768.625260:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfb87480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590114304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788271768.625283:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079000/0x99288105fd38e84b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e852 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271768.625293:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079000/0x99288105fd38e84b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e852 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271768.625418:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfb87480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590114432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271768.625517:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271768.625557:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e89061d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788271768.625693:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590114432 00000100:00100000:2.0:1788271768.625700:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590114432 00000100:00100000:2.0:1788271768.625732:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788271768.625740:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:6480:x1875138590114432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271768.625924:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfb87480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590114432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271768.625955:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfb87480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590114560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788271768.625963:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:6480:x1875138590114432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 223us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271768.625983:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788271768.626000:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271768.626027:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e89061d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788271768.626054:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590114560 00000100:00100000:2.0:1788271768.626060:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590114560 00000100:00100000:2.0:1788271768.626089:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1788271768.626098:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:6480:x1875138590114560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788271768.626182:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:6480:x1875138590114560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271768.626201:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1788271768.626431:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfb87480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590114560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788271768.627998:0:13175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788271768.628171:0:6480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788271768.628276:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788271768.628286:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079000/0x99288105fd38e84b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e852 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271768.628298:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079000/0x99288105fd38e84b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e852 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271768.628387:0:6480:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788271768.628390:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f6eb0cef800 from 7 10000000:01000000:1.0:1788271768.628392:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788271768.628424:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e859 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271768.628431:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e859 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271768.628443:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e859 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271768.628464:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8318aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590114688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788271768.628525:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271768.628570:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d9b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788271768.628686:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590114688 00000100:00100000:2.0:1788271768.628693:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590114688 00000100:00100000:2.0:1788271768.628740:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1788271768.628749:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:6480:x1875138590114688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788271768.628762:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271768.628775:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4e20a00/0x99288105fd38e860 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e859 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271768.628796:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4e20a00/0x99288105fd38e860 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e859 expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271768.628807:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4e20a00/0x99288105fd38e860 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e859 expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271768.628816:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e20a00, rc 0) 00000100:00100000:2.0:1788271768.628857:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:6480:x1875138590114688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271768.628865:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1788271768.628890:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8318aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590114688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788271768.628905:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e859 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e860 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271768.628915:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e859 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e860 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271768.628972:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8318aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590114816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271768.628998:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271768.629017:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d9b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788271768.629154:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590114816 00000100:00100000:2.0:1788271768.629166:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590114816 00000100:00100000:2.0:1788271768.629200:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1788271768.629207:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:6480:x1875138590114816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788271768.629305:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:6480:x1875138590114816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271768.629312:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1788271768.630153:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8318aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590114816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271768.630201:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8318aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590114944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271768.630420:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271768.630460:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d9b180 going to sleep for 11 seconds 00000100:00100000:3.0:1788271768.630520:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590114944 00000100:00100000:3.0:1788271768.630526:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590114944 00000100:00100000:3.0:1788271768.630560:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1788271768.630568:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:6480:x1875138590114944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788271768.630698:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:6480:x1875138590114944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271768.630716:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1788271768.630909:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8318aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590114944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788271768.638604:0:13176:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788271768.638826:0:6480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788271768.638854:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788271768.638865:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e859 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e860 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271768.638877:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e859 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e860 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271768.638887:0:6480:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788271768.638890:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f6e91513000 from 7 10000000:01000000:1.0:1788271768.638893:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788271768.638931:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4600/0x99288105fd38e867 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271768.638938:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4600/0x99288105fd38e867 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271768.638951:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4600/0x99288105fd38e867 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271768.638978:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8318b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590115072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788271768.639051:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271768.639099:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d9bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271768.639232:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590115072 00000100:00100000:2.0:1788271768.639241:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590115072 00000100:00100000:2.0:1788271768.639297:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788271768.639305:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:6480:x1875138590115072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788271768.639318:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271768.639331:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4e20200/0x99288105fd38e86e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e867 expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271768.639353:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4e20200/0x99288105fd38e86e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e867 expref: 24 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271768.639363:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4e20200/0x99288105fd38e86e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e867 expref: 24 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271768.639372:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e20200, rc 0) 00000100:00100000:2.0:1788271768.639417:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:6480:x1875138590115072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271768.639424:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788271768.639469:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8318b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590115072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788271768.639483:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4600/0x99288105fd38e867 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e86e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271768.639507:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4600/0x99288105fd38e867 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e86e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271768.639570:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83292680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590115200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788271768.639591:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271768.639610:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9836cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788271768.639660:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590115200 00000100:00100000:1.0:1788271768.639666:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590115200 00000100:00100000:1.0:1788271768.639694:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788271768.639713:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:6480:x1875138590115200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271768.639816:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:6480:x1875138590115200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271768.639830:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1788271768.639856:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83292680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590115200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788271768.639887:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83292680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590115328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788271768.639928:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271768.640294:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590115328 00000100:00100000:1.0:1788271768.640300:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590115328 00000100:00100000:1.0:1788271768.640407:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1788271768.640415:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:6480:x1875138590115328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271768.641060:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:6480:x1875138590115328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 643us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271768.641068:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1788271768.641889:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9836cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788271768.641917:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83292680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590115328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788271768.649936:0:13178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788271768.650144:0:6480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788271768.650167:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788271768.650179:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4600/0x99288105fd38e867 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e86e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271768.650201:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4600/0x99288105fd38e867 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e86e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271768.995869:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271769.118361:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271769.120893:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577451008 00000100:00100000:1.0:1788271769.120907:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577451008 00000100:00100000:1.0:1788271769.120983:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 324 00000100:00100000:1.0:1788271769.120995:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+11:6170:x1875138577451008:12345-192.168.201.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788271769.121011:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271769.121030:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4ed4a00/0x99288105fd38e875 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd395 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271769.121061:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4ed4a00/0x99288105fd38e875 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd395 expref: 12 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271769.121072:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4ed4a00/0x99288105fd38e875 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd395 expref: 12 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271769.121089:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4ed4a00, rc 0) 00000100:00100000:1.0:1788271769.121154:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+12:6170:x1875138577451008:12345-192.168.201.3@tcp:101:ll_cfg_requeue.0 Request processed in 161us (2804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271769.121161:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 324 00000100:00100000:0.0:1788271769.129903:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271769.132543:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577451136 00000100:00100000:1.0:1788271769.132558:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577451136 00000100:00100000:1.0:1788271769.132646:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 325 00000100:00100000:1.0:1788271769.132655:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+12:6170:x1875138577451136:12345-192.168.201.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271769.133726:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+12:6170:x1875138577451136:12345-192.168.201.3@tcp:501:ll_cfg_requeue.0 Request processed in 1066us (3829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271769.133736:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 325 00000100:00100000:1.0:1788271769.140993:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271769.141082:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577451264 00000100:00100000:0.0:1788271769.141093:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577451264 00000100:00100000:0.0:1788271769.141199:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 326 00000100:00100000:0.0:1788271769.141209:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+12:6170:x1875138577451264:12345-192.168.201.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788271769.141364:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+12:6170:x1875138577451264:12345-192.168.201.3@tcp:503:ll_cfg_requeue.0 Request processed in 156us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271769.141372:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 326 00000100:00100000:0.0:1788271769.146031:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271769.146577:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577451392 00000100:00100000:1.0:1788271769.146589:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577451392 00000100:00100000:1.0:1788271769.146659:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 327 00000100:00100000:1.0:1788271769.146667:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+12:6170:x1875138577451392:12345-192.168.201.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788271769.146682:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271769.146705:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4ed4c00/0x99288105fd38e87c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd39c expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271769.146728:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4ed4c00/0x99288105fd38e87c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd39c expref: 13 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271769.146735:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4ed4c00/0x99288105fd38e87c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd39c expref: 13 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271769.146756:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4ed4c00, rc 0) 00000100:00100000:1.0:1788271769.146818:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:6170:x1875138577451392:12345-192.168.201.3@tcp:101:ll_cfg_requeue.0 Request processed in 150us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271769.146825:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 327 00000100:00100000:3.0:1788271769.149069:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271769.149160:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577451520 00000100:00100000:1.0:1788271769.149171:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577451520 00000100:00100000:1.0:1788271769.149235:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 328 00000100:00100000:1.0:1788271769.149245:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:6170:x1875138577451520:12345-192.168.201.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271769.149394:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:6170:x1875138577451520:12345-192.168.201.3@tcp:501:ll_cfg_requeue.0 Request processed in 150us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271769.149403:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 328 00000100:00100000:3.0:1788271769.151397:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271769.151492:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577451648 00000100:00100000:0.0:1788271769.151502:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577451648 00000100:00100000:0.0:1788271769.151556:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 329 00000100:00100000:0.0:1788271769.151565:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:6170:x1875138577451648:12345-192.168.201.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788271769.151714:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:6170:x1875138577451648:12345-192.168.201.3@tcp:503:ll_cfg_requeue.0 Request processed in 150us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271769.151726:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 329 00010000:00010000:0.0:1788271770.013759:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788271770.707604:0:13350:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg103-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788271771.040208:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271771.552855:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271771.552942:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271771.552976:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271771.553009:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271771.553029:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271771.553112:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577452032 00000100:00100000:1.0:1788271771.553122:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577452032 00000100:00100000:1.0:1788271771.553238:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577452288 00000100:00100000:1.0:1788271771.553242:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577452288 00000100:00100000:1.0:1788271771.553256:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577451904 00000100:00100000:1.0:1788271771.553259:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577451904 00000100:00100000:1.0:1788271771.553269:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577452160 00000100:00100000:1.0:1788271771.553271:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577452160 00000100:00100000:1.0:1788271771.553288:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 179 00000100:00100000:1.0:1788271771.553297:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2398:x1875138577452032:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271771.553380:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2398:x1875138577452032:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 74us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271771.553589:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 179 00000100:00100000:1.0:1788271771.553609:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 180 00000100:00100000:1.0:1788271771.553616:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:956fb91b-4885-4e88-90fb-3061936b51ca+5:2398:x1875138577452288:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271771.553686:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:956fb91b-4885-4e88-90fb-3061936b51ca+5:2398:x1875138577452288:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 70us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271771.553692:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 180 00000100:00100000:1.0:1788271771.553705:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 181 00000100:00100000:1.0:1788271771.553725:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2398:x1875138577451904:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271771.553749:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2398:x1875138577451904:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 24us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271771.553756:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 181 00000100:00100000:1.0:1788271771.553766:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 182 00000100:00100000:1.0:1788271771.553772:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:956fb91b-4885-4e88-90fb-3061936b51ca+5:2398:x1875138577452160:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271771.553793:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:956fb91b-4885-4e88-90fb-3061936b51ca+5:2398:x1875138577452160:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 21us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271771.553798:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 182 00000100:00080000:0.0:1788271771.554690:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788271771.554697:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788271771.555088:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577451776 00000100:00100000:3.0:1788271771.555098:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577451776 00000100:00100000:3.0:1788271771.555207:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 330 00000100:00100000:3.0:1788271771.555218:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2398:x1875138577451776:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271771.555286:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2398:x1875138577451776:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 70us (2440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271771.555292:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 330 00010000:00010000:0.0:1788271772.063557:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271772.190268:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8318b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590115456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788271772.190359:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271772.190464:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590115456 00000100:00100000:1.0:1788271772.190471:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590115456 00000100:00100000:1.0:1788271772.190539:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788271772.190550:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8318a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590115456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788271772.190578:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788271772.190650:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8318a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590115456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271772.190658:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1788271772.190680:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788271772.190722:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d8318b100 x1875138590115456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271788 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271772.190740:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8318b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590115456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788271772.193241:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83291180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590115712:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788271772.193302:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271772.193850:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590115712 00000100:00100000:1.0:1788271772.193859:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590115712 00000100:00100000:1.0:1788271772.193912:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788271772.193922:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590115712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788271772.193952:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788271772.194006:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590115712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271772.194012:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788271772.194037:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590115584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788271772.194062:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271772.194094:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590115584 00000100:00100000:1.0:1788271772.194097:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590115584 00000100:00100000:1.0:1788271772.194137:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788271772.194144:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8318b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590115584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788271772.194157:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788271772.194186:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8318b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590115584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271772.194193:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1788271772.194207:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788271772.194229:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83292680 x1875138590115584/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271788 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271772.194247:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83292680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590115584:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788271772.194337:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83291180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590115712:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788271773.089282:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271773.214014:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788271773.214038:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590115840:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788271773.214118:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271773.214267:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590115840 00000100:00100000:1.0:1788271773.214287:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590115840 00000100:00100000:1.0:1788271773.214337:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788271773.214346:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590115840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788271773.214379:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788271773.214435:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590115840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271773.214442:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788271773.214601:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83368700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590115840:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788271773.726052:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788271773.726072:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83188a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590115968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788271773.726171:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271773.726244:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590115968 00000100:00100000:1.0:1788271773.726252:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590115968 00000100:00100000:1.0:1788271773.726302:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788271773.726310:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8318b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590115968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788271773.726335:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788271773.726368:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8318b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590115968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271773.726372:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1788271773.726388:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788271773.726409:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83188a80 x1875138590115968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271789 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271773.726422:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83188a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590115968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788271773.726765:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788271773.726865:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590116224:0@lo:400:kworker.0 00000100:00100000:1.0:1788271773.726893:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271773.726912:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788271773.726915:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8336a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875138590116352:0@lo:400:kworker.0 00000100:00100000:1.0:1788271773.726954:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271773.726977:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590116352 00000100:00100000:1.0:1788271773.726980:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590116352 00000100:00100000:1.0:1788271773.727000:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788271773.727004:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83188a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875138590116352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271773.727028:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83188a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875138590116352:12345-0@lo:400:kworker.0 Request processed in 24us (74us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271773.727032:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788271773.727050:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8336a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875138590116352:0@lo:400:kworker.0 00000100:00100000:1.0:1788271773.727075:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590116224 00000100:00100000:1.0:1788271773.727077:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590116224 00000100:00100000:1.0:1788271773.727093:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1788271773.727097:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3608:x1875138590116224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271773.727143:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3608:x1875138590116224:12345-0@lo:400:kworker.0 Request processed in 40us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271773.727150:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1788271773.727185:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83368a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590116224:0@lo:400:kworker.0 00000100:00100000:0.0:1788271773.729588:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875138590116480:0@lo:400:kworker.0 00000100:00100000:0.0:1788271773.729671:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271773.729715:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590116096:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788271773.729740:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271773.729839:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590116480 00000100:00100000:1.0:1788271773.729846:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590116480 00000100:00100000:1.0:1788271773.729893:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788271773.729903:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1875138590116480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271773.729954:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1875138590116480:12345-0@lo:400:kworker.0 Request processed in 52us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271773.729961:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788271773.730115:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875138590116480:0@lo:400:kworker.0 00000100:00100000:3.0:1788271773.730303:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8336b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3609:1875138590116864:0@lo:400:kworker.0 00000100:00100000:3.0:1788271773.730332:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271773.730351:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3609:1875138590117376:0@lo:400:kworker.0 00000100:00100000:3.0:1788271773.730370:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271773.730388:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788271773.730393:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3609:1875138590116736:0@lo:400:kworker.0 00000100:00100000:3.0:1788271773.730431:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271773.730449:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8336aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3609:1875138590117248:0@lo:400:kworker.0 00000100:00100000:3.0:1788271773.730468:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271773.730493:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590116864 00000100:00100000:3.0:1788271773.730497:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590116864 00000100:00100000:3.0:1788271773.730529:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590117376 00000100:00100000:3.0:1788271773.730532:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590117376 00000100:00100000:3.0:1788271773.730544:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590116736 00000100:00100000:1.0:1788271773.730639:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8336ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590116608:0@lo:400:kworker.0 00000100:00100000:1.0:1788271773.730676:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271773.730695:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590117120:0@lo:400:kworker.0 00000100:00100000:1.0:1788271773.730718:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271773.730736:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788271773.730741:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590116992:0@lo:400:kworker.0 00000100:00100000:1.0:1788271773.730764:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271773.730791:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590117120 00000100:00100000:1.0:1788271773.730795:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590117120 00000100:00100000:1.0:1788271773.730818:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590116992 00000100:00100000:1.0:1788271773.730821:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590116992 00000100:00100000:1.0:1788271773.730839:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788271773.730846:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8318b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590117120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271773.730884:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8318b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590117120:12345-0@lo:400:kworker.0 Request processed in 39us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271773.730891:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788271773.730903:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788271773.730909:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfbaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590116992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271773.730936:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfbaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590116992:12345-0@lo:400:kworker.0 Request processed in 28us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271773.730941:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788271773.730963:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590116608 00000100:00100000:1.0:1788271773.730966:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590116608 00000100:00100000:1.0:1788271773.730991:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788271773.730997:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8318aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590116608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271773.731029:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8318aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590116608:12345-0@lo:400:kworker.0 Request processed in 32us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271773.731035:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:1.0:1788271773.731069:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83369180 x1875138590116992/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271773.731081:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590116992:0@lo:400:kworker.0 00000100:00100000:1.0:1788271773.731093:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8336ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590116608:0@lo:400:kworker.0 00010000:00080000:1.0:1788271773.731117:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83369c00 x1875138590117120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271773.731126:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590117120:0@lo:400:kworker.0 00000100:00100000:1.0:1788271773.731161:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590117248 00000100:00100000:1.0:1788271773.731165:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590117248 00000100:00100000:1.0:1788271773.731184:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788271773.731190:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875138590116864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271773.731224:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875138590116864:12345-0@lo:400:kworker.0 Request processed in 34us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271773.731230:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788271773.731244:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788271773.731250:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8336a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875138590117376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271773.731274:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8336a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875138590117376:12345-0@lo:400:kworker.0 Request processed in 25us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271773.731279:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788271773.731290:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788271773.731295:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875138590117248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271773.731318:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875138590117248:12345-0@lo:400:kworker.0 Request processed in 23us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271773.731323:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:1.0:1788271773.731348:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788271773.731352:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788271773.731394:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8336aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3609:1875138590117248:0@lo:400:kworker.0 00010000:00080000:1.0:1788271773.731403:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d8336b800 x1875138590116864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271773.731411:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8336b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3609:1875138590116864:0@lo:400:kworker.0 00010000:00080000:1.0:1788271773.731419:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83368000 x1875138590117376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271773.731427:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3609:1875138590117376:0@lo:400:kworker.0 00000100:00100000:3.0:1788271773.731516:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590116736 00000100:00100000:3.0:1788271773.731546:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788271773.731564:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875138590116736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271773.731601:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875138590116736:12345-0@lo:400:kworker.0 Request processed in 38us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271773.731607:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788271773.731661:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3609:1875138590116736:0@lo:400:kworker.0 00000100:00080000:1.0:1788271773.731831:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788271773.733660:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590116096 00000100:00100000:2.0:1788271773.733671:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590116096 00000100:00100000:2.0:1788271773.733741:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788271773.733749:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590116096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788271773.733770:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788271773.733842:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590116096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (4100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271773.733849:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:0.0:1788271773.733957:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83292a00 x1875138590116096/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271789 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271773.733975:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590116096:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788271773.734058:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788271774.111495:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271775.133874:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788271776.091454:0:13500:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 10:09:34 (1788271774) === 00010000:00010000:2.0:1788271776.159094:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271776.288406:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271776.288493:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271776.288578:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577452544 00000100:00100000:3.0:1788271776.288592:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577452544 00000100:00100000:3.0:1788271776.288701:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 2 00000100:00100000:3.0:1788271776.288716:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ec7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:10486:x1875138577452544:12345-192.168.201.3@tcp:700:mkdir.0 00000100:00100000:3.0:1788271776.288822:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ec7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:10486:x1875138577452544:12345-192.168.201.3@tcp:700:mkdir.0 Request processed in 110us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271776.288832:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 2 00000100:00080000:0.0:1788271776.289027:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271776.289449:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577452416 00000100:00100000:1.0:1788271776.289456:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577452416 00000100:00100000:1.0:1788271776.289543:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 22 00000100:00100000:1.0:1788271776.289554:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2397:x1875138577452416:12345-192.168.201.3@tcp:41:mkdir.0 00000004:00000024:1.0:1788271776.289589:0:6483:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788271776.289689:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2397:x1875138577452416:12345-192.168.201.3@tcp:41:mkdir.0 Request processed in 137us (1368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271776.289696:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 22 00000100:00100000:1.0:1788271776.292571:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271776.292691:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577452800 00000100:00100000:3.0:1788271776.292702:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577452800 00000100:00100000:3.0:1788271776.292772:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 23 00000100:00100000:3.0:1788271776.292793:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfbaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:10486:x1875138577452800:12345-192.168.201.3@tcp:36:mkdir.0 00010000:00010000:3.0:1788271776.292875:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271776.293066:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21df800/0x99288105fd38e725 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd310 expref: 6 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.293100:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6e920a2f00) 00010000:00010000:3.0:1788271776.293111:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788271776.293302:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030000/0x99288105fd38e883 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.293316:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030000/0x99288105fd38e883 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.293326:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030000/0x99288105fd38e883 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.293359:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030600/0x99288105fd38e88a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.293366:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030600/0x99288105fd38e88a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.293372:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030600/0x99288105fd38e88a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.294702:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030800/0x99288105fd38e891 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.294718:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030800/0x99288105fd38e891 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.294727:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030800/0x99288105fd38e891 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788271776.294753:0:6484:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000822bb933 reply state 000000009ce2f754 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030800/0x99288105fd38e891 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.294765:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030800/0x99288105fd38e891 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.294773:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f6e8ad50400) 00010000:00010000:3.0:1788271776.294775:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788271776.294778:0:6484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788271776.294785:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788271776.294791:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030000/0x99288105fd38e883 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.294811:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030000/0x99288105fd38e883 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.294818:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030000/0x99288105fd38e883 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.294824:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e80030000 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271776.294828:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030000/0x99288105fd38e883 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.294835:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030000/0x99288105fd38e883 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.294843:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6e8ad50700) 00010000:00010000:3.0:1788271776.294845:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271776.294848:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030000/0x99288105fd38e883 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.294864:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030000/0x99288105fd38e883 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788271776.294886:0:6484:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000822bb933 reply state 000000009ce2f754 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030600/0x99288105fd38e88a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.294896:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030600/0x99288105fd38e88a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.294902:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f6e8ad50d00) 00010000:00010000:3.0:1788271776.294904:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788271776.294907:0:6484:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788271776.295010:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfbaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:10486:x1875138577452800:12345-192.168.201.3@tcp:36:mkdir.0 Request processed in 2216us (2449us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788271776.295019:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 23 00000100:00100000:0.0:1788271776.314869:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271776.314975:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577452928 00000100:00100000:2.0:1788271776.314988:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577452928 00000100:00100000:2.0:1788271776.315306:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 24 00000100:00100000:2.0:1788271776.315321:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:10487:x1875138577452928:12345-192.168.201.3@tcp:101:chmod.0 00010000:00010000:2.0:1788271776.315352:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271776.315386:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21200/0x99288105fd38e898 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd3a3 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.315471:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38e89f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.315490:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38e89f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.315506:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38e89f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271776.315569:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788271776.315574:0:6485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788271776.315643:0:6485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38e89f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.315676:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21200/0x99288105fd38e898 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3a3 expref: 9 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.315833:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38e89f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3a3 expref: 8 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.315841:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6eb35a5000) 00010000:00010000:2.0:1788271776.315844:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788271776.315847:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e21e00, rc 0) 00000100:00100000:2.0:1788271776.315922:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83154a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+8:10487:x1875138577452928:12345-192.168.201.3@tcp:101:chmod.0 Request processed in 605us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271776.315931:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 24 00000100:00100000:2.0:1788271776.320286:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271776.320604:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577453184 00000100:00100000:0.0:1788271776.320642:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577453184 00000100:00100000:0.0:1788271776.320723:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 25 00000100:00100000:0.0:1788271776.320734:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+8:10487:x1875138577453184:12345-192.168.201.3@tcp:36:chmod.0 00010000:00010000:0.0:1788271776.320805:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271776.320840:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38e89f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3a3 expref: 8 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.320865:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6eb35a5000) 00010000:00010000:0.0:1788271776.320878:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788271776.320912:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079200/0x99288105fd38e8a6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.320928:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079200/0x99288105fd38e8a6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.320939:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079200/0x99288105fd38e8a6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788271776.321217:0:6483:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003f662810 reply state 000000001c54fd37 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079200/0x99288105fd38e8a6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.321232:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079200/0x99288105fd38e8a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.321239:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6d83055500) 00010000:00010000:0.0:1788271776.321242:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788271776.321245:0:6483:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788271776.321262:0:6483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788271776.321372:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+9:10487:x1875138577453184:12345-192.168.201.3@tcp:36:chmod.0 Request processed in 638us (1101us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788271776.321382:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 25 00000100:00100000:1.0:1788271776.362190:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271776.362689:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577453312 00000100:00100000:3.0:1788271776.362704:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577453312 00000100:00100000:3.0:1788271776.362784:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 26 00000100:00100000:3.0:1788271776.362796:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfbabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+9:10488:x1875138577453312:12345-192.168.201.3@tcp:101:chown.0 00010000:00010000:3.0:1788271776.362829:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271776.362857:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030000/0x99288105fd38e8ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd3aa expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.362959:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80031e00/0x99288105fd38e8b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.362982:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80031e00/0x99288105fd38e8b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.363018:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80031e00/0x99288105fd38e8b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271776.363091:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788271776.363097:0:6484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788271776.363146:0:6484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80031e00/0x99288105fd38e8b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.363180:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030000/0x99288105fd38e8ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3aa expref: 11 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.363204:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80031e00/0x99288105fd38e8b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3aa expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.363214:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6d83055500) 00010000:00010000:3.0:1788271776.363216:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788271776.363221:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e80031e00, rc 0) 00000100:00100000:3.0:1788271776.363310:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfbabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+10:10488:x1875138577453312:12345-192.168.201.3@tcp:101:chown.0 Request processed in 512us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271776.363318:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 26 00000100:00100000:0.0:1788271776.371781:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271776.371889:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577453440 00000100:00100000:2.0:1788271776.371902:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577453440 00000100:00100000:2.0:1788271776.371979:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 27 00000100:00100000:2.0:1788271776.371992:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+10:10488:x1875138577453440:12345-192.168.201.3@tcp:101:chown.0 00010000:00010000:2.0:1788271776.372019:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271776.372046:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21200/0x99288105fd38e8bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd3b1 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.372149:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38e8c2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.372166:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38e8c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.372179:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38e8c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.372218:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21df800/0x99288105fd38e8c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.372227:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21df800/0x99288105fd38e8c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.372234:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21df800/0x99288105fd38e8c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.372525:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21de000/0x99288105fd38e8d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.372535:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21de000/0x99288105fd38e8d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.372543:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21de000/0x99288105fd38e8d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271776.372604:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788271776.372608:0:6485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788271776.372969:0:6485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21de000/0x99288105fd38e8d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.372986:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38e8c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.372993:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38e8c2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.373001:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38e8c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.373021:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e21e00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271776.373027:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38e8c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.373036:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38e8c2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.373063:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6d83055500) 00010000:00010000:2.0:1788271776.373067:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271776.373074:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38e8c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.373081:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38e8c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.373098:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21df800/0x99288105fd38e8c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.373105:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21df800/0x99288105fd38e8c9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.373110:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21df800/0x99288105fd38e8c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.373116:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6ec21df800 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271776.373119:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21df800/0x99288105fd38e8c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.373125:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21df800/0x99288105fd38e8c9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.373144:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f6e8ad50d00) 00010000:00010000:2.0:1788271776.373146:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271776.373150:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21df800/0x99288105fd38e8c9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.373156:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21df800/0x99288105fd38e8c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.373194:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21200/0x99288105fd38e8bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3b1 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.373209:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21de000/0x99288105fd38e8d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3b1 expref: 11 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.373217:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f6e8ad50400) 00010000:00010000:2.0:1788271776.373219:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788271776.373222:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6ec21de000, rc 0) 00000100:00100000:2.0:1788271776.373353:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83156680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+11:10488:x1875138577453440:12345-192.168.201.3@tcp:101:chown.0 Request processed in 1363us (1587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271776.373362:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 27 00000100:00100000:2.0:1788271776.376165:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271776.376259:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577453568 00000100:00100000:0.0:1788271776.376272:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577453568 00000100:00100000:0.0:1788271776.376390:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 6 00000100:00100000:0.0:1788271776.376403:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ef8df183-a1b1-4e56-bce5-924a894c4a71+11:10488:x1875138577453568:12345-192.168.201.3@tcp:900:chown.0 00000100:00100000:0.0:1788271776.376782:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ef8df183-a1b1-4e56-bce5-924a894c4a71+11:10488:x1875138577453568:12345-192.168.201.3@tcp:900:chown.0 Request processed in 380us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271776.376791:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 6 00000100:00100000:2.0:1788271776.387857:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271776.387937:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577453824 00000100:00100000:1.0:1788271776.387950:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577453824 00000100:00100000:1.0:1788271776.388028:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 28 00000100:00100000:1.0:1788271776.388042:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+11:10488:x1875138577453824:12345-192.168.201.3@tcp:36:chown.0 00010000:00010000:1.0:1788271776.388172:0:12164:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271776.388214:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21de000/0x99288105fd38e8d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3b1 expref: 11 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.388240:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f6e8ad50400) 00010000:00010000:1.0:1788271776.388247:0:12164:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788271776.388279:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4200/0x99288105fd38e8d7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.388295:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4200/0x99288105fd38e8d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.388307:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4200/0x99288105fd38e8d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788271776.399454:0:6462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:1.0:1788271776.399600:0:3592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030600/0x99288105fd38e88a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.399668:0:3592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030600/0x99288105fd38e88a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.399678:0:3592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030600/0x99288105fd38e88a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.399685:0:3592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e80030600 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271776.399690:0:3592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030600/0x99288105fd38e88a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.399699:0:3592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030600/0x99288105fd38e88a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.399742:0:3592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f6e8ad50d00) 00010000:00010000:1.0:1788271776.399744:0:3592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271776.399750:0:3592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030600/0x99288105fd38e88a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.399756:0:3592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030600/0x99288105fd38e88a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788271776.399759:0:12164:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055187b8e reply state 00000000d1c2d4bc transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4200/0x99288105fd38e8d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.399776:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4200/0x99288105fd38e8d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.399784:0:3592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030800/0x99288105fd38e891 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.399790:0:3592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030800/0x99288105fd38e891 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.399879:0:3592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030800/0x99288105fd38e891 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.399997:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f6e8ad50400) 00010000:00010000:3.0:1788271776.400000:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788271776.400011:0:12164:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788271776.400029:0:12164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:0.0:1788271776.400784:0:12164:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788271776.400821:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+9:10488:x1875138577453824:12345-192.168.201.3@tcp:36:chown.0 Request processed in 12773us (12971us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788271776.400833:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 28 00010000:00010000:1.0:1788271776.401205:0:3592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e80030800 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271776.401214:0:3592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030800/0x99288105fd38e891 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.401228:0:3592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030800/0x99288105fd38e891 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.401246:0:3592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f6e8ad50400) 00010000:00010000:1.0:1788271776.401249:0:3592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271776.401254:0:3592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030800/0x99288105fd38e891 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.401261:0:3592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030800/0x99288105fd38e891 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.401301:0:3592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079200/0x99288105fd38e8a6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.401306:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4200/0x99288105fd38e8d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.401309:0:3592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079200/0x99288105fd38e8a6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.401314:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4200/0x99288105fd38e8d7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.401317:0:3592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079200/0x99288105fd38e8a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.401320:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4200/0x99288105fd38e8d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.401325:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4ed4200 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271776.401327:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4200/0x99288105fd38e8d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.401333:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4200/0x99288105fd38e8d7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.401334:0:3592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4079200 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271776.401337:0:3592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079200/0x99288105fd38e8a6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.401343:0:3592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079200/0x99288105fd38e8a6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.401351:0:3592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6d83055500) 00010000:00010000:1.0:1788271776.401353:0:3592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788271776.401356:0:3592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079200/0x99288105fd38e8a6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.401362:0:3592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079200/0x99288105fd38e8a6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.402212:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f6e8ad50400) 00010000:00010000:3.0:1788271776.402216:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788271776.402221:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4200/0x99288105fd38e8d7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.402230:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4200/0x99288105fd38e8d7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271776.418873:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271776.419081:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577453952 00000100:00100000:3.0:1788271776.419096:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577453952 00000100:00100000:3.0:1788271776.419179:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 29 00000100:00100000:3.0:1788271776.419191:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:10489:x1875138577453952:12345-192.168.201.3@tcp:101:touch.500 00010000:00010000:3.0:1788271776.419227:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271776.419254:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030000/0x99288105fd38e8de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd3b8 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788271776.423191:0:6484:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3843us 00010000:00010000:3.0:1788271776.439108:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030e00/0x99288105fd38e8e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.439136:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030e00/0x99288105fd38e8e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.439151:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030e00/0x99288105fd38e8e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.439175:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030800/0x99288105fd38e8ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.439182:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030800/0x99288105fd38e8ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.439190:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030800/0x99288105fd38e8ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.439369:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030600/0x99288105fd38e8f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.439378:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030600/0x99288105fd38e8f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.439386:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030600/0x99288105fd38e8f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271776.439423:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788271776.439428:0:6484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788271776.439492:0:6484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030600/0x99288105fd38e8f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.439508:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030e00/0x99288105fd38e8e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.439515:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030e00/0x99288105fd38e8e5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.439524:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030e00/0x99288105fd38e8e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.439530:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e80030e00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271776.439536:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030e00/0x99288105fd38e8e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.439545:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030e00/0x99288105fd38e8e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.439559:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6d83055500) 00010000:00010000:3.0:1788271776.441736:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271776.441756:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030e00/0x99288105fd38e8e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.441771:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030e00/0x99288105fd38e8e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.441803:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030800/0x99288105fd38e8ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.441811:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030800/0x99288105fd38e8ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.441820:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030800/0x99288105fd38e8ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.441849:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e80030800 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271776.441854:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030800/0x99288105fd38e8ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.441863:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030800/0x99288105fd38e8ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.441883:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f6e8ad50400) 00010000:00010000:3.0:1788271776.441885:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271776.441889:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030800/0x99288105fd38e8ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.441895:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030800/0x99288105fd38e8ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.441965:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030000/0x99288105fd38e8de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3b8 expref: 8 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.441983:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030600/0x99288105fd38e8f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3b8 expref: 7 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.441991:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f6e8ad50700) 00010000:00010000:3.0:1788271776.441993:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788271776.441996:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e80030600, rc 0) 00000100:00100000:3.0:1788271776.442164:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:10489:x1875138577453952:12345-192.168.201.3@tcp:101:touch.500 Request processed in 22972us (23305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271776.442175:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 29 00000100:00100000:2.0:1788271776.446014:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271776.446127:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577454208 00000100:00100000:3.0:1788271776.446161:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577454208 00000100:00100000:3.0:1788271776.446276:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 30 00000100:00100000:3.0:1788271776.446289:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:10489:x1875138577454208:12345-192.168.201.3@tcp:101:touch.500 00010000:00010000:3.0:1788271776.446332:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271776.446381:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38e8fa lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd3bf expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.446534:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4a00/0x99288105fd38e901 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.446554:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4a00/0x99288105fd38e901 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.446879:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4a00/0x99288105fd38e901 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.446902:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38e908 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.446911:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38e908 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.446919:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38e908 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788271776.447478:0:6485:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:3.0:1788271776.447878:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38e90f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.447892:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38e90f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.447915:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38e90f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.447961:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4a00/0x99288105fd38e901 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.447969:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4a00/0x99288105fd38e901 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.447977:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4a00/0x99288105fd38e901 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.447983:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4a00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271776.447988:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4a00/0x99288105fd38e901 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.447997:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4a00/0x99288105fd38e901 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.448010:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f6e8ad50700) 00010000:00010000:3.0:1788271776.448014:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271776.448019:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4a00/0x99288105fd38e901 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.448026:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4a00/0x99288105fd38e901 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788271776.448042:0:6485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003ea365d5 reply state 00000000a72c8a02 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38e908 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.448066:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38e908 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.448080:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff8f6e8ad50f00) 00010000:00010000:3.0:1788271776.448082:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788271776.448086:0:6485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788271776.448129:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38e8fa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3bf expref: 10 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.448147:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38e90f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3bf expref: 9 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.448156:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f6e8ad50000) 00010000:00010000:3.0:1788271776.448158:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788271776.448161:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c4c00, rc 0) 00000100:00100000:3.0:1788271776.448395:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+10:10489:x1875138577454208:12345-192.168.201.3@tcp:101:touch.500 Request processed in 2108us (2394us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788271776.448406:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 30 00000100:00100000:0.0:1788271776.452765:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271776.452853:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577454464 00000100:00100000:2.0:1788271776.452866:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577454464 00000100:00100000:2.0:1788271776.452943:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 31 00000100:00100000:2.0:1788271776.452970:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+10:10489:x1875138577454464:12345-192.168.201.3@tcp:36:touch.500 00010000:00010000:2.0:1788271776.453049:0:12164:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271776.453096:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38e90f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3bf expref: 10 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.453123:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f6e8ad50000) 00010000:00010000:2.0:1788271776.453137:0:12164:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788271776.453224:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21df800/0x99288105fd38e91d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.453371:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21df800/0x99288105fd38e91d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.453384:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21df800/0x99288105fd38e91d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788271776.453540:0:12164:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000082c257bf reply state 00000000252071ac transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21df800/0x99288105fd38e91d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.453555:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21df800/0x99288105fd38e91d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.453561:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f6e90141f00) 00010000:00010000:2.0:1788271776.453762:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788271776.453766:0:12164:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788271776.453909:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83157b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+11:10489:x1875138577454464:12345-192.168.201.3@tcp:36:touch.500 Request processed in 940us (1352us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788271776.453918:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 31 00000100:00100000:2.0:1788271776.456441:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271776.456915:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577454592 00000100:00100000:3.0:1788271776.456928:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577454592 00000100:00100000:2.0:1788271776.457147:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 32 00000100:00100000:2.0:1788271776.457178:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d833d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+11:10489:x1875138577454592:12345-192.168.201.3@tcp:101:touch.500 00010000:00010000:2.0:1788271776.457211:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271776.457238:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21de000/0x99288105fd38e924 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd3c6 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.457330:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21de000/0x99288105fd38e924 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3c6 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.457348:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21de000/0x99288105fd38e924 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3c6 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.457369:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f6e90141f00) 00010000:00010000:2.0:1788271776.457373:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788271776.457378:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6ec21de000, rc 0) 00000100:00100000:2.0:1788271776.457466:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d833d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+12:10489:x1875138577454592:12345-192.168.201.3@tcp:101:touch.500 Request processed in 290us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271776.457475:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 32 00000100:00100000:3.0:1788271776.460015:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271776.460141:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577454720 00000100:00100000:1.0:1788271776.460155:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577454720 00000100:00100000:1.0:1788271776.460218:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 24 00000100:00100000:1.0:1788271776.460228:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83368e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2394:x1875138577454720:12345-192.168.201.3@tcp:8:touch.500 00010000:00080000:1.0:1788271776.460273:0:8397:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from ef8df183-a1b1-4e56-bce5-924a894c4a71@192.168.201.3@tcp t0 exp 0000000000000000 cur 337 last 0 00000020:00000080:1.0:1788271776.460349:0:8397:0:(genops.c:1385:class_connect()) connect: client ef8df183-a1b1-4e56-bce5-924a894c4a71, cookie 0x99288105fd38e92b 00002000:00100000:1.0:1788271776.460371:0:8397:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ef8df183-a1b1-4e56-bce5-924a894c4a71/ffff8f6e812ae800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788271776.460395:0:8397:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788271776.460494:0:8397:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788271776.460534:0:8397:0:(import.c:65:import_set_state_nolock()) ffff8f6e812a9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788271776.460656:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83368e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2394:x1875138577454720:12345-192.168.201.3@tcp:8:touch.500 Request processed in 428us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271776.460665:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 24 00000100:00100000:1.0:1788271776.465130:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271776.465352:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577454848 00000100:00100000:2.0:1788271776.465370:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577454848 00000100:00100000:2.0:1788271776.465486:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 25 00000100:00100000:2.0:1788271776.465502:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfba9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:0:x1875138577454848:12345-192.168.201.3@tcp:2:touch.500 00000100:00080000:0.0:1788271776.465524:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1788271776.475116:0:9475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:0.0:1788271776.475132:0:9475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ef8df183-a1b1-4e56-bce5-924a894c4a71 00000100:00100000:2.0:1788271776.475464:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfba9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:0:x1875138577454848:12345-192.168.201.3@tcp:2:touch.500 Request processed in 9962us (10347us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788271776.475477:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 25 00000100:00100000:1.0:1788271776.478802:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271776.478905:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577455104 00000100:00100000:3.0:1788271776.478915:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577455104 00000100:00100000:3.0:1788271776.479002:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 2 00000100:00100000:3.0:1788271776.479022:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfba8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+12:10489:x1875138577455104:12345-192.168.201.3@tcp:35:touch.500 00000100:00100000:3.0:1788271776.479383:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfba8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+13:10489:x1875138577455104:12345-192.168.201.3@tcp:35:touch.500 Request processed in 362us (589us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788271776.479393:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 2 00000100:00100000:3.0:1788271776.504956:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271776.505089:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577455232 00000100:00100000:2.0:1788271776.505103:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577455232 00000100:00100000:2.0:1788271776.505180:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 33 00000100:00100000:2.0:1788271776.505206:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+13:10490:x1875138577455232:12345-192.168.201.3@tcp:101:rm.0 00010000:00010000:2.0:1788271776.505231:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271776.505253:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21de800/0x99288105fd38e932 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd3cd expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.505326:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21200/0x99288105fd38e939 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.505340:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21200/0x99288105fd38e939 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.505350:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21200/0x99288105fd38e939 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271776.505392:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788271776.505395:0:6485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788271776.505431:0:6485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21200/0x99288105fd38e939 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.505457:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21de800/0x99288105fd38e932 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3cd expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.505475:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21200/0x99288105fd38e939 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3cd expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.505482:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f6e8ad50700) 00010000:00010000:2.0:1788271776.505484:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788271776.505488:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e21200, rc 0) 00000100:00100000:2.0:1788271776.505950:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+14:10490:x1875138577455232:12345-192.168.201.3@tcp:101:rm.0 Request processed in 350us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271776.505970:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 33 00000100:00100000:0.0:1788271776.515236:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271776.515332:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577455488 00000100:00100000:2.0:1788271776.515343:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577455488 00000100:00100000:2.0:1788271776.515401:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 34 00000100:00100000:2.0:1788271776.515412:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83274e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+14:10490:x1875138577455488:12345-192.168.201.3@tcp:101:rm.0 00010000:00010000:2.0:1788271776.515433:0:12164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271776.515454:0:12164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38e940 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd3d4 expref: -99 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271776.515564:0:12164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788271776.515746:0:12164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38e940 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3d4 expref: 16 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.515763:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6d83055500) 00010000:00010000:2.0:1788271776.515766:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788271776.515773:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38e940 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3d4 expref: 16 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.515788:0:12164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e21e00, rc 0) 00000100:00100000:2.0:1788271776.515857:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83274e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+15:10490:x1875138577455488:12345-192.168.201.3@tcp:101:rm.0 Request processed in 446us (630us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1788271776.515864:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 34 00000100:00100000:1.0:1788271776.526366:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271776.526485:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577455616 00000100:00100000:0.0:1788271776.526496:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577455616 00000100:00100000:0.0:1788271776.526567:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 3 00000100:00100000:0.0:1788271776.526577:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfbaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+15:10490:x1875138577455616:12345-192.168.201.3@tcp:37:rm.0 00000100:00100000:0.0:1788271776.535699:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfbaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+15:10490:x1875138577455616:12345-192.168.201.3@tcp:37:rm.0 Request processed in 9113us (9334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271776.535727:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 3 00000100:00100000:1.0:1788271776.538982:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271776.539662:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577455872 00000100:00100000:3.0:1788271776.539672:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577455872 00000100:00100000:3.0:1788271776.540099:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 4 00000100:00100000:3.0:1788271776.540111:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb36ae050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+15:10490:x1875138577455872:12345-192.168.201.3@tcp:35:rm.0 00000100:00100000:3.0:1788271776.540342:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb36ae050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+16:10490:x1875138577455872:12345-192.168.201.3@tcp:35:rm.0 Request processed in 231us (1367us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788271776.540350:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 4 00000100:00100000:1.0:1788271776.547222:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271776.547345:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577456128 00000100:00100000:2.0:1788271776.547356:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577456128 00000100:00100000:2.0:1788271776.547419:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 35 00000100:00100000:2.0:1788271776.547433:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+16:10490:x1875138577456128:12345-192.168.201.3@tcp:101:rm.0 00010000:00010000:2.0:1788271776.547477:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271776.547500:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38e94e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd3db expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.547671:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21de800/0x99288105fd38e955 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.547688:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21de800/0x99288105fd38e955 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.547699:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21de800/0x99288105fd38e955 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271776.547711:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788271776.547816:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38e94e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3db expref: 19 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.547834:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21de800/0x99288105fd38e955 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3db expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.547842:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f6e8ad50700) 00010000:00010000:2.0:1788271776.547845:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788271776.547848:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6ec21de800, rc 0) 00000100:00100000:2.0:1788271776.547912:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfba8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+18:10490:x1875138577456128:12345-192.168.201.3@tcp:101:rm.0 Request processed in 483us (700us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788271776.547919:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 35 00000100:00100000:2.0:1788271776.553059:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271776.553130:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577456256 00000100:00100000:0.0:1788271776.553142:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577456256 00000100:00100000:0.0:1788271776.553244:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 36 00000100:00100000:0.0:1788271776.553256:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d833d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+18:10490:x1875138577456256:12345-192.168.201.3@tcp:41:rm.0 00000004:00000024:0.0:1788271776.553316:0:6483:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1788271776.553399:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d833d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+18:10490:x1875138577456256:12345-192.168.201.3@tcp:41:rm.0 Request processed in 146us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271776.553407:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 36 00000100:00100000:1.0:1788271776.555984:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271776.556169:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577456384 00000100:00100000:0.0:1788271776.556178:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577456384 00000100:00100000:0.0:1788271776.556237:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 37 00000100:00100000:0.0:1788271776.556247:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+18:10490:x1875138577456384:12345-192.168.201.3@tcp:101:rm.0 00010000:00010000:0.0:1788271776.556268:0:9899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271776.556292:0:9899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079400/0x99288105fd38e963 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd3e2 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.556357:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079200/0x99288105fd38e96a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.556372:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079200/0x99288105fd38e96a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.556383:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079200/0x99288105fd38e96a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.556394:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079c00/0x99288105fd38e971 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.556420:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079c00/0x99288105fd38e971 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.556426:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079c00/0x99288105fd38e971 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.556544:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078e00/0x99288105fd38e978 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.556720:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078e00/0x99288105fd38e978 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.556729:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078e00/0x99288105fd38e978 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271776.556766:0:9899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788271776.556770:0:9899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788271776.556787:0:9899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078e00/0x99288105fd38e978 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.556798:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078e00/0x99288105fd38e978 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.556806:0:9899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079200/0x99288105fd38e96a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.556813:0:9899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079200/0x99288105fd38e96a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.556818:0:9899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079200/0x99288105fd38e96a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.556833:0:9899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4079200 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271776.556837:0:9899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079200/0x99288105fd38e96a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.556845:0:9899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079200/0x99288105fd38e96a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.556858:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f6e8ad50700) 00010000:00010000:0.0:1788271776.556860:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271776.556864:0:9899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079200/0x99288105fd38e96a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.556870:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079200/0x99288105fd38e96a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.556883:0:9899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079c00/0x99288105fd38e971 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.556889:0:9899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079c00/0x99288105fd38e971 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.556895:0:9899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079c00/0x99288105fd38e971 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.556899:0:9899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4079c00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271776.556902:0:9899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079c00/0x99288105fd38e971 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.556908:0:9899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079c00/0x99288105fd38e971 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.556922:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff8f6e8ad50f00) 00010000:00010000:0.0:1788271776.556925:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271776.556927:0:9899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079c00/0x99288105fd38e971 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.556933:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079c00/0x99288105fd38e971 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.556955:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079400/0x99288105fd38e963 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3e2 expref: 20 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.556967:0:9899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078e00/0x99288105fd38e978 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3e2 expref: 19 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.556974:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f6e90141f00) 00010000:00010000:0.0:1788271776.556977:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788271776.556979:0:9899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4078e00, rc 0) 00000100:00100000:0.0:1788271776.557865:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfba8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+19:10490:x1875138577456384:12345-192.168.201.3@tcp:101:rm.0 Request processed in 1615us (1886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271776.557873:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 37 00000100:00100000:1.0:1788271776.569777:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271776.569893:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577456640 00000100:00100000:2.0:1788271776.569904:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577456640 00000100:00100000:2.0:1788271776.569979:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 38 00000100:00100000:2.0:1788271776.569989:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+19:10490:x1875138577456640:12345-192.168.201.3@tcp:36:rm.0 00010000:00010000:2.0:1788271776.570071:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788271776.570097:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078e00/0x99288105fd38e978 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3e2 expref: 19 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.570121:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21de000/0x99288105fd38e924 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3c6 expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.570134:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f6e90141f00) 00010000:00010000:2.0:1788271776.570144:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21200/0x99288105fd38e939 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3cd expref: 17 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.570154:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f6e8ad50700) 00010000:00010000:2.0:1788271776.570157:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788271776.570180:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38e97f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.570193:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38e97f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.570202:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38e97f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.570213:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1a00/0x99288105fd38e986 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.570221:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1a00/0x99288105fd38e986 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.570239:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1a00/0x99288105fd38e986 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.570338:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1400/0x99288105fd38e98d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.570346:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1400/0x99288105fd38e98d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.570353:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1400/0x99288105fd38e98d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788271776.570578:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788271776.570588:0:6484:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 337659968189ns, next at 338659965822ns, rc = 0 00010000:00010000:2.0:1788271776.570789:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38e994 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.570798:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38e994 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.570806:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38e994 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.570812:0:6484:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38e994 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.570819:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38e994 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.570825:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38e994 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.570925:0:6484:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788271776.570949:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1400/0x99288105fd38e98d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.570955:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1400/0x99288105fd38e98d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.570961:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1400/0x99288105fd38e98d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.570967:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e813a1400 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271776.570971:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1400/0x99288105fd38e98d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.570978:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1400/0x99288105fd38e98d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.570988:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f6e90141f00) 00010000:00010000:2.0:1788271776.570991:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788271776.570994:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1400/0x99288105fd38e98d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.570999:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1400/0x99288105fd38e98d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.571026:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38e97f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.571032:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38e97f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.571037:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38e97f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.571047:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e21e00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271776.571065:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38e97f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.571071:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38e97f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.571079:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f6e8ad50700) 00010000:00010000:2.0:1788271776.571081:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271776.571084:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38e97f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.571090:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38e97f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788271776.571100:0:6484:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008fc9d06b reply state 0000000039aafc6d transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1a00/0x99288105fd38e986 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.571111:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1a00/0x99288105fd38e986 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271776.571118:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff8f6e8ad50f00) 00010000:00010000:2.0:1788271776.571121:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788271776.571123:0:6484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788271776.571197:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+18:10490:x1875138577456640:12345-192.168.201.3@tcp:36:rm.0 Request processed in 1207us (1428us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788271776.571204:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 38 00010000:00010000:3.0:1788271776.571919:0:8413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788271776.571926:0:8413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38e994 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.571933:0:8413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e813a1600 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:3.0:1788271776.571937:0:8413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38e994 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.571944:0:8413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38e994 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.571954:0:8413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f6e90141f00) 00010000:00010000:3.0:1788271776.571957:0:8413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788271776.571960:0:8413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38e994 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.571966:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38e994 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271776.571976:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271776.571978:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271776.571980:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271776.577255:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271776.577488:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577456896 00000100:00100000:0.0:1788271776.577502:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577456896 00000100:00100000:0.0:1788271776.577580:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 5 00000100:00100000:0.0:1788271776.579432:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d833d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+18:10490:x1875138577456896:12345-192.168.201.3@tcp:35:rm.0 00000100:00100000:0.0:1788271776.579909:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d833d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+19:10490:x1875138577456896:12345-192.168.201.3@tcp:35:rm.0 Request processed in 2316us (2667us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788271776.579922:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 5 00000100:00100000:1.0:1788271776.587947:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271776.592361:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577457152 00000100:00100000:0.0:1788271776.592426:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577457152 00000100:00100000:0.0:1788271776.592504:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 39 00000100:00100000:0.0:1788271776.592514:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfba8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+19:10490:x1875138577457152:12345-192.168.201.3@tcp:36:rm.0 00010000:00010000:0.0:1788271776.592711:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788271776.592738:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21de800/0x99288105fd38e955 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3db expref: 19 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.592761:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80030600/0x99288105fd38e8f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3b8 expref: 18 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.592775:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f6e8ad50700) 00010000:00010000:0.0:1788271776.592791:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e80031e00/0x99288105fd38e8b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3aa expref: 17 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.592815:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6d83055500) 00010000:00010000:0.0:1788271776.592823:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788271776.592849:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079400/0x99288105fd38e99b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.592861:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079400/0x99288105fd38e99b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.592870:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079400/0x99288105fd38e99b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.592882:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079c00/0x99288105fd38e9a2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.592889:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079c00/0x99288105fd38e9a2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.592912:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079c00/0x99288105fd38e9a2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.593000:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079200/0x99288105fd38e9a9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.593731:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079200/0x99288105fd38e9a9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271776.593741:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079200/0x99288105fd38e9a9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271776.598171:0:6483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788271776.598199:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079200/0x99288105fd38e9a9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.598209:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079200/0x99288105fd38e9a9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.598217:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079200/0x99288105fd38e9a9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.598223:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4079200 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271776.598228:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079200/0x99288105fd38e9a9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.598253:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079200/0x99288105fd38e9a9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.598269:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f6d83055900) 00010000:00010000:1.0:1788271776.598272:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788271776.598276:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079200/0x99288105fd38e9a9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.598283:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079200/0x99288105fd38e9a9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.598309:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079400/0x99288105fd38e99b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.598315:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079400/0x99288105fd38e99b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.598321:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079400/0x99288105fd38e99b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.598325:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4079400 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271776.598328:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079400/0x99288105fd38e99b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.598333:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079400/0x99288105fd38e99b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.598341:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6d83055a00) 00010000:00010000:1.0:1788271776.598343:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271776.598345:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079400/0x99288105fd38e99b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.598360:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079400/0x99288105fd38e99b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788271776.598373:0:6483:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d3927777 reply state 000000001409a376 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079c00/0x99288105fd38e9a2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.598386:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079c00/0x99288105fd38e9a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271776.598393:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f6d83055c00) 00010000:00010000:1.0:1788271776.598396:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788271776.598398:0:6483:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788271776.598489:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfba8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+18:10490:x1875138577457152:12345-192.168.201.3@tcp:36:rm.0 Request processed in 5972us (10547us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788271776.598498:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 39 00000100:00100000:1.0:1788271776.671957:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271776.671995:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271776.672030:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271776.672077:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271776.672160:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577457408 00000100:00100000:0.0:1788271776.672171:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577457408 00000100:00100000:0.0:1788271776.672227:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577457664 00000100:00100000:0.0:1788271776.672229:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577457664 00000100:00100000:2.0:1788271776.672252:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577457536 00000100:00100000:2.0:1788271776.672269:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577457536 00000100:00100000:0.0:1788271776.672269:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 189 00000100:00100000:0.0:1788271776.672282:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfbaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2396:x1875138577457408:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788271776.672362:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 190 00000100:00100000:0.0:1788271776.672371:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfbaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2396:x1875138577457408:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 89us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271776.672381:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3f64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:956fb91b-4885-4e88-90fb-3061936b51ca+5:2396:x1875138577457664:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271776.672388:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 191 00000100:00100000:3.0:1788271776.672441:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577457280 00000100:00100000:2.0:1788271776.672462:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3f64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:956fb91b-4885-4e88-90fb-3061936b51ca+5:2396:x1875138577457664:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 86us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271776.672465:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577457280 00000100:00100000:1.0:1788271776.672515:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:956fb91b-4885-4e88-90fb-3061936b51ca+5:2396:x1875138577457536:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271776.672554:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:956fb91b-4885-4e88-90fb-3061936b51ca+5:2396:x1875138577457536:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 45us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271776.672593:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 332 00000100:00100000:3.0:1788271776.672612:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2396:x1875138577457280:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271776.672664:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2396:x1875138577457280:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 65us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271776.672671:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 332 00000100:00080000:3.0:1788271776.672724:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788271776.672728:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788271776.676914:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 189 00000100:00100000:2.0:1788271776.680423:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 190 00000100:00100000:1.0:1788271776.680835:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 191 00010000:00010000:1.0:1788271777.182993:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271777.309888:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d833d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590117504:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788271777.309964:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271777.310115:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590117504 00000100:00100000:2.0:1788271777.310124:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590117504 00000100:00100000:2.0:1788271777.310168:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788271777.310176:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83275880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590117504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788271777.310217:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788271777.310279:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83275880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590117504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271777.310287:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788271777.310304:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83277480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590117632:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788271777.310321:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788271777.310340:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590117760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788271777.310346:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271777.310404:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271777.310428:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590117632 00000100:00100000:2.0:1788271777.310435:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590117632 00000100:00100000:3.0:1788271777.310464:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590117760 00000100:00100000:3.0:1788271777.310471:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590117760 00000100:00100000:2.0:1788271777.310495:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788271777.310508:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3f64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590117632:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788271777.310514:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788271777.310523:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8336bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590117760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788271777.310532:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:3.0:1788271777.310541:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788271777.310581:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3f64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590117632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271777.310589:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1788271777.310635:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788271777.310725:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8336bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590117760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 202us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271777.310731:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:2.0:1788271777.310824:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83369500 x1875138590117760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271793 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271777.310842:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590117760:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1788271777.313811:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83277480 x1875138590117632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271793 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271777.313840:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83277480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590117632:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788271777.313921:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d833d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590117504:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788271778.206267:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271778.335883:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788271778.335909:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590117888:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788271778.336189:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271778.336259:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590117888 00000100:00100000:3.0:1788271778.336271:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590117888 00000100:00100000:3.0:1788271778.336826:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788271778.336843:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590117888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788271778.336892:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788271778.336964:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590117888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271778.336996:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788271778.339516:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590117888:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788271778.851083:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8336b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590118016:0@lo:400:kworker.0 00000004:00080000:2.0:1788271778.851125:0:9905:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 339940503885ns, next at 340940500982ns, rc = 0 00000100:00100000:3.0:1788271778.851156:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271778.851203:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3606:1875138590118528:0@lo:400:kworker.0 00000100:00100000:3.0:1788271778.851229:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271778.851259:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8336ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3606:1875138590119040:0@lo:400:kworker.0 00000100:00100000:3.0:1788271778.851282:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271778.851305:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590118528 00000100:00100000:3.0:1788271778.851310:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d833d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590119552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788271778.851314:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590118528 00000100:00100000:3.0:1788271778.851338:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271778.851374:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590119040 00000100:00100000:2.0:1788271778.851378:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590119040 00000100:00100000:2.0:1788271778.851403:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788271778.851413:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83030e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1875138590118528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271778.851463:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83030e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1875138590118528:12345-0@lo:400:kworker.0 Request processed in 53us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271778.851471:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788271778.851486:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788271778.851493:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83033800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3606:x1875138590119040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271778.851531:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83033800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3606:x1875138590119040:12345-0@lo:400:kworker.0 Request processed in 28us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271778.851537:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:2.0:1788271778.851553:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788271778.853877:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3606:1875138590118528:0@lo:400:kworker.0 00000100:00100000:3.0:1788271778.853895:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8336ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3606:1875138590119040:0@lo:400:kworker.0 00000100:00100000:3.0:1788271778.853926:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788271778.853935:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8336a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875138590118144:0@lo:400:kworker.0 00000100:00100000:3.0:1788271778.853987:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271778.854024:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8336b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3606:1875138590118656:0@lo:400:kworker.0 00000100:00100000:3.0:1788271778.854047:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271778.854064:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3606:1875138590119168:0@lo:400:kworker.0 00000100:00100000:3.0:1788271778.854084:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271778.854129:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590118016 00000100:00100000:3.0:1788271778.854135:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590118016 00000100:00100000:3.0:1788271778.854180:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1788271778.854189:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3606:x1875138590118016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271778.854237:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3606:x1875138590118016:12345-0@lo:400:kworker.0 Request processed in 49us (3083us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271778.854333:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1788271778.854368:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590118144 00000100:00100000:3.0:1788271778.854372:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590118144 00000100:00100000:3.0:1788271778.854390:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590118656 00000100:00100000:3.0:1788271778.854393:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590118656 00000100:00100000:3.0:1788271778.854410:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590119168 00000100:00100000:3.0:1788271778.854413:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590119168 00000100:00100000:3.0:1788271778.854428:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788271778.854434:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83030000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875138590118144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271778.854467:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83030000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875138590118144:12345-0@lo:400:kworker.0 Request processed in 33us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271778.854473:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788271778.854485:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788271778.854491:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83032a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1875138590118656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271778.854517:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83032a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1875138590118656:12345-0@lo:400:kworker.0 Request processed in 26us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271778.855358:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788271778.855379:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788271778.855389:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8336ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1875138590119168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271778.855432:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8336ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1875138590119168:12345-0@lo:400:kworker.0 Request processed in 45us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271778.855438:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788271778.855458:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590119552 00000100:00100000:3.0:1788271778.855463:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590119552 00000100:00100000:3.0:1788271778.855495:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788271778.855501:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83031180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590119552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788271778.857047:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271778.857110:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83031180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590119552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1607us (5771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271778.857120:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788271778.857179:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8336a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875138590118144:0@lo:400:kworker.0 00010000:00080000:3.0:1788271778.857196:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d8336b800 x1875138590118656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271778.857206:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8336b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3606:1875138590118656:0@lo:400:kworker.0 00010000:00080000:3.0:1788271778.857218:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83369180 x1875138590119168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271778.857226:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3606:1875138590119168:0@lo:400:kworker.0 00010000:00080000:3.0:1788271778.857237:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d833d5500 x1875138590119552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271794 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271778.857406:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d833d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590119552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788271778.857422:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8336b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590118016:0@lo:400:kworker.0 00000100:00100000:3.0:1788271778.857455:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788271778.857464:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83277480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590119680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788271778.857496:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271778.858659:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590118400:0@lo:400:kworker.0 00000100:00100000:2.0:1788271778.858702:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271778.858727:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590118912:0@lo:400:kworker.0 00000100:00100000:2.0:1788271778.858752:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271778.858770:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83031880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590119424:0@lo:400:kworker.0 00000100:00100000:2.0:1788271778.858790:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271778.858808:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788271778.858814:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875138590118272:0@lo:400:kworker.0 00000100:00100000:2.0:1788271778.858838:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271778.858854:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8336aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590118784:0@lo:400:kworker.0 00000100:00100000:2.0:1788271778.858874:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271778.858903:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590119296:0@lo:400:kworker.0 00000100:00100000:2.0:1788271778.858937:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271778.858973:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590118272 00000100:00100000:2.0:1788271778.858979:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590118272 00000100:00100000:2.0:1788271778.859038:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788271778.859047:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875138590118272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271778.859094:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875138590118272:12345-0@lo:400:kworker.0 Request processed in 47us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271778.859101:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788271778.859138:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875138590118272:0@lo:400:kworker.0 00000100:00080000:2.0:1788271778.859161:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788271778.859167:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788271778.859930:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590118400 00000100:00100000:3.0:1788271778.859937:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590118400 00000100:00100000:0.0:1788271778.860453:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590119680 00000100:00100000:0.0:1788271778.860459:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590119680 00000100:00100000:0.0:1788271778.860506:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788271778.860515:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8336b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590119680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788271778.860676:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788271778.860740:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8336b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590119680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 225us (3242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271778.860747:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1788271778.860770:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788271778.860796:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83277480 x1875138590119680/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271794 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271778.860812:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83277480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590119680:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788271778.862299:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590118912 00000100:00100000:2.0:1788271778.862308:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590118912 00000100:00100000:2.0:1788271778.862348:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590119424 00000100:00100000:2.0:1788271778.862351:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590119424 00000100:00100000:2.0:1788271778.862363:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590118784 00000100:00100000:2.0:1788271778.862366:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590118784 00000100:00100000:2.0:1788271778.862377:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590119296 00000100:00100000:2.0:1788271778.862381:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590119296 00000100:00100000:2.0:1788271778.862394:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788271778.862402:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d833d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590118912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271778.862466:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d833d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590118912:12345-0@lo:400:kworker.0 Request processed in 65us (3712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271778.862474:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788271778.862489:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788271778.862495:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d833d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590119424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271778.862534:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d833d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590119424:12345-0@lo:400:kworker.0 Request processed in 40us (3743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271778.862547:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788271778.862559:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788271778.862564:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590118784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271778.862590:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590118784:12345-0@lo:400:kworker.0 Request processed in 26us (3715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271778.862595:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788271778.862605:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788271778.862611:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82eced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590119296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271778.862657:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82eced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590119296:12345-0@lo:400:kworker.0 Request processed in 46us (3719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271778.862664:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:2.0:1788271778.862705:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d8336aa00 x1875138590118784/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271778.862719:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8336aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590118784:0@lo:400:kworker.0 00010000:00080000:2.0:1788271778.862731:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83154380 x1875138590119296/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271778.862739:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590119296:0@lo:400:kworker.0 00010000:00080000:2.0:1788271778.862749:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83369c00 x1875138590118912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271778.862758:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590118912:0@lo:400:kworker.0 00010000:00080000:2.0:1788271778.862768:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83031880 x1875138590119424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271778.862775:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83031880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590119424:0@lo:400:kworker.0 00000100:00100000:3.0:1788271778.864588:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788271778.864603:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d833d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590118400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271778.864764:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d833d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590118400:12345-0@lo:400:kworker.0 Request processed in 165us (6060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271778.864780:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788271778.864837:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590118400:0@lo:400:kworker.0 00010000:00010000:2.0:1788271779.230034:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271780.256192:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788271780.290110:0:13648:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000020:00000080:2.0:1788271781.202048:0:13696:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff0d04d7a0 20000000:00000080:2.0:1788271781.202068:0:13696:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f6ebc814000 uarg=0000000000000000 20000000:01000000:2.0:1788271781.202111:0:13696:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788271781.202118:0:13696:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788271781.202124:0:13696:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1788271781.202772:0:13697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1788271781.202933:0:13696:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788271781.208761:0:13696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788271781.208801:0:13696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788271781.208820:0:13696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788271781.208837:0:13696:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788271781.208857:0:13696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f6e813a0600/0x99288105fd38e9b0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.208875:0:13696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6eb4079800/0x99288105fd38e844 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e83d expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.208884:0:13696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6eb4e21000/0x99288105fd38e852 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e84b expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.208892:0:13696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6eb4e20a00/0x99288105fd38e860 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e859 expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.208900:0:13696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6eb4e20200/0x99288105fd38e86e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e867 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.208910:0:13696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6eb4ed4a00/0x99288105fd38e875 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd395 expref: 12 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.208918:0:13696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6eb4ed4c00/0x99288105fd38e87c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd39c expref: 12 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.208950:0:13696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f6e813a0600/0x99288105fd38e9b0 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.209107:0:13696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6eb4ed4c00/0x99288105fd38e87c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd39c expref: 12 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.209124:0:13696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f6eb4ed4c00/0x99288105fd38e87c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd39c expref: 12 pid: 6476 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271781.209140:0:13696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ecd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13696:1875138590119808:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788271781.209281:0:13696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6eb4ed4a00/0x99288105fd38e875 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd395 expref: 12 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.209290:0:13696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f6eb4ed4a00/0x99288105fd38e875 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd395 expref: 12 pid: 6476 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271781.209299:0:13696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ecf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13696:1875138590119936:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788271781.209333:0:13696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6eb4e20200/0x99288105fd38e86e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e867 expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.209341:0:13696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f6eb4e20200/0x99288105fd38e86e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e867 expref: 23 pid: 6477 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271781.209350:0:13696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ece680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13696:1875138590120064:0@lo:104: 00000100:00100000:2.0:1788271781.209391:0:13696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788271781.209424:0:13696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6eb4e20a00/0x99288105fd38e860 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e859 expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.209443:0:13696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f6eb4e20a00/0x99288105fd38e860 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e859 expref: 23 pid: 6476 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271781.209451:0:13696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ecf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13696:1875138590120192:0@lo:104: 00010000:00010000:2.0:1788271781.209482:0:13696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6eb4e21000/0x99288105fd38e852 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e84b expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.209489:0:13696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f6eb4e21000/0x99288105fd38e852 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e84b expref: 23 pid: 6476 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271781.209497:0:13696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83031880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13696:1875138590120320:0@lo:104: 00010000:00010000:2.0:1788271781.209536:0:13696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6eb4079800/0x99288105fd38e844 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38e83d expref: 23 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.209544:0:13696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f6eb4079800/0x99288105fd38e844 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38e83d expref: 23 pid: 6476 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271781.209551:0:13696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83154380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13696:1875138590120448:0@lo:104: 00000100:00100000:2.0:1788271781.209566:0:13696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830a63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271781.209658:0:6467:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788271781.209679:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271781.209704:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271781.209720:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271781.209728:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590120064 00000100:00100000:0.0:1788271781.209735:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590120064 00000100:00100000:0.0:1788271781.209768:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590120192 00000100:00100000:0.0:1788271781.209770:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590120192 00000100:00100000:0.0:1788271781.209779:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590120320 00000100:00100000:0.0:1788271781.209781:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590120320 00000100:00100000:0.0:1788271781.209787:0:6467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590120448 00000100:00100000:0.0:1788271781.209789:0:6467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590120448 00000100:00100000:0.0:1788271781.209801:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788271781.209809:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83159c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+6:13696:x1875138590120064:12345-0@lo:104: 00010000:00010000:0.0:1788271781.209820:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4600/0x99288105fd38e867 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e86e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.209877:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788271781.209883:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83159c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+6:13696:x1875138590120064:12345-0@lo:104: Request processed in 76us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271781.209890:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788271781.209925:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788271781.209932:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83277480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+5:13696:x1875138590120192:12345-0@lo:104: 00010000:00010000:0.0:1788271781.209952:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e859 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e860 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.209993:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788271781.209998:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83277480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+5:13696:x1875138590120192:12345-0@lo:104: Request processed in 68us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271781.210004:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788271781.210018:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788271781.210024:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83274700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+4:13696:x1875138590120320:12345-0@lo:104: 00010000:00010000:0.0:1788271781.210031:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079000/0x99288105fd38e84b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e852 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.210062:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788271781.210067:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83274700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+4:13696:x1875138590120320:12345-0@lo:104: Request processed in 45us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271781.210073:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788271781.210085:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788271781.210090:0:6467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83274a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+3:13696:x1875138590120448:12345-0@lo:104: 00010000:00010000:0.0:1788271781.210097:0:6467:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079e00/0x99288105fd38e83d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e844 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.210135:0:6467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788271781.210140:0:6467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83274a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f4eab87b-0440-4f90-8c88-4ffaef16406f+3:13696:x1875138590120448:12345-0@lo:104: Request processed in 50us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271781.210146:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:0.0:1788271781.210166:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788271781.210171:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4600/0x99288105fd38e867 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e86e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.210179:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4ed4600 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:0.0:1788271781.210183:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4600/0x99288105fd38e867 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e86e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.210190:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4600/0x99288105fd38e867 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e86e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788271781.210197:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4600/0x99288105fd38e867 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e86e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271781.210202:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788271781.210227:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4600/0x99288105fd38e867 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e86e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.210234:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788271781.210252:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4600/0x99288105fd38e867 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e86e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.210258:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4600/0x99288105fd38e867 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e86e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.210282:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788271781.210285:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e859 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e860 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.210291:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4ed4400 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:0.0:1788271781.210293:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e859 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e860 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.210301:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e859 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e860 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788271781.210307:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e859 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e860 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271781.210312:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788271781.210326:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e859 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e860 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.210332:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788271781.210338:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e859 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e860 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.210345:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e859 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e860 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.210354:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788271781.210357:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079000/0x99288105fd38e84b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e852 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.210373:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4079000 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:0.0:1788271781.210376:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079000/0x99288105fd38e84b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e852 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.210383:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079000/0x99288105fd38e84b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e852 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788271781.210389:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079000/0x99288105fd38e84b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e852 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271781.210395:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788271781.210408:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079000/0x99288105fd38e84b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e852 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.210414:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788271781.210428:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079000/0x99288105fd38e84b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e852 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.210434:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079000/0x99288105fd38e84b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e852 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.210442:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271781.210445:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079e00/0x99288105fd38e83d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38e844 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.210452:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4079e00 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:0.0:1788271781.210455:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079e00/0x99288105fd38e83d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38e844 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.210472:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079e00/0x99288105fd38e83d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38e844 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788271781.210477:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079e00/0x99288105fd38e83d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38e844 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271781.210482:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788271781.210494:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079e00/0x99288105fd38e83d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e844 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.210499:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788271781.210506:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079e00/0x99288105fd38e83d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e844 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.210512:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079e00/0x99288105fd38e83d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38e844 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.210525:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271781.210527:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271781.210528:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271781.210542:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83277800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590120576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788271781.210570:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271781.210600:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788271781.210606:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83275180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590120704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788271781.210659:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271781.210683:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83276a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590120832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788271781.210704:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271781.210769:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788271781.210782:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83277b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590120960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788271781.210805:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271781.210833:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590120576 00000100:00100000:0.0:1788271781.210838:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590120576 00010000:00010000:0.0:1788271781.210856:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6eb4e20200/0x99288105fd38e86e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e867 expref: 24 pid: 6477 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271781.210874:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590120704 00000100:00100000:0.0:1788271781.210876:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590120704 00010000:00010000:0.0:1788271781.210887:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6eb4e20a00/0x99288105fd38e860 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e859 expref: 25 pid: 6476 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271781.210897:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590120832 00000100:00100000:0.0:1788271781.210899:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590120832 00010000:00010000:0.0:1788271781.210907:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6eb4e21000/0x99288105fd38e852 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e84b expref: 26 pid: 6476 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271781.210915:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590120960 00000100:00100000:0.0:1788271781.210919:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590120960 00010000:00010000:0.0:1788271781.210926:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6eb4079800/0x99288105fd38e844 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e83d expref: 27 pid: 6476 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271781.210936:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788271781.211296:0:13696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ece680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13696:1875138590120064:0@lo:104: 00000100:00100000:2.0:1788271781.211304:0:13696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ecf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13696:1875138590120192:0@lo:104: 00000100:00100000:2.0:1788271781.211309:0:13696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83031880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13696:1875138590120320:0@lo:104: 00000100:00100000:2.0:1788271781.211315:0:13696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83154380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13696:1875138590120448:0@lo:104: 00010000:00010000:3.0:1788271781.211469:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271781.211485:0:9485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788271781.211492:0:9485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d833d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4eab87b-0440-4f90-8c88-4ffaef16406f+27:3608:x1875138590120704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788271781.211502:0:9485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271781.211507:0:9485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6eb4e20a00/0x99288105fd38e860 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e859 expref: 27 pid: 6476 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271781.211515:0:9485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6eb4e20a00/0x99288105fd38e860 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e859 expref: 27 pid: 6476 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271781.211527:0:9485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4e20a00/0x99288105fd38e860 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e859 expref: 27 pid: 6476 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271781.211537:0:9485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271781.211573:0:9485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d833d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4eab87b-0440-4f90-8c88-4ffaef16406f+26:3608:x1875138590120704:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271781.211578:0:9485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788271781.211590:0:9485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788271781.211595:0:9485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d833d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4eab87b-0440-4f90-8c88-4ffaef16406f+25:3606:x1875138590120832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788271781.211601:0:9485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271781.211604:0:9485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6eb4e21000/0x99288105fd38e852 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e84b expref: 25 pid: 6476 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271781.211610:0:9485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6eb4e21000/0x99288105fd38e852 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e84b expref: 25 pid: 6476 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271781.211644:0:9485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4e21000/0x99288105fd38e852 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e84b expref: 25 pid: 6476 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271781.211651:0:9485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271781.211676:0:9485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d833d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3606:x1875138590120832:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271781.211681:0:9485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788271781.211691:0:9485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788271781.211695:0:9485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d833d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:3606:x1875138590120960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788271781.211701:0:9485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271781.211704:0:9485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6eb4079800/0x99288105fd38e844 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e83d expref: 23 pid: 6476 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271781.211712:0:9485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6eb4079800/0x99288105fd38e844 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e83d expref: 23 pid: 6476 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271781.211720:0:9485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4079800/0x99288105fd38e844 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e83d expref: 23 pid: 6476 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271781.211726:0:9485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271781.211742:0:9485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d833d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:3606:x1875138590120960:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271781.211746:0:9485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788271781.211779:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83277b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590120960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788271781.211784:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83276a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590120832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788271781.212140:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d833d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:3608:x1875138590120576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788271781.212151:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271781.212156:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6eb4e20200/0x99288105fd38e86e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38e867 expref: 21 pid: 6477 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.212163:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6eb4e20200/0x99288105fd38e86e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38e867 expref: 21 pid: 6477 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.212185:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4e20200/0x99288105fd38e86e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38e867 expref: 21 pid: 6477 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.212194:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271781.212344:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d833d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:3608:x1875138590120576:12345-0@lo:103:ldlm_bl.0 Request processed in 1402us (1773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271781.212351:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788271781.212530:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83275180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590120704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788271781.212538:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83277800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590120576:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788271781.212739:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271781.212745:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271781.215262:0:13696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ecd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13696:1875138590119808:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788271781.215278:0:13696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ecf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13696:1875138590119936:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788271781.215316:0:13696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f6e813a0600/0x99288105fd38e9b0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271781.217382:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271781.217523:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271781.221897:0:9485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577457792 00000100:00100000:0.0:1788271781.221913:0:9485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577457792 00000100:00100000:1.0:1788271781.222135:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577457920 00000100:00100000:1.0:1788271781.222140:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577457920 00010000:00010000:1.0:1788271781.222182:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6eb4ed4a00/0x99288105fd38e875 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd395 expref: 14 pid: 6476 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271781.222456:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 50 00000100:00100000:1.0:1788271781.222471:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83369180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a94beb9-7f16-4b5a-842a-fac2e5234617+14:2397:x1875138577457920:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271781.222487:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271781.222494:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6eb4ed4a00/0x99288105fd38e875 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd395 expref: 14 pid: 6476 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271781.222506:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6eb4ed4a00/0x99288105fd38e875 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd395 expref: 14 pid: 6476 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271781.222525:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4ed4a00/0x99288105fd38e875 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd395 expref: 14 pid: 6476 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271781.222540:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271781.222732:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83369180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2397:x1875138577457920:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 264us (5207us total) trans 0 rc 0/0 00010000:00010000:0.0:1788271781.222960:0:9485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6eb4ed4c00/0x99288105fd38e87c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd39c expref: 13 pid: 6476 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271781.223003:0:9485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 51 00000100:00100000:0.0:1788271781.223011:0:9485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83369500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2398:x1875138577457792:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271781.223020:0:9485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271781.223025:0:9485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6eb4ed4c00/0x99288105fd38e87c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd39c expref: 13 pid: 6476 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.223036:0:9485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6eb4ed4c00/0x99288105fd38e87c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd39c expref: 13 pid: 6476 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.223047:0:9485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4ed4c00/0x99288105fd38e87c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd39c expref: 13 pid: 6476 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.223058:0:9485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f6e813a0600/0x99288105fd38e9b0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.223067:0:9485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6e813a0600/0x99288105fd38e9b0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.223096:0:9485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f6e813a0600/0x99288105fd38e9b0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.223104:0:9485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f6e813a0600/0x99288105fd38e9b0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.223111:0:9485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f6e813a0600/0x99288105fd38e9b0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.223118:0:9485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f6e813a0600/0x99288105fd38e9b0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.223124:0:9485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e813a0600 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:0.0:1788271781.223128:0:9485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f6e813a0600/0x99288105fd38e9b0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.223136:0:9485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f6e813a0600/0x99288105fd38e9b0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271781.223803:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 50 00010000:00010000:0.0:1788271781.223913:0:9485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f6e813a0600/0x99288105fd38e9b0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.223927:0:9485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271781.223986:0:9485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83369500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a94beb9-7f16-4b5a-842a-fac2e5234617+11:2398:x1875138577457792:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 975us (6611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271781.223993:0:9485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 51 00010000:00010000:2.0:1788271781.224870:0:13696:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f6e813a0600/0x99288105fd38e9b0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.224883:0:13696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f6e813a0600/0x99288105fd38e9b0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.224889:0:13696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6e813a0600/0x99288105fd38e9b0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.277830:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271781.789401:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271781.789884:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271781.789918:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271781.789965:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271781.789990:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271781.790016:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271781.790102:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577458304 00000100:00100000:0.0:1788271781.790112:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577458304 00000100:00100000:0.0:1788271781.790165:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577458560 00000100:00100000:0.0:1788271781.790167:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577458560 00000100:00100000:0.0:1788271781.790178:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577458176 00000100:00100000:0.0:1788271781.790180:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577458176 00000100:00100000:0.0:1788271781.790190:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577458688 00000100:00100000:0.0:1788271781.790192:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577458688 00000100:00100000:0.0:1788271781.790218:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 198 00000100:00100000:0.0:1788271781.790228:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4ec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2398:x1875138577458304:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788271781.790301:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4ec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2398:x1875138577458304:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 74us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271781.790308:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 198 00000100:00100000:0.0:1788271781.790324:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 199 00000100:00100000:0.0:1788271781.790331:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:956fb91b-4885-4e88-90fb-3061936b51ca+5:2398:x1875138577458560:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788271781.790354:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:956fb91b-4885-4e88-90fb-3061936b51ca+5:2398:x1875138577458560:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 24us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271781.790360:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 199 00000100:00100000:0.0:1788271781.790370:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 200 00000100:00100000:0.0:1788271781.790375:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4eca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+18:2398:x1875138577458176:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788271781.790402:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4eca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+18:2398:x1875138577458176:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 27us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271781.790408:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 200 00000100:00100000:0.0:1788271781.790428:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 201 00000100:00100000:0.0:1788271781.790434:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4ec8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:956fb91b-4885-4e88-90fb-3061936b51ca+5:2398:x1875138577458688:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788271781.790457:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4ec8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:956fb91b-4885-4e88-90fb-3061936b51ca+5:2398:x1875138577458688:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 23us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271781.790463:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 201 00000100:00080000:0.0:1788271781.790481:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788271781.790485:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788271781.791441:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577458432 00000100:00100000:2.0:1788271781.791451:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577458432 00000100:00100000:2.0:1788271781.791604:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 80 00000100:00100000:2.0:1788271781.791614:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4eca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2398:x1875138577458432:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788271781.791675:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4eca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2398:x1875138577458432:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 63us (1684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271781.791682:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 80 00000100:00080000:0.0:1788271781.792037:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788271781.792385:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577458048 00000100:00100000:3.0:1788271781.792391:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577458048 00000100:00100000:3.0:1788271781.792467:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 334 00000100:00100000:3.0:1788271781.792483:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+11:2398:x1875138577458048:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271781.792531:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+11:2398:x1875138577458048:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 57us (3142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271781.792538:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 334 00000004:00080000:0.0:1788271781.931810:0:6462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:0.0:1788271781.931850:0:6462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:0.0:1788271781.931859:0:6462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1788271781.932548:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788271781.932570:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8336b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590121088:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788271781.932667:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788271781.932837:0:3592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38e908 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.932848:0:3592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38e908 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.932874:0:3592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38e908 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.932880:0:3592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c5400 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271781.932885:0:3592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38e908 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.932894:0:3592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38e908 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.932913:0:3592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff8f6e8ad50f00) 00010000:00010000:2.0:1788271781.932916:0:3592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271781.932920:0:3592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38e908 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.932927:0:3592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38e908 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.932946:0:3592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21df800/0x99288105fd38e91d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.932953:0:3592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21df800/0x99288105fd38e91d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.932988:0:3592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21df800/0x99288105fd38e91d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.932993:0:3592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6ec21df800 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271781.932995:0:3592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21df800/0x99288105fd38e91d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.933012:0:3592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21df800/0x99288105fd38e91d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.933021:0:3592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f6e90141f00) 00010000:00010000:2.0:1788271781.933023:0:3592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271781.933025:0:3592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21df800/0x99288105fd38e91d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.933031:0:3592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21df800/0x99288105fd38e91d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.933050:0:3592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1a00/0x99288105fd38e986 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.933056:0:3592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1a00/0x99288105fd38e986 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.933062:0:3592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1a00/0x99288105fd38e986 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.933068:0:3592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e813a1a00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271781.933071:0:3592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1a00/0x99288105fd38e986 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.933077:0:3592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1a00/0x99288105fd38e986 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.933084:0:3592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x476db67c (ffff8f6e8ad50f00) 00010000:00010000:2.0:1788271781.933087:0:3592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271781.933090:0:3592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1a00/0x99288105fd38e986 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.933102:0:3592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1a00/0x99288105fd38e986 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x476db67c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.933146:0:3592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079c00/0x99288105fd38e9a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.933154:0:3592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079c00/0x99288105fd38e9a2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.933159:0:3592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079c00/0x99288105fd38e9a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.933165:0:3592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4079c00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271781.933168:0:3592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079c00/0x99288105fd38e9a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.933175:0:3592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079c00/0x99288105fd38e9a2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.933183:0:3592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f6d83055c00) 00010000:00010000:2.0:1788271781.933186:0:3592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271781.933201:0:3592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079c00/0x99288105fd38e9a2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271781.933320:0:3592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079c00/0x99288105fd38e9a2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271781.933750:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590121088 00000100:00100000:0.0:1788271781.933761:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590121088 00000100:00100000:0.0:1788271781.933828:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788271781.933837:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8336a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590121088:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788271781.933865:0:12967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:0.0:1788271781.933897:0:12967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a96dc9f, atime: 0x6a96dc9f, ctime: 0x6a96dc9f, blocks: 0x0 00010000:00010000:0.0:1788271781.933904:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044b522a7/0x99288105fd38e9b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.933919:0:12967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=343s v=(0 0) 00010000:00010000:0.0:1788271781.933923:0:12967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271781.933929:0:12967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044b522a7/0x99288105fd38e9b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.933944:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044b522a7/0x99288105fd38e9b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.933978:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044b522a7/0x99288105fd38e9b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.933984:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044b522a7/0x99288105fd38e9b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.934002:0:12967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788271781.934186:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8336a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3609:x1875138590121088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 349us (1518us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788271781.934194:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1788271781.934216:0:8412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271781.934221:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044b522a7/0x99288105fd38e9b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.934228:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4079200 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:0.0:1788271781.934232:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044b522a7/0x99288105fd38e9b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.934240:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044b522a7/0x99288105fd38e9b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.934253:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044b522a7/0x99288105fd38e9b7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.934261:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044b522a7/0x99288105fd38e9b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271781.934284:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271781.934286:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271781.934287:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788271781.934318:0:3609:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f6d8336b800/2, rc 0, transno 4294967301 00000100:00100000:0.0:1788271781.934325:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8336b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590121088:0@lo:6:osp-syn-1-0.0 00000100:00080000:2.0:1788271781.934356:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:2.0:1788271782.018809:0:13745:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd5afa97f0 20000000:00000080:2.0:1788271782.018827:0:13745:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f6ebc814400 uarg=0000000000000000 20000000:01000000:2.0:1788271782.018870:0:13745:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1788271782.018883:0:13745:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1788271782.018888:0:13745:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1788271782.021379:0:13746:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:2.0:1788271782.021926:0:13745:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:2.0:1788271782.022040:0:13745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:2.0:1788271782.022072:0:13745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:2.0:1788271782.022088:0:13745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:2.0:1788271782.022100:0:13745:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788271782.022126:0:13745:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f6e813a1a00/0x99288105fd38e9be lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271782.022145:0:13745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6e813a1a00/0x99288105fd38e9be lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271782.022158:0:13745:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f6e813a1a00/0x99288105fd38e9be lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271782.022164:0:13745:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f6e813a1a00/0x99288105fd38e9be lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271782.022173:0:13745:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f6e813a1a00/0x99288105fd38e9be lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271782.022180:0:13745:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f6e813a1a00/0x99288105fd38e9be lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271782.022367:0:13745:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e813a1a00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:2.0:1788271782.022372:0:13745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f6e813a1a00/0x99288105fd38e9be lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271782.022381:0:13745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f6e813a1a00/0x99288105fd38e9be lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271782.022563:0:13745:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f6e813a1a00/0x99288105fd38e9be lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271782.022571:0:13745:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f6e813a1a00/0x99288105fd38e9be lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271782.022577:0:13745:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6e813a1a00/0x99288105fd38e9be lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271782.303882:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271782.430771:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ec8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590121216:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788271782.430871:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271782.430969:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590121216 00000100:00100000:3.0:1788271782.430977:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590121216 00000100:00100000:3.0:1788271782.431027:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788271782.431037:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590121216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788271782.431066:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271782.431109:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590121216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271782.431117:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:3.0:1788271782.431154:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4ec8e00 x1875138590121216/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271798 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271782.431173:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ec8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590121216:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788271782.431756:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788271782.431767:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590121344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788271782.431801:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271782.431831:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590121344 00000100:00100000:0.0:1788271782.431851:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590121344 00000100:00100000:0.0:1788271782.431884:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788271782.431891:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4ecad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590121344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788271782.431904:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788271782.431956:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4ecad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590121344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271782.431963:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:0.0:1788271782.431992:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4ecbb80 x1875138590121344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271798 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271782.432005:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590121344:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788271782.432431:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788271782.433492:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788271782.433520:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590121472:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788271782.433588:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271782.435928:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590121472 00000100:00100000:3.0:1788271782.435942:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590121472 00000100:00100000:3.0:1788271782.436043:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788271782.436053:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590121472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788271782.436093:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788271782.436175:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590121472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (2586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271782.436191:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788271782.436373:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590121472:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788271782.493040:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271782.493340:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577458816 00000100:00100000:3.0:1788271782.493349:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577458816 00000100:00100000:3.0:1788271782.493409:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 335 00000100:00100000:3.0:1788271782.493420:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+11:6170:x1875138577458816:12345-192.168.201.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788271782.493435:0:6476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271782.493453:0:6476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6d830c4a00/0x99288105fd38e9c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd3e9 expref: -99 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271782.493481:0:6476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6d830c4a00/0x99288105fd38e9c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3e9 expref: 12 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271782.493492:0:6476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6d830c4a00/0x99288105fd38e9c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3e9 expref: 12 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271782.493502:0:6476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c4a00, rc 0) 00000100:00100000:3.0:1788271782.493563:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+12:6170:x1875138577458816:12345-192.168.201.3@tcp:101:ll_cfg_requeue.0 Request processed in 145us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271782.493571:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 335 00000100:00100000:0.0:1788271782.499241:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271782.499655:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577458944 00000100:00100000:3.0:1788271782.499665:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577458944 00000100:00100000:3.0:1788271782.499726:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 336 00000100:00100000:3.0:1788271782.499737:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+12:6170:x1875138577458944:12345-192.168.201.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788271782.499910:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+12:6170:x1875138577458944:12345-192.168.201.3@tcp:501:ll_cfg_requeue.0 Request processed in 174us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271782.500742:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 336 00000100:00100000:2.0:1788271782.508399:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271782.508650:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577459072 00000100:00100000:1.0:1788271782.508659:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577459072 00000100:00100000:1.0:1788271782.508728:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 337 00000100:00100000:1.0:1788271782.508738:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+12:6170:x1875138577459072:12345-192.168.201.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271782.508885:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+12:6170:x1875138577459072:12345-192.168.201.3@tcp:503:ll_cfg_requeue.0 Request processed in 148us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271782.508894:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 337 00000100:00100000:1.0:1788271782.516037:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271782.516242:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577459200 00000100:00100000:3.0:1788271782.516251:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577459200 00000100:00100000:3.0:1788271782.516295:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 338 00000100:00100000:3.0:1788271782.516302:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+12:10776:x1875138577459200:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788271782.516437:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+12:10776:x1875138577459200:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 134us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271782.516445:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 338 00000100:00100000:2.0:1788271782.523727:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271782.523873:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577459328 00000100:00100000:0.0:1788271782.523884:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577459328 00000100:00100000:0.0:1788271782.523956:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 339 00000100:00100000:0.0:1788271782.523967:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+12:10776:x1875138577459328:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788271782.524123:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+12:10776:x1875138577459328:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 157us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271782.524131:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 339 00000100:00100000:2.0:1788271782.529860:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271782.531430:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577459456 00000100:00100000:1.0:1788271782.531444:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577459456 00000100:00100000:1.0:1788271782.531520:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 340 00000100:00100000:1.0:1788271782.531530:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+12:6170:x1875138577459456:12345-192.168.201.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788271782.531546:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271782.531563:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4ed4200/0x99288105fd38e9cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd3f0 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271782.531592:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4ed4200/0x99288105fd38e9cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3f0 expref: 13 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271782.531603:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4ed4200/0x99288105fd38e9cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3f0 expref: 13 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271782.531612:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4ed4200, rc 0) 00000100:00100000:1.0:1788271782.531714:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:6170:x1875138577459456:12345-192.168.201.3@tcp:101:ll_cfg_requeue.0 Request processed in 176us (1856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271782.531738:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 340 00000100:00100000:1.0:1788271782.536199:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271782.536370:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577459584 00000100:00100000:3.0:1788271782.536380:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577459584 00000100:00100000:3.0:1788271782.536432:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 341 00000100:00100000:3.0:1788271782.536442:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:6170:x1875138577459584:12345-192.168.201.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788271782.536601:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:6170:x1875138577459584:12345-192.168.201.3@tcp:501:ll_cfg_requeue.0 Request processed in 160us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271782.536609:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 341 00000100:00100000:2.0:1788271782.552638:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 10000000:01000000:2.0:1788271782.558015:0:6480:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788271782.558024:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f6d820cc800 from 7 10000000:01000000:2.0:1788271782.558030:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788271782.558089:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e813a1400/0x99288105fd38e9d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271782.558101:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6e813a1400/0x99288105fd38e9d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271782.558112:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6e813a1400/0x99288105fd38e9d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271782.558137:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83154380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590121600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788271782.558223:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271782.569187:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830a6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788271782.571197:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577459712 00000100:00100000:0.0:1788271782.571210:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577459712 00000100:00100000:0.0:1788271782.571277:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590121600 00000100:00100000:0.0:1788271782.571280:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590121600 00000100:00100000:0.0:1788271782.571307:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 342 00000100:00100000:1.0:1788271782.571317:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1788271782.571319:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:6170:x1875138577459712:12345-192.168.201.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271782.571333:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:6480:x1875138590121600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788271782.571344:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271782.571363:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4ed5600/0x99288105fd38e9da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e9d3 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271782.571389:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4ed5600/0x99288105fd38e9da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e9d3 expref: 21 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271782.571401:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4ed5600/0x99288105fd38e9da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e9d3 expref: 21 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271782.571411:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4ed5600, rc 0) 00000100:00100000:0.0:1788271782.571479:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:6170:x1875138577459712:12345-192.168.201.3@tcp:503:ll_cfg_requeue.0 Request processed in 163us (18864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271782.571488:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 342 00000100:00100000:1.0:1788271782.575285:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:6480:x1875138590121600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3905us (17009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271782.575298:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1788271782.575424:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83154380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590121600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788271782.575448:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6e813a1400/0x99288105fd38e9d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e9da expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271782.575461:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6e813a1400/0x99288105fd38e9d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e9da expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271782.575538:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8336aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590121728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788271782.575586:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271782.575687:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4d100c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271782.577723:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271782.579019:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590121728 00000100:00100000:0.0:1788271782.579032:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590121728 00000100:00100000:0.0:1788271782.579113:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577459840 00000100:00100000:0.0:1788271782.579117:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577459840 00000100:00100000:0.0:1788271782.579132:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1788271782.579141:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:6480:x1875138590121728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271782.579406:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:6480:x1875138590121728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 265us (3819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271782.579414:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1788271782.579444:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 345 00000100:00100000:0.0:1788271782.579451:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:10780:x1875138577459840:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788271782.579550:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:10780:x1875138577459840:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 98us (1836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271782.579565:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 345 00000100:00100000:2.0:1788271782.580427:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8336aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590121728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788271782.580481:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83154380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590121856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788271782.580531:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271782.580572:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830a6480 going to sleep for 11 seconds 00000100:00100000:2.0:1788271782.582294:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271782.582733:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590121856 00000100:00100000:1.0:1788271782.582742:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590121856 00000100:00100000:1.0:1788271782.582801:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1788271782.582811:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:6480:x1875138590121856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271782.582962:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:6480:x1875138590121856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (2431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271782.582970:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1788271782.583032:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83154380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590121856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271782.583695:0:13758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3f64e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:13758:1875138590121984:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271782.583743:0:13758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271782.583779:0:13758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830d8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788271782.583835:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590121984 00000100:00100000:3.0:1788271782.583841:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590121984 00000100:00100000:3.0:1788271782.583869:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1788271782.583877:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:13758:x1875138590121984:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271782.583983:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:13758:x1875138590121984:12345-0@lo:502:llog_process_th.0 Request processed in 107us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271782.583991:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788271782.584077:0:13758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3f64e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:13758:1875138590121984:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788271782.584101:0:13758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788271782.584110:0:13758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271782.584113:0:13758:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788271782.584120:0:13758:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f6d820cc800 00000020:00000080:1.0:1788271782.584122:0:13758:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788271782.584184:0:13758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788271782.584188:0:13758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271782.584190:0:13758:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788271782.584193:0:13758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788271782.584195:0:13758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271782.584197:0:13758:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788271782.584200:0:13758:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f6d820cc800 00000020:00000080:1.0:1788271782.584202:0:13758:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788271782.584232:0:13758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3f64e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:13758:1875138590122112:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271782.588525:0:13758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271782.588570:0:13758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830d8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788271782.588679:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590122112 00000100:00100000:0.0:1788271782.588688:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590122112 00000100:00100000:0.0:1788271782.588744:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1788271782.588754:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:13758:x1875138590122112:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788271782.588871:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:13758:x1875138590122112:12345-0@lo:502:llog_process_th.0 Request processed in 118us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271782.588878:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788271782.588996:0:13758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3f64e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:13758:1875138590122112:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788271782.589029:0:13758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788271782.589037:0:13758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271782.589040:0:13758:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788271782.589046:0:13758:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788271782.589414:0:6480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788271782.589437:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788271782.589446:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e813a1400/0x99288105fd38e9d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e9da expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271782.589456:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6e813a1400/0x99288105fd38e9d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e9da expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271782.589466:0:6480:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788271782.589469:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f6eb4b8b800 from 7 10000000:01000000:0.0:1788271782.589472:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788271782.589503:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e9e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271782.589511:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e9e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271782.589519:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e9e1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271782.589540:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ecbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590122240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788271782.589575:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271782.589601:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8387c480 going to sleep for 11 seconds 00000100:00100000:1.0:1788271782.589660:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590122240 00000100:00100000:1.0:1788271782.589663:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590122240 00000100:00100000:1.0:1788271782.589682:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1788271782.589691:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:6480:x1875138590122240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788271782.589699:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271782.589711:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4ed5c00/0x99288105fd38e9e8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e9e1 expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271782.589732:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4ed5c00/0x99288105fd38e9e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e9e1 expref: 22 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271782.589743:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4ed5c00/0x99288105fd38e9e8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e9e1 expref: 22 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271782.589752:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4ed5c00, rc 0) 00000100:00100000:1.0:1788271782.589785:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:6480:x1875138590122240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271782.589791:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1788271782.589823:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ecbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590122240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788271782.589835:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e9e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e9e8 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271782.589844:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e9e1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e9e8 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271782.589893:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3f64e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590122368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271782.589918:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271782.589932:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830d86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271782.589952:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590122368 00000100:00100000:1.0:1788271782.589956:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590122368 00000100:00100000:1.0:1788271782.589978:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1788271782.589991:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:6480:x1875138590122368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271782.590086:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:6480:x1875138590122368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 95us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271782.590093:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1788271782.590124:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3f64e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590122368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271782.590149:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3f64e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590122496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271782.590181:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271782.590193:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830d86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271782.590203:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590122496 00000100:00100000:1.0:1788271782.590206:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590122496 00000100:00100000:1.0:1788271782.590222:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1788271782.590228:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:6480:x1875138590122496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271782.590471:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:6480:x1875138590122496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 243us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271782.590475:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1788271782.590636:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3f64e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590122496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788271782.590965:0:13760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ecbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:13760:1875138590122624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788271782.591000:0:13760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271782.591030:0:13760:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8387c240 going to sleep for 11 seconds 00000100:00100000:2.0:1788271782.591082:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577459968 00000100:00100000:2.0:1788271782.591087:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577459968 00000100:00100000:2.0:1788271782.591117:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590122624 00000100:00100000:2.0:1788271782.591120:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590122624 00000100:00100000:2.0:1788271782.591135:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 352 00000100:00100000:2.0:1788271782.591143:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:10780:x1875138577459968:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788271782.591227:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:10780:x1875138577459968:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 84us (8940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271782.591234:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 352 00000100:00100000:2.0:1788271782.591444:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788271782.591450:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:13760:x1875138590122624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788271782.591513:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:13760:x1875138590122624:12345-0@lo:502:llog_process_th.0 Request processed in 63us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271782.591520:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1788271782.593380:0:13760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ecbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:13760:1875138590122624:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788271782.593407:0:13760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788271782.593418:0:13760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271782.593420:0:13760:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788271782.593426:0:13760:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f6eb4b8b800 00000020:00000080:0.0:1788271782.593427:0:13760:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788271782.593522:0:13760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788271782.593525:0:13760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271782.593526:0:13760:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788271782.593528:0:13760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788271782.593530:0:13760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271782.593530:0:13760:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788271782.593533:0:13760:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f6eb4b8b800 00000020:00000080:0.0:1788271782.593534:0:13760:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788271782.593569:0:13760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ecbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:13760:1875138590122752:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788271782.593614:0:13760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271782.593670:0:13760:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8387c240 going to sleep for 11 seconds 00000100:00100000:1.0:1788271782.594650:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590122752 00000100:00100000:1.0:1788271782.594657:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590122752 00000100:00100000:1.0:1788271782.594692:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1788271782.594699:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:13760:x1875138590122752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271782.594809:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:13760:x1875138590122752:12345-0@lo:502:llog_process_th.0 Request processed in 110us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271782.594814:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788271782.595102:0:13760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ecbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:13760:1875138590122752:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788271782.595123:0:13760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788271782.595128:0:13760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271782.595130:0:13760:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788271782.595136:0:13760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788271782.596555:0:6480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788271782.596582:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788271782.596593:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e9e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e9e8 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271782.596615:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e9e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e9e8 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271782.596654:0:6480:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788271782.596657:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f6eb0cef800 from 7 10000000:01000000:0.0:1788271782.596659:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788271782.596691:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079200/0x99288105fd38e9ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271782.596699:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079200/0x99288105fd38e9ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271782.596709:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079200/0x99288105fd38e9ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271782.596730:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ec8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590122880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788271782.596777:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271782.596814:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8387c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271782.597607:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590122880 00000100:00100000:1.0:1788271782.597615:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590122880 00000100:00100000:1.0:1788271782.597686:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1788271782.597696:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:6480:x1875138590122880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788271782.597717:0:6478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271782.597730:0:6478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4ed4600/0x99288105fd38e9f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e9ef expref: -99 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271782.597754:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4ed4600/0x99288105fd38e9f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e9ef expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271782.597764:0:6478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4ed4600/0x99288105fd38e9f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e9ef expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271782.597773:0:6478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4ed4600, rc 0) 00000100:00100000:1.0:1788271782.597825:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:6480:x1875138590122880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271782.597832:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1788271782.597973:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ec8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590122880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788271782.597989:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079200/0x99288105fd38e9ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e9f6 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271782.597998:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079200/0x99288105fd38e9ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e9f6 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271782.598057:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ec8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590123008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271782.598086:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271782.598129:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8387c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271782.598334:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590123008 00000100:00100000:1.0:1788271782.598338:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590123008 00000100:00100000:1.0:1788271782.598372:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1788271782.598378:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:6480:x1875138590123008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271782.599020:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:6480:x1875138590123008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 640us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271782.599029:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1788271782.599092:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ec8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590123008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271782.599123:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ec8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590123136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788271782.599163:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271782.600633:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8387c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271782.607774:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590123136 00000100:00100000:2.0:1788271782.607789:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590123136 00000100:00100000:3.0:1788271782.615630:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1788271782.615646:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:6480:x1875138590123136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788271782.615813:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:6480:x1875138590123136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (16649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271782.615820:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1788271782.617845:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ec8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590123136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788271782.621525:0:13763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ec8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:13763:1875138590123264:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788271782.621614:0:13763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271782.621688:0:13763:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8387c840 going to sleep for 11 seconds 00000100:00100000:1.0:1788271782.621812:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590123264 00000100:00100000:1.0:1788271782.621819:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590123264 00000100:00100000:1.0:1788271782.621871:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1788271782.621880:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:13763:x1875138590123264:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271782.622005:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:13763:x1875138590123264:12345-0@lo:502:llog_process_th.0 Request processed in 126us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271782.622022:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1788271782.622373:0:13763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ec8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:13763:1875138590123264:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788271782.622400:0:13763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788271782.622411:0:13763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271782.622413:0:13763:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788271782.622421:0:13763:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f6eb0cef800 00000020:00000080:0.0:1788271782.622423:0:13763:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788271782.622493:0:13763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788271782.622496:0:13763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271782.622498:0:13763:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788271782.622500:0:13763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788271782.622503:0:13763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271782.622504:0:13763:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788271782.622507:0:13763:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f6eb0cef800 00000020:00000080:0.0:1788271782.622510:0:13763:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788271782.622542:0:13763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ec8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:13763:1875138590123392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788271782.622579:0:13763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271782.622603:0:13763:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8387c840 going to sleep for 11 seconds 00000100:00100000:1.0:1788271782.622690:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590123392 00000100:00100000:1.0:1788271782.622694:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590123392 00000100:00100000:1.0:1788271782.622724:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1788271782.622732:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:13763:x1875138590123392:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271782.622803:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:13763:x1875138590123392:12345-0@lo:502:llog_process_th.0 Request processed in 71us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271782.622809:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1788271782.623613:0:13763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ec8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:13763:1875138590123392:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788271782.623671:0:13763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788271782.623676:0:13763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271782.623678:0:13763:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788271782.623683:0:13763:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788271782.623842:0:6480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788271782.623861:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788271782.623871:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079200/0x99288105fd38e9ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e9f6 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271782.623881:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079200/0x99288105fd38e9ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e9f6 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271782.623891:0:6480:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788271782.623894:0:6480:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f6e91513000 from 7 10000000:01000000:1.0:1788271782.623896:0:6480:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788271782.623924:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e9fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271782.623932:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e9fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271782.623941:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e9fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271782.623968:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3f66a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590123520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788271782.624013:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271782.624040:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e89ab9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271782.624085:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590123520 00000100:00100000:0.0:1788271782.624090:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590123520 00000100:00100000:0.0:1788271782.624128:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1788271782.624136:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:6480:x1875138590123520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788271782.624146:0:6477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271782.624157:0:6477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4079c00/0x99288105fd38ea04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38e9fd expref: -99 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271782.624185:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4079c00/0x99288105fd38ea04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38e9fd expref: 24 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271782.624961:0:6477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4079c00/0x99288105fd38ea04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38e9fd expref: 24 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271782.624972:0:6477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4079c00, rc 0) 00000100:00100000:0.0:1788271782.625026:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:6480:x1875138590123520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 891us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271782.625032:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788271782.625111:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3f66a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590123520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788271782.625127:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e9fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38ea04 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271782.625137:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e9fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38ea04 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271782.625220:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3f66a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590123648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271782.625257:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271782.625277:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e89ab9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271782.625412:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590123648 00000100:00100000:0.0:1788271782.625417:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590123648 00000100:00100000:0.0:1788271782.625453:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1788271782.625468:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:6480:x1875138590123648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271782.625572:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:6480:x1875138590123648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271782.625592:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1788271782.625790:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3f66a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590123648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788271782.625822:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83154380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590123776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788271782.625859:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271782.625883:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830a6240 going to sleep for 11 seconds 00000100:00100000:1.0:1788271782.625936:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590123776 00000100:00100000:1.0:1788271782.625940:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590123776 00000100:00100000:1.0:1788271782.625982:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1788271782.625989:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:6480:x1875138590123776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271782.626065:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:6480:x1875138590123776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271782.626072:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1788271782.626139:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83154380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f4eab87b-0440-4f90-8c88-4ffaef16406f:6480:1875138590123776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788271782.626677:0:13764:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ec8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:13764:1875138590123904:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788271782.626720:0:13764:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271782.626737:0:13764:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8387cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788271782.626790:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590123904 00000100:00100000:1.0:1788271782.626794:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590123904 00000100:00100000:1.0:1788271782.626820:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1788271782.626826:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:13764:x1875138590123904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271782.626910:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:13764:x1875138590123904:12345-0@lo:502:llog_process_th.0 Request processed in 82us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271782.626917:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1788271782.626996:0:13764:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ec8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:13764:1875138590123904:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788271782.627020:0:13764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788271782.627031:0:13764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271782.627033:0:13764:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788271782.627042:0:13764:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f6e91513000 00000020:00000080:0.0:1788271782.627045:0:13764:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788271782.627113:0:13764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788271782.627117:0:13764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271782.627118:0:13764:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788271782.627121:0:13764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788271782.627123:0:13764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271782.627124:0:13764:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788271782.627128:0:13764:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f6e91513000 00000020:00000080:0.0:1788271782.627130:0:13764:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788271782.627159:0:13764:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ec8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:13764:1875138590124032:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788271782.628587:0:13764:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271782.628654:0:13764:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8387cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788271782.628885:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590124032 00000100:00100000:2.0:1788271782.628893:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590124032 00000100:00100000:2.0:1788271782.628953:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1788271782.628964:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:13764:x1875138590124032:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788271782.629082:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:13764:x1875138590124032:12345-0@lo:502:llog_process_th.0 Request processed in 119us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271782.629090:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1788271782.629327:0:13764:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ec8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f4eab87b-0440-4f90-8c88-4ffaef16406f:13764:1875138590124032:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788271782.629359:0:13764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788271782.629366:0:13764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271782.629368:0:13764:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788271782.629374:0:13764:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788271782.629610:0:6480:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788271782.629663:0:6480:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788271782.629674:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e9fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38ea04 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271782.629685:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e9fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38ea04 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788271782.631738:0:13762:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788271782.653407:0:13766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788271783.325857:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271783.453893:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788271783.453917:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590124160:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788271783.454012:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271783.454140:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590124160 00000100:00100000:3.0:1788271783.454149:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590124160 00000100:00100000:3.0:1788271783.454207:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788271783.454217:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590124160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788271783.454251:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788271783.454302:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590124160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271783.454309:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788271783.454442:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590124160:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1788271783.647513:0:13762:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788271783.710777:0:13766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788271783.967468:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590124288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788271783.967757:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271783.968932:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590124288 00000100:00100000:1.0:1788271783.968942:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590124288 00000100:00100000:1.0:1788271783.969002:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788271783.969016:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83369f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3609:x1875138590124288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788271783.969046:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271783.971816:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83031880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590124800:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788271783.971911:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271783.972186:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590124800 00000100:00100000:0.0:1788271783.972199:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590124800 00000100:00100000:0.0:1788271783.972260:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788271783.972270:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8336aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590124800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788271783.972294:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788271783.972364:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8336aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590124800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271783.972371:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788271783.972505:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85809c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875138590124544:0@lo:400:kworker.0 00000100:00100000:0.0:1788271783.972544:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271783.977139:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788271783.977163:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590124416:0@lo:400:kworker.0 00000100:00100000:0.0:1788271783.977247:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271783.977329:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590124544 00000100:00100000:0.0:1788271783.977336:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590124544 00000100:00100000:0.0:1788271783.977383:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788271783.977392:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e85808380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875138590124544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271783.977747:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e85808380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875138590124544:12345-0@lo:400:kworker.0 Request processed in 355us (5202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271783.977756:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788271783.977796:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85809c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875138590124544:0@lo:400:kworker.0 00000100:00100000:0.0:1788271783.977842:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788271783.977862:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85809c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875138590124928:0@lo:400:kworker.0 00000100:00100000:0.0:1788271783.977898:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271783.977937:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590124928 00000100:00100000:0.0:1788271783.977942:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590124928 00000100:00100000:0.0:1788271783.977967:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788271783.977978:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e8580b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875138590124928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271783.978013:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e8580b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875138590124928:12345-0@lo:400:kworker.0 Request processed in 40us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271783.978019:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788271783.978045:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85809c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875138590124928:0@lo:400:kworker.0 00000100:00100000:0.0:1788271783.978075:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85809c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590125056:0@lo:400:kworker.0 00000100:00100000:0.0:1788271783.978098:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271783.978154:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788271783.978160:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e8580ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590125440:0@lo:400:kworker.0 00000100:00100000:0.0:1788271783.978183:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271783.978221:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590125568:0@lo:400:kworker.0 00000100:00100000:0.0:1788271783.978243:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271783.978268:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590125440 00000100:00100000:0.0:1788271783.978272:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590125440 00000100:00100000:0.0:1788271783.978296:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590125568 00000100:00100000:0.0:1788271783.978299:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590125568 00000100:00100000:0.0:1788271783.978325:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788271783.978331:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e85808e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590125440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271783.978364:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e85808e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590125440:12345-0@lo:400:kworker.0 Request processed in 33us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271783.978369:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788271783.978387:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788271783.978393:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e85808a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590125568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271783.978421:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e85808a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590125568:12345-0@lo:400:kworker.0 Request processed in 28us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271783.978427:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:0.0:1788271783.978456:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6e85809500 x1875138590125568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271783.978466:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590125568:0@lo:400:kworker.0 00010000:00080000:0.0:1788271783.978475:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6e8580ad80 x1875138590125440/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271783.978481:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e8580ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590125440:0@lo:400:kworker.0 00000100:00080000:0.0:1788271783.978539:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788271783.978580:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590124416 00000100:00100000:0.0:1788271783.978583:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590124416 00000100:00100000:0.0:1788271783.978607:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1788271783.978614:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3607:x1875138590124416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271783.978670:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3607:x1875138590124416:12345-0@lo:400:kworker.0 Request processed in 57us (1423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271783.978677:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1788271783.978709:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590124416:0@lo:400:kworker.0 00000100:00100000:0.0:1788271783.978726:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e8580bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590124672:0@lo:400:kworker.0 00000100:00100000:0.0:1788271783.978749:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271783.978765:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e8580a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3608:1875138590125184:0@lo:400:kworker.0 00000100:00100000:0.0:1788271783.978784:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271783.978814:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e8580ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3608:1875138590125696:0@lo:400:kworker.0 00000100:00100000:0.0:1788271783.978835:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271783.978851:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788271783.978856:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85809180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3608:1875138590125312:0@lo:400:kworker.0 00000100:00100000:0.0:1788271783.978873:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271783.978886:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3608:1875138590125824:0@lo:400:kworker.0 00000100:00100000:0.0:1788271783.978904:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271783.978936:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590125184 00000100:00100000:0.0:1788271783.978940:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590125184 00000100:00100000:0.0:1788271783.978962:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590125696 00000100:00100000:0.0:1788271783.978965:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590125696 00000100:00100000:0.0:1788271783.978976:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590125312 00000100:00100000:0.0:1788271783.978979:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590125312 00000100:00100000:0.0:1788271783.978989:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590125824 00000100:00100000:0.0:1788271783.978991:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590125824 00000100:00100000:0.0:1788271783.979003:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788271783.979009:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875138590125184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271783.979039:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4ecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875138590125184:12345-0@lo:400:kworker.0 Request processed in 30us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271783.979045:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788271783.979056:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788271783.979061:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0ccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875138590125696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271783.979086:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0ccd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875138590125696:12345-0@lo:400:kworker.0 Request processed in 25us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271783.979092:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788271783.979103:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788271783.979108:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0ccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875138590125312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271783.979145:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0ccf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875138590125312:12345-0@lo:400:kworker.0 Request processed in 37us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271783.979151:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788271783.979163:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788271783.979168:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875138590125824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271783.979191:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875138590125824:12345-0@lo:400:kworker.0 Request processed in 24us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271783.979196:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00080000:0.0:1788271783.979212:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788271783.979215:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788271783.979222:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590125056 00000100:00100000:0.0:1788271783.979225:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590125056 00000100:00100000:0.0:1788271783.979241:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590124672 00000100:00100000:0.0:1788271783.979244:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590124672 00000100:00100000:0.0:1788271783.979255:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788271783.979261:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e85808700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590125056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271783.979295:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e85808700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590125056:12345-0@lo:400:kworker.0 Request processed in 34us (1196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271783.979301:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788271783.979311:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788271783.979317:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e85809f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590124672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271783.979341:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e85809f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590124672:12345-0@lo:400:kworker.0 Request processed in 24us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271783.979346:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788271783.979368:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85809c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590125056:0@lo:400:kworker.0 00010000:00080000:0.0:1788271783.979389:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6e85809180 x1875138590125312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271783.979404:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85809180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3608:1875138590125312:0@lo:400:kworker.0 00010000:00080000:0.0:1788271783.979414:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6e85809500 x1875138590125824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271783.979422:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3608:1875138590125824:0@lo:400:kworker.0 00000100:00100000:0.0:1788271783.979430:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e8580bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590124672:0@lo:400:kworker.0 00000100:00100000:0.0:1788271783.979438:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e8580a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3608:1875138590125184:0@lo:400:kworker.0 00000100:00100000:0.0:1788271783.979445:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e8580ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3608:1875138590125696:0@lo:400:kworker.0 00000100:00100000:1.0:1788271783.984317:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83369f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3609:x1875138590124288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 15296us (16551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271783.984333:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788271783.990460:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590124288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788271783.990526:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83031880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590124800:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788271784.349800:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271785.373854:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271786.397860:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271786.915879:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271786.915929:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271786.915954:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271786.915970:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577460480 00000100:00100000:3.0:1788271786.915981:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577460480 00000100:00100000:0.0:1788271786.915996:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271786.916026:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271786.916044:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 83 00000100:00100000:3.0:1788271786.916055:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0ccd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2397:x1875138577460480:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788271786.916063:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00080000:0.0:1788271786.916084:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788271786.916102:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577460224 00000100:00100000:0.0:1788271786.916106:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577460224 00000100:00100000:0.0:1788271786.916141:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577460736 00000100:00100000:0.0:1788271786.916145:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577460736 00000100:00100000:3.0:1788271786.916152:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0ccd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2397:x1875138577460480:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 99us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271786.916161:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577460352 00000100:00100000:0.0:1788271786.916165:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577460352 00000100:00100000:0.0:1788271786.916177:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577460608 00000100:00100000:0.0:1788271786.916179:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577460608 00000100:00100000:0.0:1788271786.916193:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 208 00000100:00100000:0.0:1788271786.916199:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0ccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2397:x1875138577460224:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788271786.916242:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0ccc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2397:x1875138577460224:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 44us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271786.916250:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 208 00000100:00100000:0.0:1788271786.916265:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 209 00000100:00100000:0.0:1788271786.916270:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0ccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:956fb91b-4885-4e88-90fb-3061936b51ca+5:2397:x1875138577460736:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788271786.916291:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0ccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:956fb91b-4885-4e88-90fb-3061936b51ca+5:2397:x1875138577460736:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 20us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271786.916297:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 209 00000100:00100000:0.0:1788271786.916306:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 210 00000100:00100000:0.0:1788271786.916312:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2397:x1875138577460352:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788271786.916347:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2397:x1875138577460352:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 35us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271786.916354:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 210 00000100:00100000:0.0:1788271786.916365:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 211 00000100:00100000:0.0:1788271786.916371:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0ccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:956fb91b-4885-4e88-90fb-3061936b51ca+5:2397:x1875138577460608:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788271786.916395:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0ccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:956fb91b-4885-4e88-90fb-3061936b51ca+5:2397:x1875138577460608:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 24us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271786.916401:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 211 00000100:00080000:0.0:1788271786.916422:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788271786.916424:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788271786.916465:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577460096 00000100:00100000:3.0:1788271786.916467:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 83 00000100:00100000:0.0:1788271786.916471:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577460096 00000100:00100000:0.0:1788271786.916502:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 366 00000100:00100000:0.0:1788271786.916508:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2397:x1875138577460096:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788271786.916538:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2397:x1875138577460096:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 30us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271786.916545:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 366 00010000:00010000:2.0:1788271787.427457:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271787.549865:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e8580ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590126080:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788271787.549883:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590125952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788271787.550038:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788271787.550053:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83031880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590126208:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788271787.551654:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271787.554405:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590125952 00000100:00100000:1.0:1788271787.554420:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590125952 00000100:00100000:1.0:1788271787.554500:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788271787.554515:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590125952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788271787.554551:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788271787.554970:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590125952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 460us (3320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271787.554979:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1788271787.555025:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788271787.555065:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb0cce300 x1875138590125952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271803 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271787.555086:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590125952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788271787.555222:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271787.555357:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271787.555431:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590126208 00000100:00100000:0.0:1788271787.555438:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590126208 00000100:00100000:0.0:1788271787.555474:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788271787.555482:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590126208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788271787.555505:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788271787.555540:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590126208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271787.555546:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788271787.555615:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83031880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590126208:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788271787.557322:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590126080 00000100:00100000:1.0:1788271787.557332:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590126080 00000100:00100000:1.0:1788271787.557395:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788271787.557478:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e8580a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590126080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788271787.557499:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788271787.557575:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e8580a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590126080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (2353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271787.557582:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:0.0:1788271787.557910:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788271787.557945:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6e8580ad80 x1875138590126080/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271803 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271787.557964:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e8580ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590126080:0@lo:13:osp-pre-0-1.0 00000001:00080000:2.0:1788271788.064957:0:9475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:0.0:1788271788.445782:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271788.582481:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590126336:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788271788.582567:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271788.582827:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590126336 00000100:00100000:0.0:1788271788.582835:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590126336 00000100:00100000:0.0:1788271788.582913:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788271788.582923:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590126336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788271788.582958:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788271788.583023:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590126336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271788.583050:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788271788.583321:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83154380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590126336:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788271789.085885:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e8580ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590126464:0@lo:400:kworker.0 00000100:00100000:1.0:1788271789.085972:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271789.086140:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590126464 00000100:00100000:2.0:1788271789.086147:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590126464 00000100:00100000:3.0:1788271789.086165:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e8580bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875138590126592:0@lo:400:kworker.0 00000100:00100000:3.0:1788271789.086200:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271789.086201:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1788271789.086210:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3606:x1875138590126464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271789.086291:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83277800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590126720:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788271789.086319:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271789.086355:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590126720 00000100:00100000:3.0:1788271789.086359:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590126720 00000100:00100000:3.0:1788271789.086395:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788271789.086403:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83275180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590126720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788271789.086429:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271789.086466:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83275180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590126720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271789.086491:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1788271789.086523:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788271789.086556:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83277800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590126720:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788271789.086610:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83277800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590126848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788271789.086655:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271789.086692:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590126848 00000100:00100000:3.0:1788271789.086696:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590126848 00000100:00100000:3.0:1788271789.086722:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788271789.086728:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83276a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590126848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788271789.086740:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271789.087359:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83276a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590126848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 628us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271789.087366:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:3.0:1788271789.087385:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788271789.087402:0:3609:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1788271789.087407:0:3609:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f6d8336b800, transno 4294967301 00000100:00100000:3.0:1788271789.087420:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83277800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590126848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788271789.087559:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590126592 00000100:00100000:3.0:1788271789.087564:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590126592 00000100:00100000:3.0:1788271789.087596:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788271789.087603:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875138590126592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271789.087665:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83154380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875138590126592:12345-0@lo:400:kworker.0 Request processed in 62us (1464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271789.087671:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788271789.087702:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e8580bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875138590126592:0@lo:400:kworker.0 00000100:00100000:0.0:1788271789.090964:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85809c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590127232:0@lo:400:kworker.0 00000100:00100000:0.0:1788271789.091033:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271789.091066:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590127744:0@lo:400:kworker.0 00000100:00100000:0.0:1788271789.091100:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271789.091125:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788271789.091130:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e8580bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3608:1875138590127360:0@lo:400:kworker.0 00000100:00100000:0.0:1788271789.091152:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271789.091169:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3608:1875138590127872:0@lo:400:kworker.0 00000100:00100000:0.0:1788271789.091189:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271789.091222:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590127744 00000100:00100000:0.0:1788271789.091229:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590127744 00000100:00100000:0.0:1788271789.091281:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788271789.091290:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590127744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271789.091339:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590127744:12345-0@lo:400:kworker.0 Request processed in 50us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271789.091346:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788271789.091370:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590127360 00000100:00100000:0.0:1788271789.091373:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590127360 00000100:00100000:0.0:1788271789.091403:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590127872 00000100:00100000:0.0:1788271789.091406:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590127872 00000100:00100000:0.0:1788271789.091421:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788271789.091427:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875138590127360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271789.091455:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875138590127360:12345-0@lo:400:kworker.0 Request processed in 28us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271789.091461:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788271789.091488:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788271789.091494:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875138590127872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271789.091522:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875138590127872:12345-0@lo:400:kworker.0 Request processed in 29us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271789.091528:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00080000:0.0:1788271789.091542:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788271789.091547:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788271789.091572:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e8580bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3608:1875138590127360:0@lo:400:kworker.0 00000100:00100000:0.0:1788271789.091582:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3608:1875138590127872:0@lo:400:kworker.0 00010000:00080000:0.0:1788271789.091594:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4f3b800 x1875138590127744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271789.091604:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590127744:0@lo:400:kworker.0 00000100:00100000:0.0:1788271789.091656:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590127232 00000100:00100000:0.0:1788271789.091660:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590127232 00000100:00100000:0.0:1788271789.091683:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788271789.091689:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590127232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271789.091724:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590127232:12345-0@lo:400:kworker.0 Request processed in 35us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271789.091730:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788271789.091751:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85809c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590127232:0@lo:400:kworker.0 00000100:00100000:3.0:1788271789.092027:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85809180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875138590127104:0@lo:400:kworker.0 00000100:00100000:3.0:1788271789.092057:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271789.092093:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590127616:0@lo:400:kworker.0 00000100:00100000:3.0:1788271789.092113:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271789.092134:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590127616 00000100:00100000:3.0:1788271789.092137:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590127616 00000100:00100000:3.0:1788271789.092165:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788271789.092170:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83277b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590127616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271789.092197:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83277b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590127616:12345-0@lo:400:kworker.0 Request processed in 27us (83us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271789.092202:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:3.0:1788271789.092228:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4f38a80 x1875138590127616/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271789.092237:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590127616:0@lo:400:kworker.0 00000100:00100000:3.0:1788271789.092249:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788271789.092254:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590126976:0@lo:400:kworker.0 00000100:00100000:3.0:1788271789.092276:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271789.092293:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590126976 00000100:00100000:3.0:1788271789.092296:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590126976 00000100:00100000:3.0:1788271789.092312:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788271789.092317:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8336b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590126976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271789.092342:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8336b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590126976:12345-0@lo:400:kworker.0 Request processed in 25us (66us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271789.092347:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788271789.092366:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85809500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590126976:0@lo:400:kworker.0 00000100:00100000:3.0:1788271789.092379:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3607:1875138590127488:0@lo:400:kworker.0 00000100:00100000:3.0:1788271789.092400:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271789.092416:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590127104 00000100:00100000:3.0:1788271789.092419:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590127104 00000100:00100000:3.0:1788271789.092435:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590127488 00000100:00100000:3.0:1788271789.092437:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590127488 00000100:00100000:3.0:1788271789.092452:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788271789.092458:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83277800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875138590127104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271789.092484:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83277800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875138590127104:12345-0@lo:400:kworker.0 Request processed in 27us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271789.092490:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788271789.092501:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788271789.092506:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875138590127488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271789.092530:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875138590127488:12345-0@lo:400:kworker.0 Request processed in 24us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271789.092536:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00010000:00080000:3.0:1788271789.092562:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4f38700 x1875138590127488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271789.092571:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3607:1875138590127488:0@lo:400:kworker.0 00000100:00100000:3.0:1788271789.092576:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3607:1875138590128000:0@lo:400:kworker.0 00000100:00100000:3.0:1788271789.092598:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271789.092615:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590128000 00000100:00100000:3.0:1788271789.092640:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590128000 00000100:00100000:3.0:1788271789.092665:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788271789.092671:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82238e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875138590128000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271789.092708:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82238e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875138590128000:12345-0@lo:400:kworker.0 Request processed in 37us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271789.092715:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00010000:00080000:3.0:1788271789.092738:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb4f3a680 x1875138590128000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271789.092746:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3607:1875138590128000:0@lo:400:kworker.0 00000100:00100000:3.0:1788271789.092755:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85809180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875138590127104:0@lo:400:kworker.0 00000100:00080000:0.0:1788271789.093240:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788271789.093246:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788271789.093484:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3606:x1875138590126464:12345-0@lo:400:kworker.0 Request processed in 7273us (7510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271789.093494:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1788271789.093585:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e8580ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590126464:0@lo:400:kworker.0 00010000:00010000:0.0:1788271789.469784:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271790.494001:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271791.517956:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271792.030511:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271792.030561:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271792.030584:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577460992 00000100:00100000:2.0:1788271792.030601:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271792.030604:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577460992 00000100:00100000:2.0:1788271792.030687:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271792.030710:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271792.030734:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271792.030801:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577461248 00000100:00100000:1.0:1788271792.030808:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577461248 00000100:00100000:1.0:1788271792.030867:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 86 00000100:00100000:1.0:1788271792.030883:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ece680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2397:x1875138577461248:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271792.030992:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ece680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2397:x1875138577461248:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 115us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271792.031000:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 86 00000100:00080000:1.0:1788271792.031047:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788271792.031053:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271792.031065:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577460864 00000100:00100000:1.0:1788271792.031069:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577460864 00000100:00100000:1.0:1788271792.031100:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 368 00000100:00100000:1.0:1788271792.031107:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2397:x1875138577460864:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271792.031137:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2397:x1875138577460864:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 31us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271792.031143:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 368 00000100:00100000:3.0:1788271792.034234:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577461504 00000100:00100000:1.0:1788271792.034234:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577461120 00000100:00100000:3.0:1788271792.034253:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577461504 00000100:00100000:1.0:1788271792.034253:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577461120 00000100:00100000:3.0:1788271792.034328:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577461376 00000100:00100000:3.0:1788271792.034332:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577461376 00000100:00100000:0.0:1788271792.036000:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 218 00000100:00100000:0.0:1788271792.036035:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 219 00000100:00100000:0.0:1788271792.036054:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83031880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:956fb91b-4885-4e88-90fb-3061936b51ca+5:2397:x1875138577461504:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788271792.036198:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83031880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:956fb91b-4885-4e88-90fb-3061936b51ca+5:2397:x1875138577461504:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 153us (5594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271792.036207:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 219 00000100:00100000:0.0:1788271792.036329:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2397:x1875138577460992:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788271792.036359:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2397:x1875138577460992:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 343us (5867us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271792.036979:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 220 00000100:00100000:1.0:1788271792.036995:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:956fb91b-4885-4e88-90fb-3061936b51ca+5:2397:x1875138577461376:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271792.037086:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:956fb91b-4885-4e88-90fb-3061936b51ca+5:2397:x1875138577461376:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 96us (6350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271792.037094:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 220 00000100:00100000:1.0:1788271792.037115:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 221 00000100:00100000:1.0:1788271792.037122:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2397:x1875138577461120:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271792.037151:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2397:x1875138577461120:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 30us (6441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271792.037157:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 221 00000100:00080000:1.0:1788271792.037188:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788271792.037195:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788271792.040862:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 218 00010000:00010000:2.0:1788271792.545048:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271792.670105:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590128128:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788271792.670183:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271792.670340:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590128128 00000100:00100000:0.0:1788271792.670350:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590128128 00000100:00080000:1.0:1788271792.670405:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788271792.670902:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590128256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788271792.670936:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271792.675514:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590128256 00000100:00100000:0.0:1788271792.675530:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590128256 00000100:00100000:0.0:1788271792.675596:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788271792.675606:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590128128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788271792.675659:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788271792.675733:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590128128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 128us (5549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271792.675741:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788271792.675759:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788271792.675780:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590128256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788271792.675793:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788271792.675822:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590128256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (4885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271792.675828:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788271792.678243:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfb5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590128384:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788271792.678320:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788271792.678452:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788271792.678490:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d816ced80 x1875138590128128/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271792.678515:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590128128:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1788271792.678556:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb3f66a00 x1875138590128256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271792.678582:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590128256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788271792.679029:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590128384 00000100:00100000:0.0:1788271792.679038:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590128384 00000100:00100000:1.0:1788271792.679164:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788271792.679173:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0cce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590128384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788271792.679209:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788271792.679312:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0cce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590128384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 139us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271792.679320:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788271792.679380:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfb5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590128384:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788271793.565816:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271793.694243:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788271793.694267:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590128512:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788271793.694347:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271793.694557:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590128512 00000100:00100000:1.0:1788271793.694569:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590128512 00000100:00100000:3.0:1788271793.694866:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788271793.694879:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590128512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788271793.694929:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788271793.694976:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590128512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271793.694984:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788271793.696037:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590128512:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1788271793.889062:0:13762:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788271793.952568:0:13766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788271794.206501:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfb58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875138590128768:0@lo:400:kworker.0 00000100:00100000:3.0:1788271794.206583:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271794.206675:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3608:1875138590129280:0@lo:400:kworker.0 00000100:00100000:3.0:1788271794.206700:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271794.206724:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3608:1875138590129792:0@lo:400:kworker.0 00000100:00100000:3.0:1788271794.206760:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271794.206782:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590128768 00000100:00100000:1.0:1788271794.206792:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590128768 00000100:00100000:3.0:1788271794.206807:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788271794.206816:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfb5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590128896:0@lo:400:kworker.0 00000100:00100000:3.0:1788271794.206844:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271794.206857:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590129280 00000100:00100000:1.0:1788271794.206861:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590129280 00000100:00100000:3.0:1788271794.206869:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3608:1875138590129408:0@lo:400:kworker.0 00000100:00100000:1.0:1788271794.206894:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590129792 00000100:00100000:3.0:1788271794.206899:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271794.206899:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590129792 00000100:00100000:3.0:1788271794.206918:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3608:1875138590129920:0@lo:400:kworker.0 00000100:00100000:1.0:1788271794.206920:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590129408 00000100:00100000:1.0:1788271794.206924:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590129408 00000100:00100000:1.0:1788271794.206945:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788271794.206951:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271794.206960:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8223bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875138590128768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271794.207147:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8223bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875138590128768:12345-0@lo:400:kworker.0 Request processed in 191us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271794.207155:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788271794.207184:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590129920 00000100:00100000:1.0:1788271794.207188:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590129920 00000100:00100000:3.0:1788271794.207205:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788271794.207284:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788271794.207296:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875138590129280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271794.207297:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82239c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875138590129792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271794.207341:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82239500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875138590129280:12345-0@lo:400:kworker.0 Request processed in 128us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271794.207352:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788271794.207353:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82239c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875138590129792:12345-0@lo:400:kworker.0 Request processed in 59us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271794.207363:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788271794.207375:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788271794.207385:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788271794.207386:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875138590129408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271794.207397:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875138590129920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271794.207425:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82239880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875138590129408:12345-0@lo:400:kworker.0 Request processed in 42us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271794.207434:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788271794.207441:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875138590129920:12345-0@lo:400:kworker.0 Request processed in 47us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271794.207448:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788271794.207457:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590128896 00000100:00100000:3.0:1788271794.207462:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590128896 00000100:00080000:1.0:1788271794.207474:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788271794.207479:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271794.207491:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875138590129024:0@lo:400:kworker.0 00000100:00100000:3.0:1788271794.207498:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788271794.207507:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8223b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590128896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271794.207522:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271794.207547:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590129536:0@lo:400:kworker.0 00000100:00100000:3.0:1788271794.207554:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8223b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590128896:12345-0@lo:400:kworker.0 Request processed in 46us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271794.207562:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788271794.207581:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271794.207599:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590130048:0@lo:400:kworker.0 00000100:00100000:3.0:1788271794.207609:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590130304:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788271794.207651:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271794.207685:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788271794.207691:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271794.207695:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfb5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590128640:0@lo:400:kworker.0 00000100:00100000:1.0:1788271794.207730:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271794.207734:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfb5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590128896:0@lo:400:kworker.0 00010000:00080000:3.0:1788271794.207765:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d81f40000 x1875138590129408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271794.207773:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590129152:0@lo:400:kworker.0 00000100:00100000:3.0:1788271794.207780:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3608:1875138590129408:0@lo:400:kworker.0 00010000:00080000:3.0:1788271794.207795:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d81f42300 x1875138590129920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271794.207806:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271794.207811:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3608:1875138590129920:0@lo:400:kworker.0 00000100:00100000:3.0:1788271794.207831:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfb58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875138590128768:0@lo:400:kworker.0 00000100:00100000:3.0:1788271794.207841:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3608:1875138590129280:0@lo:400:kworker.0 00000100:00100000:3.0:1788271794.207849:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3608:1875138590129792:0@lo:400:kworker.0 00000100:00100000:3.0:1788271794.207875:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788271794.207880:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590130432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788271794.207906:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271794.207934:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590130304 00000100:00100000:3.0:1788271794.207938:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590130304 00000100:00100000:3.0:1788271794.207970:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590130432 00000100:00100000:3.0:1788271794.207973:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590130432 00000100:00100000:3.0:1788271794.207989:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788271794.208083:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590129664:0@lo:400:kworker.0 00000100:00100000:1.0:1788271794.208115:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271794.208127:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590129024 00000100:00100000:0.0:1788271794.208133:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590129024 00000100:00100000:1.0:1788271794.208137:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590130176:0@lo:400:kworker.0 00000100:00100000:0.0:1788271794.208168:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788271794.208177:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1875138590129024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271794.208216:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1875138590129024:12345-0@lo:400:kworker.0 Request processed in 40us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271794.208223:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788271794.208240:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271794.208271:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875138590129024:0@lo:400:kworker.0 00000100:00100000:3.0:1788271794.208276:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590130304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788271794.208303:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271794.208346:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590130304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271794.208362:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788271794.208376:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788271794.208381:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590130432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788271794.208392:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271794.208419:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590130432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271794.208424:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788271794.210754:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590128640 00000100:00100000:2.0:1788271794.210770:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590128640 00000100:00100000:2.0:1788271794.210830:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1788271794.210841:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3606:x1875138590128640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271794.210942:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3606:x1875138590128640:12345-0@lo:400:kworker.0 Request processed in 103us (3210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271794.210949:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1788271794.211019:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfb5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590128640:0@lo:400:kworker.0 00000100:00080000:2.0:1788271794.211066:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788271794.211103:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590130432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788271794.211321:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590129536 00000100:00100000:0.0:1788271794.211327:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590129536 00000100:00100000:0.0:1788271794.211369:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590130048 00000100:00100000:0.0:1788271794.211373:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590130048 00000100:00100000:0.0:1788271794.211386:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590129664 00000100:00100000:0.0:1788271794.211389:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590129664 00000100:00100000:0.0:1788271794.211400:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590130176 00000100:00100000:0.0:1788271794.211403:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590130176 00000100:00100000:0.0:1788271794.211415:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788271794.211421:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590129536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271794.211468:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590129536:12345-0@lo:400:kworker.0 Request processed in 46us (3888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271794.211475:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788271794.211489:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788271794.211504:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebcb82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590130048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271794.211535:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebcb82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590130048:12345-0@lo:400:kworker.0 Request processed in 33us (3885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271794.211542:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788271794.211755:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788271794.211762:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590129664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271794.211792:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590129664:12345-0@lo:400:kworker.0 Request processed in 31us (3678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271794.211798:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788271794.211808:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788271794.211814:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590130176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271794.211838:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590130176:12345-0@lo:400:kworker.0 Request processed in 25us (3600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271794.211844:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:0.0:1788271794.211870:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788271794.211904:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590129152 00000100:00100000:0.0:1788271794.211908:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590129152 00000100:00100000:0.0:1788271794.211929:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788271794.211935:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590129152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271794.211971:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590129152:12345-0@lo:400:kworker.0 Request processed in 36us (4168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271794.211977:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788271794.212057:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590129152:0@lo:400:kworker.0 00010000:00080000:0.0:1788271794.212073:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d81f42680 x1875138590129664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271794.212098:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590129664:0@lo:400:kworker.0 00000100:00100000:0.0:1788271794.212112:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590130176:0@lo:400:kworker.0 00010000:00080000:0.0:1788271794.212308:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d81f40e00 x1875138590129536/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271794.212318:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590129536:0@lo:400:kworker.0 00000100:00100000:0.0:1788271794.212329:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590130048:0@lo:400:kworker.0 00000100:00100000:2.0:1788271794.212425:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590130304:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788271794.590555:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271795.615048:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271796.641043:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271797.152563:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271797.152607:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271797.152684:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271797.152786:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577461632 00000100:00100000:3.0:1788271797.152796:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577461632 00000100:00100000:3.0:1788271797.152852:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 370 00000100:00100000:3.0:1788271797.152861:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2395:x1875138577461632:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271797.152933:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2395:x1875138577461632:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 73us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271797.152940:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 370 00000100:00100000:1.0:1788271797.153027:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577461888 00000100:00100000:1.0:1788271797.153033:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577461888 00000100:00100000:1.0:1788271797.153086:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577461760 00000100:00100000:1.0:1788271797.153089:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577461760 00000100:00100000:1.0:1788271797.153110:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 228 00000100:00100000:1.0:1788271797.153133:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577461888:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271797.153166:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577461888:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 37us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271797.153171:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 228 00000100:00100000:1.0:1788271797.153186:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 229 00000100:00100000:1.0:1788271797.153192:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577461760:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271797.153216:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577461760:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 24us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271797.153222:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 229 00000100:00080000:3.0:1788271797.153411:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788271797.153416:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788271797.167739:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271797.167798:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271797.167838:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271797.167936:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577462144 00000100:00100000:3.0:1788271797.167959:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577462144 00000100:00100000:3.0:1788271797.168037:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577462272 00000100:00100000:3.0:1788271797.168040:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577462272 00000100:00100000:3.0:1788271797.168064:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 230 00000100:00100000:3.0:1788271797.168075:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:956fb91b-4885-4e88-90fb-3061936b51ca+5:2396:x1875138577462144:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271797.168179:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:956fb91b-4885-4e88-90fb-3061936b51ca+5:2396:x1875138577462144:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 106us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271797.168188:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 230 00000100:00100000:3.0:1788271797.168216:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 231 00000100:00100000:3.0:1788271797.168239:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:956fb91b-4885-4e88-90fb-3061936b51ca+5:2396:x1875138577462272:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271797.168272:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:956fb91b-4885-4e88-90fb-3061936b51ca+5:2396:x1875138577462272:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 31us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271797.168278:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 231 00000100:00080000:1.0:1788271797.168637:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788271797.168641:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788271797.169820:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577462016 00000100:00100000:0.0:1788271797.169833:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577462016 00000100:00100000:0.0:1788271797.169919:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 27 00000100:00100000:0.0:1788271797.169929:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2394:x1875138577462016:12345-192.168.201.3@tcp:9:kworker.0 00000020:00000080:0.0:1788271797.169967:0:12967:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e92b 00000100:00080000:0.0:1788271797.169977:0:12967:0:(import.c:65:import_set_state_nolock()) ffff8f6e812a9800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788271797.170032:0:12967:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:0.0:1788271797.170224:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+2:2394:x1875138577462016:12345-192.168.201.3@tcp:9:kworker.0 Request processed in 294us (2498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271797.170231:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 27 00000100:00080000:1.0:1788271797.170612:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788271797.170781:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271797.662223:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271797.789994:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590130560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788271797.790072:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271797.790490:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590130560 00000100:00100000:1.0:1788271797.790498:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590130560 00000100:00100000:1.0:1788271797.790566:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788271797.790576:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4fb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590130560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788271797.790643:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788271797.790699:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4fb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590130560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271797.790707:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:2.0:1788271797.790802:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d8313d500 x1875138590130560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271797.790820:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590130560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788271797.790964:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590130688:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788271797.790995:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271797.791158:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590130816:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788271797.791190:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271797.791388:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590130816 00000100:00100000:2.0:1788271797.791394:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590130816 00000100:00100000:2.0:1788271797.791431:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788271797.791439:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590130816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788271797.791464:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788271797.791498:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590130816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271797.791513:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788271797.791644:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590130816:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788271797.791717:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590130688 00000100:00100000:0.0:1788271797.791722:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590130688 00000100:00100000:0.0:1788271797.791757:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788271797.791765:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590130688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788271797.791776:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788271797.791821:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590130688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271797.791836:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:2.0:1788271797.791918:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d816cf800 x1875138590130688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271797.791931:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590130688:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788271797.792080:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788271798.689407:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271798.813999:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788271798.819884:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590130944:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788271798.819976:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271798.820151:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590130944 00000100:00100000:2.0:1788271798.820161:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590130944 00000100:00100000:2.0:1788271798.820211:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788271798.820220:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590130944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788271798.820263:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788271798.820308:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590130944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271798.820314:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788271798.826082:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590130944:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788271799.325958:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788271799.325982:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590131072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788271799.326054:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271799.326179:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590131072 00000100:00100000:0.0:1788271799.326186:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590131072 00000100:00100000:0.0:1788271799.326246:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788271799.326257:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590131072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788271799.326300:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788271799.326346:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590131072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271799.326353:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:2.0:1788271799.326419:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788271799.326456:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590131072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788271799.326975:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875138590131328:0@lo:400:kworker.0 00000100:00100000:1.0:1788271799.327014:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271799.327035:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3608:1875138590131840:0@lo:400:kworker.0 00000100:00100000:1.0:1788271799.327057:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271799.327078:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3608:1875138590132352:0@lo:400:kworker.0 00000100:00100000:1.0:1788271799.327098:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271799.327120:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788271799.327127:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590131456:0@lo:400:kworker.0 00000100:00100000:1.0:1788271799.327151:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271799.327169:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83032680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3608:1875138590131968:0@lo:400:kworker.0 00000100:00100000:1.0:1788271799.327208:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271799.327226:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83030a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3608:1875138590132480:0@lo:400:kworker.0 00000100:00100000:1.0:1788271799.327246:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271799.327270:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590131328 00000100:00100000:1.0:1788271799.327275:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590131328 00000100:00100000:0.0:1788271799.327382:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590131840 00000100:00100000:0.0:1788271799.327386:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590131840 00000100:00100000:0.0:1788271799.327415:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590132352 00000100:00100000:0.0:1788271799.327417:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590132352 00000100:00100000:0.0:1788271799.327429:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590131968 00000100:00100000:0.0:1788271799.327431:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590131968 00000100:00100000:0.0:1788271799.327441:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590132480 00000100:00100000:0.0:1788271799.327442:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590132480 00000100:00100000:0.0:1788271799.327454:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788271799.327461:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0c60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875138590131840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271799.327504:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0c60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875138590131840:12345-0@lo:400:kworker.0 Request processed in 43us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271799.327510:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788271799.327523:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788271799.327528:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875138590132352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271799.327555:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875138590132352:12345-0@lo:400:kworker.0 Request processed in 27us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271799.327560:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788271799.327579:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788271799.327583:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875138590131968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271799.327607:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875138590131968:12345-0@lo:400:kworker.0 Request processed in 25us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271799.327613:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788271799.327640:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788271799.327645:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875138590132480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271799.327682:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875138590132480:12345-0@lo:400:kworker.0 Request processed in 36us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271799.327688:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788271799.327715:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875138590131584:0@lo:400:kworker.0 00000100:00100000:0.0:1788271799.327739:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271799.327754:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83033480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590132096:0@lo:400:kworker.0 00000100:00100000:0.0:1788271799.327775:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271799.327790:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83031c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590132608:0@lo:400:kworker.0 00000100:00100000:0.0:1788271799.327809:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271799.327834:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788271799.327841:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590131200:0@lo:400:kworker.0 00000100:00100000:0.0:1788271799.327869:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271799.327884:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590131584 00000100:00100000:2.0:1788271799.327891:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590131584 00000100:00100000:0.0:1788271799.327897:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590131712:0@lo:400:kworker.0 00000100:00100000:2.0:1788271799.327928:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788271799.327928:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271799.327940:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1875138590131584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271799.327951:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83030380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590132224:0@lo:400:kworker.0 00000100:00100000:0.0:1788271799.327984:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271799.327991:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1875138590131584:12345-0@lo:400:kworker.0 Request processed in 52us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271799.327999:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788271799.328017:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875138590131584:0@lo:400:kworker.0 00000100:00100000:2.0:1788271799.328028:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590131456 00000100:00100000:2.0:1788271799.328033:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590131456 00000100:00100000:2.0:1788271799.328057:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590131712 00000100:00100000:0.0:1788271799.328059:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590132096 00000100:00100000:2.0:1788271799.328060:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590131712 00000100:00100000:0.0:1788271799.328065:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590132096 00000100:00100000:2.0:1788271799.328079:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788271799.328089:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590131456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271799.328099:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590132608 00000100:00100000:0.0:1788271799.328104:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590132608 00000100:00100000:0.0:1788271799.328128:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590132224 00000100:00100000:0.0:1788271799.328131:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590132224 00000100:00100000:0.0:1788271799.328146:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788271799.328155:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590131456:12345-0@lo:400:kworker.0 Request processed in 66us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271799.328155:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590132096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271799.328172:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788271799.328190:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788271799.328202:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590131712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271799.328202:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590132096:12345-0@lo:400:kworker.0 Request processed in 45us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271799.328215:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788271799.328229:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788271799.328236:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590132608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271799.328254:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590131712:12345-0@lo:400:kworker.0 Request processed in 56us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271799.328270:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590132608:12345-0@lo:400:kworker.0 Request processed in 33us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271799.328274:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788271799.328281:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788271799.328309:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590131456:0@lo:400:kworker.0 00010000:00080000:2.0:1788271799.328323:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83032680 x1875138590131968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271799.328332:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83032680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3608:1875138590131968:0@lo:400:kworker.0 00010000:00080000:2.0:1788271799.328343:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83030a80 x1875138590132480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271799.328350:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83030a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3608:1875138590132480:0@lo:400:kworker.0 00000100:00100000:2.0:1788271799.328363:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3608:1875138590131840:0@lo:400:kworker.0 00000100:00100000:0.0:1788271799.328370:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788271799.328378:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3608:1875138590132352:0@lo:400:kworker.0 00000100:00100000:0.0:1788271799.328380:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590132224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271799.328423:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590132224:12345-0@lo:400:kworker.0 Request processed in 47us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271799.328431:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788271799.328477:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83290700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590131712:0@lo:400:kworker.0 00000100:00100000:2.0:1788271799.328482:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590131200 00010000:00080000:0.0:1788271799.328490:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83030380 x1875138590132224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271799.328494:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590131200 00000100:00100000:0.0:1788271799.328504:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83030380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590132224:0@lo:400:kworker.0 00010000:00080000:0.0:1788271799.328519:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83033480 x1875138590132096/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271799.328528:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1788271799.328539:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3606:x1875138590131200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271799.328542:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83033480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590132096:0@lo:400:kworker.0 00000100:00100000:0.0:1788271799.328559:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83031c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590132608:0@lo:400:kworker.0 00000100:00100000:0.0:1788271799.328587:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590131200:0@lo:400:kworker.0 00000100:00100000:2.0:1788271799.328594:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3606:x1875138590131200:12345-0@lo:400:kworker.0 Request processed in 43us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271799.328603:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00080000:0.0:1788271799.328661:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788271799.328666:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788271799.328668:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788271799.328670:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271799.328768:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788271799.328777:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875138590131328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271799.328812:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875138590131328:12345-0@lo:400:kworker.0 Request processed in 38us (1799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271799.328818:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788271799.328886:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875138590131328:0@lo:400:kworker.0 00000100:00100000:1.0:1788271799.329268:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788271799.329278:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590132736:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788271799.329484:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271799.329773:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590132736 00000100:00100000:3.0:1788271799.329779:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590132736 00000100:00100000:3.0:1788271799.329852:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788271799.329861:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ec5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590132736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788271799.329877:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271799.330013:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ec5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590132736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 153us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271799.330019:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788271799.330080:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590132736:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788271799.711150:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271800.735716:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271801.759067:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271802.275492:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271802.275540:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271802.275760:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271802.275788:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271802.287736:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271802.287832:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577462528 00000100:00100000:2.0:1788271802.287846:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577462528 00000100:00100000:2.0:1788271802.287994:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577462784 00000100:00100000:2.0:1788271802.287999:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577462784 00000100:00100000:2.0:1788271802.288031:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577462656 00000100:00100000:2.0:1788271802.288035:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577462656 00000100:00100000:2.0:1788271802.288056:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 238 00000100:00100000:2.0:1788271802.288070:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ec5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577462528:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788271802.288202:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ec5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577462528:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 133us (12726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271802.288210:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 238 00000100:00100000:2.0:1788271802.288232:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 239 00000100:00100000:2.0:1788271802.288239:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83189f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:956fb91b-4885-4e88-90fb-3061936b51ca+5:2395:x1875138577462784:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788271802.288280:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83189f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:956fb91b-4885-4e88-90fb-3061936b51ca+5:2395:x1875138577462784:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 41us (12739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271802.288287:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 239 00000100:00100000:2.0:1788271802.288301:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 240 00000100:00100000:2.0:1788271802.288308:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8318a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577462656:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788271802.288349:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8318a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577462656:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 42us (12560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271802.288356:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 240 00000100:00080000:2.0:1788271802.288660:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788271802.288666:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788271802.293443:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577462400 00000100:00100000:0.0:1788271802.293463:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577462400 00000100:00100000:0.0:1788271802.293535:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 372 00000100:00100000:0.0:1788271802.293547:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2395:x1875138577462400:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788271802.293692:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2395:x1875138577462400:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 145us (17929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271802.293699:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 372 00000100:00100000:2.0:1788271802.299575:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577462912 00000100:00100000:2.0:1788271802.299596:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577462912 00000100:00100000:2.0:1788271802.300098:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 241 00000100:00100000:2.0:1788271802.300112:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83188700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:956fb91b-4885-4e88-90fb-3061936b51ca+5:2395:x1875138577462912:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788271802.300227:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83188700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:956fb91b-4885-4e88-90fb-3061936b51ca+5:2395:x1875138577462912:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 118us (12507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271802.300236:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 241 00000100:00080000:0.0:1788271802.304407:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788271802.796295:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271802.915702:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8318b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590132864:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788271802.915777:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271802.915837:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788271802.915844:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590132992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788271802.915869:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271802.915905:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590132864 00000100:00100000:1.0:1788271802.915913:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590132864 00000100:00100000:1.0:1788271802.915964:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590132992 00000100:00100000:1.0:1788271802.915968:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590132992 00000100:00100000:1.0:1788271802.915996:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788271802.916005:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfbaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590132864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788271802.916036:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788271802.916077:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfbaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590132864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271802.916083:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788271802.916101:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788271802.916107:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfba9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590132992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788271802.916116:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788271802.916140:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfba9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590132992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271802.916147:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:1.0:1788271802.916167:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788271802.916199:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6ebfba9880 x1875138590132992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271802.916216:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590132992:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788271802.916226:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d8318b800 x1875138590132864/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271802.916235:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8318b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590132864:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788271802.916394:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788271802.916416:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590133120:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788271802.916450:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271802.916479:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590133120 00000100:00100000:2.0:1788271802.916483:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590133120 00000100:00100000:2.0:1788271802.916511:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788271802.916517:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4fb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590133120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788271802.916542:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788271802.916579:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4fb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590133120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271802.916586:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788271802.916664:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590133120:0@lo:41:osp-pre-1-0.0 00000001:00100000:0.0:1788271802.939833:0:9475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ef8df183-a1b1-4e56-bce5-924a894c4a71 00000020:00000080:0.0:1788271802.939843:0:9475:0:(genops.c:885:class_export_put()) final put ffff8f6e812ae800/ef8df183-a1b1-4e56-bce5-924a894c4a71 00000020:00000080:1.0:1788271802.943101:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6e812ae800/ef8df183-a1b1-4e56-bce5-924a894c4a71 for lustre-OST0001 00000020:00000080:1.0:1788271802.943169:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f6e812a9800 for lustre-OST0001 00000040:00080000:1.0:1788271803.102332:0:13762:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788271803.167672:0:13766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788271803.806737:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271803.933789:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788271803.933814:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590133248:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788271803.933882:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271803.934166:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590133248 00000100:00100000:1.0:1788271803.934180:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590133248 00000100:00100000:1.0:1788271803.934231:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788271803.934240:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590133248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788271803.934272:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788271803.934323:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590133248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271803.934329:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788271803.934407:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfba9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590133248:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788271804.449929:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590133376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788271804.450049:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271804.450157:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590133376 00000100:00100000:1.0:1788271804.450167:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590133376 00000100:00100000:1.0:1788271804.450238:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788271804.450251:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfba9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590133376:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788271804.450252:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1788271804.450290:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788271804.450338:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfba9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590133376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271804.450346:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788271804.450387:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875138590133632:0@lo:400:kworker.0 00000100:00100000:3.0:1788271804.450428:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271804.450434:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590133504:0@lo:400:kworker.0 00000100:00100000:2.0:1788271804.450502:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271804.450528:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3609:1875138590134016:0@lo:400:kworker.0 00000100:00100000:2.0:1788271804.450559:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590133888:0@lo:400:kworker.0 00000100:00100000:3.0:1788271804.450586:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3606:1875138590134144:0@lo:400:kworker.0 00000100:00100000:2.0:1788271804.450600:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271804.450608:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271804.450647:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590134400:0@lo:400:kworker.0 00000100:00100000:2.0:1788271804.450674:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271804.450722:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590133376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788271804.450761:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590133888 00000100:00100000:2.0:1788271804.450766:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590133888 00000100:00100000:2.0:1788271804.450800:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788271804.450807:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590133888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271804.450852:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590133888:12345-0@lo:400:kworker.0 Request processed in 46us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271804.450859:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788271804.450882:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590134400 00000100:00100000:2.0:1788271804.450886:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590134400 00000100:00100000:2.0:1788271804.450925:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788271804.450932:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590134400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271804.450966:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590134400:12345-0@lo:400:kworker.0 Request processed in 34us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271804.450972:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788271804.451003:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590133888:0@lo:400:kworker.0 00010000:00080000:2.0:1788271804.451015:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d81f41500 x1875138590134400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271804.451040:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590134400:0@lo:400:kworker.0 00000100:00100000:2.0:1788271804.451081:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590133504 00000100:00100000:2.0:1788271804.451084:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590133504 00000100:00100000:2.0:1788271804.451111:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1788271804.451117:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3609:x1875138590133504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271804.451149:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3609:x1875138590133504:12345-0@lo:400:kworker.0 Request processed in 32us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271804.451156:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1788271804.451184:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875138590133760:0@lo:400:kworker.0 00000100:00080000:2.0:1788271804.451228:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788271804.451831:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3606:1875138590134656:0@lo:400:kworker.0 00000100:00100000:3.0:1788271804.451866:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271804.451945:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590133632 00000100:00100000:1.0:1788271804.451951:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590133632 00000100:00100000:1.0:1788271804.451994:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590134144 00000100:00100000:1.0:1788271804.451997:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590134144 00000100:00100000:1.0:1788271804.452022:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788271804.452029:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875138590133632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271804.452072:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875138590133632:12345-0@lo:400:kworker.0 Request processed in 44us (1644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271804.452079:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788271804.452093:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788271804.452109:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1875138590134144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271804.452138:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1875138590134144:12345-0@lo:400:kworker.0 Request processed in 30us (1528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271804.452163:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:1.0:1788271804.452583:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788271804.452799:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875138590133632:0@lo:400:kworker.0 00010000:00080000:3.0:1788271804.452816:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb3d2ea00 x1875138590134144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271804.452841:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3606:1875138590134144:0@lo:400:kworker.0 00000100:00100000:3.0:1788271804.452911:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271804.453863:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590134272:0@lo:400:kworker.0 00000100:00100000:3.0:1788271804.453924:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271804.453946:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590134784:0@lo:400:kworker.0 00000100:00100000:3.0:1788271804.453970:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271804.454011:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590134272 00000100:00100000:3.0:1788271804.454017:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590134272 00000100:00100000:3.0:1788271804.454068:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590134784 00000100:00100000:3.0:1788271804.454071:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590134784 00000100:00100000:3.0:1788271804.454096:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788271804.454104:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590134272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271804.454404:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590134272:12345-0@lo:400:kworker.0 Request processed in 299us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271804.454412:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788271804.454432:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788271804.454438:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590134784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271804.454478:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590134784:12345-0@lo:400:kworker.0 Request processed in 32us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271804.454485:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1788271804.454510:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788271804.454514:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788271804.454540:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb3d2c700 x1875138590134272/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271804.454554:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590134272:0@lo:400:kworker.0 00000100:00100000:3.0:1788271804.454592:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590134784:0@lo:400:kworker.0 00000100:00100000:3.0:1788271804.454649:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590134656 00000100:00100000:3.0:1788271804.454653:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590134656 00000100:00100000:3.0:1788271804.454687:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590133760 00000100:00100000:3.0:1788271804.454690:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590133760 00000100:00100000:3.0:1788271804.454709:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788271804.454715:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1875138590134656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271804.454757:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1875138590134656:12345-0@lo:400:kworker.0 Request processed in 42us (2891us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271804.454763:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788271804.454775:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788271804.454780:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875138590133760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271804.454813:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875138590133760:12345-0@lo:400:kworker.0 Request processed in 32us (1901us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271804.454820:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:3.0:1788271804.454842:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788271804.454862:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875138590133760:0@lo:400:kworker.0 00000100:00100000:3.0:1788271804.454881:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590134912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788271804.454913:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271804.454923:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271804.454947:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590134912 00000100:00100000:2.0:1788271804.454949:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3609:1875138590134528:0@lo:400:kworker.0 00000100:00100000:3.0:1788271804.454950:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590134912 00000100:00100000:3.0:1788271804.454976:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788271804.454977:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271804.454983:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590134912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788271804.455002:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788271804.455005:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590133504:0@lo:400:kworker.0 00000100:00100000:3.0:1788271804.455119:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590134912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 135us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271804.455134:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788271804.455441:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590134016 00000100:00100000:3.0:1788271804.455448:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590134016 00000100:00100000:3.0:1788271804.455540:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590134528 00000100:00100000:3.0:1788271804.455544:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590134528 00000100:00100000:3.0:1788271804.455585:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788271804.455592:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4fb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875138590134016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271804.455664:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4fb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875138590134016:12345-0@lo:400:kworker.0 Request processed in 73us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271804.455671:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788271804.455684:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788271804.455690:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875138590134528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271804.455742:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875138590134528:12345-0@lo:400:kworker.0 Request processed in 52us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271804.455749:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:3.0:1788271804.455768:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788271804.455801:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590134912:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788271804.456657:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3609:1875138590134016:0@lo:400:kworker.0 00000100:00100000:2.0:1788271804.456670:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3609:1875138590134528:0@lo:400:kworker.0 00010000:00080000:2.0:1788271804.456854:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d81f42680 x1875138590134656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271804.456868:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3606:1875138590134656:0@lo:400:kworker.0 00010000:00010000:1.0:1788271804.831018:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271805.853913:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271806.877948:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271807.402983:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271807.403042:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271807.403073:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271807.403095:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271807.403126:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271807.403162:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577463296 00000100:00100000:0.0:1788271807.403175:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577463296 00000100:00100000:0.0:1788271807.403251:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577463552 00000100:00100000:0.0:1788271807.403254:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577463552 00000100:00100000:0.0:1788271807.403269:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577463168 00000100:00100000:0.0:1788271807.403271:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577463168 00000100:00100000:0.0:1788271807.403285:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577463424 00000100:00100000:0.0:1788271807.403288:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577463424 00000100:00100000:0.0:1788271807.403306:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 248 00000100:00100000:0.0:1788271807.403318:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577463296:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788271807.403426:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577463296:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 111us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271807.403436:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 248 00000100:00100000:0.0:1788271807.403455:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 249 00000100:00100000:0.0:1788271807.403461:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:956fb91b-4885-4e88-90fb-3061936b51ca+5:2395:x1875138577463552:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788271807.403487:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:956fb91b-4885-4e88-90fb-3061936b51ca+5:2395:x1875138577463552:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 26us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271807.403493:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 249 00000100:00100000:0.0:1788271807.403504:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 250 00000100:00100000:0.0:1788271807.403535:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577463168:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788271807.403572:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577463168:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 61us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271807.403596:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 250 00000100:00100000:0.0:1788271807.403608:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 251 00000100:00100000:0.0:1788271807.403615:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:956fb91b-4885-4e88-90fb-3061936b51ca+5:2395:x1875138577463424:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788271807.403670:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:956fb91b-4885-4e88-90fb-3061936b51ca+5:2395:x1875138577463424:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 55us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271807.403676:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 251 00000100:00100000:3.0:1788271807.404010:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577463040 00000100:00100000:3.0:1788271807.404017:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577463040 00000100:00100000:3.0:1788271807.404066:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 374 00000100:00100000:3.0:1788271807.404074:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2395:x1875138577463040:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271807.404112:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2395:x1875138577463040:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 39us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271807.404119:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 374 00000100:00080000:3.0:1788271807.404155:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788271807.404169:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788271807.903886:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271808.031059:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8318b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590135040:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788271808.031149:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271808.031539:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590135040 00000100:00100000:1.0:1788271808.031549:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590135040 00000100:00100000:1.0:1788271808.031614:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788271808.031642:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590135040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788271808.031672:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788271808.031718:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83290700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590135040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271808.031725:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:0.0:1788271808.031864:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788271808.031897:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d8318b800 x1875138590135040/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271824 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271808.031918:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8318b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590135040:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788271808.032744:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788271808.032950:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590135168:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788271808.032997:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271808.033278:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590135168 00000100:00100000:2.0:1788271808.033289:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590135168 00000100:00100000:2.0:1788271808.033353:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788271808.033362:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590135168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788271808.033393:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788271808.033491:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590135168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271808.033510:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788271808.035594:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788271808.035616:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfb58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590135296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788271808.035707:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271808.036206:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590135296 00000100:00100000:3.0:1788271808.036214:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590135296 00000100:00100000:3.0:1788271808.036277:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788271808.036286:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4fb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590135296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788271808.036308:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271808.036354:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4fb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590135296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271808.036360:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:2.0:1788271808.037709:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788271808.037771:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6ebfb58700 x1875138590135296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271824 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271808.037797:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfb58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590135296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788271808.040206:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590135168:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1788271808.501829:0:14026:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 10:10:06 (1788271806) 00010000:00010000:1.0:1788271808.926345:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271809.053904:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788271809.053943:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8318b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590135424:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788271809.054017:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271809.054249:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590135424 00000100:00100000:2.0:1788271809.054257:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590135424 00000100:00100000:2.0:1788271809.054311:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788271809.054321:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590135424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788271809.054355:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788271809.054469:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590135424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 149us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271809.054477:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788271809.059389:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8318b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590135424:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788271809.565935:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfb58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590135552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788271809.566020:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271809.566134:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590135552 00000100:00100000:3.0:1788271809.566142:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590135552 00000100:00100000:3.0:1788271809.566201:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788271809.566211:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8318b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590135552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788271809.566237:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271809.566275:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8318b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590135552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271809.566281:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:1.0:1788271809.566405:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788271809.566437:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfb58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590135552:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788271809.566651:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3f65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590136064:0@lo:400:kworker.0 00000100:00100000:0.0:1788271809.566686:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271809.566707:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590136576:0@lo:400:kworker.0 00000100:00100000:0.0:1788271809.566728:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271809.566751:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590137088:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788271809.566752:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590136576 00000100:00100000:2.0:1788271809.566759:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590136576 00000100:00100000:0.0:1788271809.566794:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271809.566802:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788271809.566812:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788271809.566813:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83275500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590136576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271809.566820:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3f65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875138590135936:0@lo:400:kworker.0 00000100:00100000:0.0:1788271809.566844:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271809.566862:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb0ccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590136448:0@lo:400:kworker.0 00000100:00100000:2.0:1788271809.566875:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83275500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590136576:12345-0@lo:400:kworker.0 Request processed in 63us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271809.566889:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271809.566895:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788271809.566909:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590136960:0@lo:400:kworker.0 00000100:00100000:2.0:1788271809.566913:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590136448 00000100:00100000:2.0:1788271809.566918:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590136448 00000100:00100000:0.0:1788271809.566931:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271809.566983:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590135680:0@lo:400:kworker.0 00000100:00100000:3.0:1788271809.567011:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271809.567032:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3f67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3606:1875138590136192:0@lo:400:kworker.0 00000100:00100000:3.0:1788271809.567049:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271809.567062:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ecca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3606:1875138590136704:0@lo:400:kworker.0 00000100:00100000:3.0:1788271809.567076:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271809.567089:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788271809.567093:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875138590135808:0@lo:400:kworker.0 00000100:00100000:3.0:1788271809.567108:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271809.567127:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3606:1875138590136320:0@lo:400:kworker.0 00000100:00100000:3.0:1788271809.567142:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271809.567156:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82eced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3606:1875138590136832:0@lo:400:kworker.0 00000100:00100000:3.0:1788271809.567172:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271809.567190:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590137088 00000100:00100000:3.0:1788271809.567193:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590137088 00000100:00100000:3.0:1788271809.567217:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788271809.567223:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83275f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590137088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788271809.567233:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271809.567256:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83275f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590137088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271809.567262:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788271809.567279:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590135680 00000100:00100000:3.0:1788271809.567282:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590135680 00000100:00100000:3.0:1788271809.567312:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1788271809.567318:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3606:x1875138590135680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271809.567345:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3606:x1875138590135680:12345-0@lo:400:kworker.0 Request processed in 27us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271809.567350:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1788271809.567383:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590135680:0@lo:400:kworker.0 00000100:00100000:3.0:1788271809.567414:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590136064 00000100:00100000:3.0:1788271809.567416:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590136064 00000100:00100000:3.0:1788271809.567436:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788271809.567441:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83277100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590136064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271809.567468:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83277100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590136064:12345-0@lo:400:kworker.0 Request processed in 26us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271809.567494:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:1.0:1788271809.567548:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788271809.567567:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590135936 00000100:00100000:1.0:1788271809.567574:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590135936 00000100:00100000:1.0:1788271809.567596:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590136192 00000100:00100000:1.0:1788271809.567598:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590136192 00000100:00100000:1.0:1788271809.567613:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590136704 00000100:00100000:1.0:1788271809.567615:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590136704 00000100:00100000:1.0:1788271809.567644:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590135808 00000100:00100000:1.0:1788271809.567646:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590135808 00000100:00100000:1.0:1788271809.567654:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590136320 00000100:00100000:1.0:1788271809.567655:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590136320 00000100:00100000:1.0:1788271809.567664:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590136832 00000100:00100000:1.0:1788271809.567666:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590136832 00000100:00100000:1.0:1788271809.567676:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788271809.567681:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83276680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875138590135936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271809.567708:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83276680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875138590135936:12345-0@lo:400:kworker.0 Request processed in 27us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271809.567713:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788271809.567724:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788271809.567729:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1875138590136192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271809.567752:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1875138590136192:12345-0@lo:400:kworker.0 Request processed in 22us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271809.567757:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788271809.567766:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788271809.567771:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3606:x1875138590136704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271809.567789:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3606:x1875138590136704:12345-0@lo:400:kworker.0 Request processed in 19us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271809.567795:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788271809.567802:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788271809.567807:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875138590135808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271809.567834:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875138590135808:12345-0@lo:400:kworker.0 Request processed in 27us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271809.567839:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788271809.567848:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788271809.567853:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1875138590136320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271809.567870:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1875138590136320:12345-0@lo:400:kworker.0 Request processed in 18us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271809.567875:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788271809.567883:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788271809.567888:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1875138590136832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271809.567905:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1875138590136832:12345-0@lo:400:kworker.0 Request processed in 18us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271809.567923:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788271809.574001:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590136960 00000100:00100000:2.0:1788271809.574019:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590136960 00000100:00100000:2.0:1788271809.574094:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788271809.574106:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83277b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590136448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271809.574213:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83277b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590136448:12345-0@lo:400:kworker.0 Request processed in 109us (7325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271809.574221:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788271809.574239:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788271809.574246:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590136960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271809.574278:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590136960:12345-0@lo:400:kworker.0 Request processed in 32us (7346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271809.574284:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:2.0:1788271809.574368:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788271809.574374:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788271809.574420:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875138590135808:0@lo:400:kworker.0 00010000:00080000:2.0:1788271809.574439:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83156d80 x1875138590136320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271809.574449:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83156d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3606:1875138590136320:0@lo:400:kworker.0 00010000:00080000:2.0:1788271809.574462:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82eced80 x1875138590136832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271809.574470:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82eced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3606:1875138590136832:0@lo:400:kworker.0 00000100:00100000:2.0:1788271809.574493:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3f67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3606:1875138590136192:0@lo:400:kworker.0 00000100:00100000:2.0:1788271809.574526:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ecca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3606:1875138590136704:0@lo:400:kworker.0 00000100:00100000:0.0:1788271809.577346:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ece680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590136960:0@lo:400:kworker.0 00000100:00100000:0.0:1788271809.577372:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590137088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788271809.577384:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3f65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590136064:0@lo:400:kworker.0 00010000:00080000:0.0:1788271809.577412:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82ecea00 x1875138590136576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271809.577423:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590136576:0@lo:400:kworker.0 00000100:00100000:0.0:1788271809.577468:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3f65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875138590135936:0@lo:400:kworker.0 00010000:00080000:0.0:1788271809.577493:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6eb0ccd880 x1875138590136448/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271809.577502:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb0ccd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590136448:0@lo:400:kworker.0 00010000:00010000:2.0:1788271809.951319:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271810.036715:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271810.043890:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577463680 00000100:00100000:1.0:1788271810.043909:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577463680 00000100:00100000:1.0:1788271810.044097:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 40 00000100:00100000:1.0:1788271810.044112:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:11071:x1875138577463680:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788271810.044133:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271810.045478:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38ea0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd3f7 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271810.045561:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38ea12 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271810.045575:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38ea12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271810.045609:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38ea12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271810.045679:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788271810.045684:0:6485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788271810.045726:0:6485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38ea12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271810.045756:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38ea0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3f7 expref: 7 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271810.045779:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38ea12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3f7 expref: 6 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271810.045788:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6e87187b00) 00010000:00010000:1.0:1788271810.045792:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788271810.045795:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4ed4c00, rc 0) 00000100:00100000:1.0:1788271810.045885:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:11071:x1875138577463680:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 1777us (9321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271810.045893:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 40 00000100:00080000:2.0:1788271810.061260:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788271810.061498:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271810.061643:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577463808 00000100:00100000:2.0:1788271810.061656:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577463808 00000100:00100000:2.0:1788271810.061746:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 41 00000100:00100000:2.0:1788271810.061759:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:11072:x1875138577463808:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788271810.061787:0:12164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271810.061815:0:12164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38ea19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd3fe expref: -99 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.061917:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ea20 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.062084:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ea20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.062099:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ea20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.062119:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ea27 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.062127:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ea27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.062133:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ea27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.062213:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1a00/0x99288105fd38ea2e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.062244:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1a00/0x99288105fd38ea2e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.062251:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1a00/0x99288105fd38ea2e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271810.062304:0:12164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788271810.062308:0:12164:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788271810.062336:0:12164:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1a00/0x99288105fd38ea2e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.062348:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ea20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.062356:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ea20 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.062363:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ea20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.062370:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e813a0e00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271810.062374:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ea20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.062382:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ea20 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.062397:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6e87187b00) 00010000:00010000:2.0:1788271810.062400:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271810.062407:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ea20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.062423:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ea20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.062443:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ea27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.062449:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ea27 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.062455:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ea27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.062460:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e813a0a00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271810.062463:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ea27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.062481:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ea27 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.062489:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8f6e90141600) 00010000:00010000:2.0:1788271810.062493:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271810.062496:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ea27 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.062502:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ea27 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.062540:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38ea19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3fe expref: 8 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.062569:0:12164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1a00/0x99288105fd38ea2e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3fe expref: 7 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.062578:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f6e90141400) 00010000:00010000:2.0:1788271810.062581:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788271810.062583:0:12164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e813a1a00, rc 0) 00000100:00100000:2.0:1788271810.062710:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:11072:x1875138577463808:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 952us (1242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271810.063917:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 41 00000100:00100000:3.0:1788271810.075670:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271810.075852:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577463936 00000100:00100000:0.0:1788271810.075869:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577463936 00000100:00100000:0.0:1788271810.076145:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:0.0:1788271810.076156:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:11072:x1875138577463936:12345-192.168.201.3@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788271810.076275:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:11072:x1875138577463936:12345-192.168.201.3@tcp:900:lhsmtool_posix.0 Request processed in 120us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271810.076284:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:1.0:1788271810.082597:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271810.082739:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577464192 00000100:00100000:2.0:1788271810.082756:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577464192 00000100:00100000:2.0:1788271810.082841:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 42 00000100:00100000:2.0:1788271810.082863:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:11072:x1875138577464192:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788271810.082891:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271810.082918:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38ea35 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd405 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.083028:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ea3c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.083048:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ea3c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.083062:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ea3c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.083080:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ea43 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.083106:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ea43 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.083114:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ea43 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.083275:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0200/0x99288105fd38ea4a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.083284:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0200/0x99288105fd38ea4a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.083292:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0200/0x99288105fd38ea4a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271810.083303:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788271810.083422:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ea3c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.083431:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ea3c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.083439:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ea3c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.083446:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e813a0a00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271810.083457:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ea3c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.083474:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ea3c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.083751:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f6e90141400) 00010000:00010000:2.0:1788271810.083754:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271810.083761:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ea3c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.083768:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ea3c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.083786:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ea43 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.083793:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ea43 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.083799:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ea43 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.083805:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e813a0e00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271810.083808:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ea43 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.083815:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ea43 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.083823:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8f6e90141600) 00010000:00010000:2.0:1788271810.083825:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271810.083828:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ea43 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.083833:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ea43 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.084360:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38ea35 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd405 expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.084381:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0200/0x99288105fd38ea4a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd405 expref: 9 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271810.084390:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f6e90141900) 00010000:00010000:2.0:1788271810.084392:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271810.084395:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e813a0200, rc 0) 00000100:00100000:2.0:1788271810.084727:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+9:11072:x1875138577464192:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 1866us (2137us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788271810.084737:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 42 00000100:00100000:1.0:1788271810.097880:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271810.097967:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577464320 00000100:00100000:0.0:1788271810.097980:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577464320 00000100:00100000:0.0:1788271810.098063:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 43 00000100:00100000:0.0:1788271810.098077:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8336a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+9:11072:x1875138577464320:12345-192.168.201.3@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788271810.098246:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8336a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+9:11072:x1875138577464320:12345-192.168.201.3@tcp:59:lhsmtool_posix.0 Request processed in 171us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271810.098255:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 43 00000100:00100000:3.0:1788271810.101820:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271810.102135:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577464448 00000100:00100000:2.0:1788271810.102310:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577464448 00000100:00100000:2.0:1788271810.103967:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 44 00000100:00100000:2.0:1788271810.104008:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:11072:x1875138577464448:12345-192.168.201.3@tcp:59:lhsmtool_posix.0 00000100:00080000:1.0:1788271810.111393:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1788271810.114667:0:12164:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 10592us 00000100:00100000:0.0:1788271810.129870:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:11072:x1875138577464448:12345-192.168.201.3@tcp:59:lhsmtool_posix.0 Request processed in 25862us (28048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271810.129890:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 44 00000040:00080000:1.0:1788271810.273142:0:13762:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788271810.334754:0:13766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788271810.974097:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271811.997741:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271812.500755:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271812.500988:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577464576 00000100:00100000:0.0:1788271812.500998:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577464576 00000100:00100000:0.0:1788271812.501070:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 45 00000100:00100000:0.0:1788271812.501081:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4eca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+9:11115:x1875138577464576:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:0.0:1788271812.501100:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271812.501120:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079800/0x99288105fd38ea58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd40c expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.501192:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38ea5f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.501209:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38ea5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.501220:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38ea5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.501234:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38ea66 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.501240:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38ea66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.501246:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38ea66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.501288:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38ea5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.501294:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38ea5f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.501300:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38ea5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.501305:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4079a00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271812.501309:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38ea5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.501316:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38ea5f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.501327:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6e87187b00) 00010000:00010000:0.0:1788271812.501335:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271812.501340:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38ea5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.501346:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38ea5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.501357:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38ea66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.501362:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38ea66 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.501367:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38ea66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.501371:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4078400 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271812.501374:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38ea66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.501379:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38ea66 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.501385:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8f6d83058f00) 00010000:00010000:0.0:1788271812.501387:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271812.501390:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38ea66 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.501394:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38ea66 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.501420:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079800/0x99288105fd38ea58 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd40c expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.501453:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6e87187b00) 00010000:00010000:0.0:1788271812.501455:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271812.501459:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079800/0x99288105fd38ea58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd40c expref: 10 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.501468:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4079800, rc 0) 00000100:00100000:0.0:1788271812.501523:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4eca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+9:11115:x1875138577464576:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 444us (778us total) trans 0 rc 301/301 00000100:00100000:0.0:1788271812.501530:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 45 00000100:00080000:1.0:1788271812.501717:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271812.506175:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271812.506243:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271812.506267:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271812.506293:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271812.506324:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577464704 00000100:00100000:1.0:1788271812.506336:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577464704 00000100:00100000:1.0:1788271812.506390:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 376 00000100:00100000:1.0:1788271812.506401:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2396:x1875138577464704:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271812.506477:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2396:x1875138577464704:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 78us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271812.506485:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 376 00000100:00100000:1.0:1788271812.506517:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577464832 00000100:00100000:1.0:1788271812.506521:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577464832 00000100:00100000:1.0:1788271812.506553:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577465088 00000100:00100000:1.0:1788271812.506556:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577465088 00000100:00100000:1.0:1788271812.506571:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577464960 00000100:00100000:1.0:1788271812.506573:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577464960 00000100:00100000:1.0:1788271812.506588:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 258 00000100:00100000:1.0:1788271812.506593:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d833d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577464832:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271812.506648:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d833d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577464832:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 53us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271812.506654:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 258 00000100:00100000:1.0:1788271812.506667:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 259 00000100:00100000:1.0:1788271812.506673:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d833d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:956fb91b-4885-4e88-90fb-3061936b51ca+5:2395:x1875138577465088:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271812.506693:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d833d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:956fb91b-4885-4e88-90fb-3061936b51ca+5:2395:x1875138577465088:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 21us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271812.506698:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 259 00000100:00100000:1.0:1788271812.506717:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 260 00000100:00100000:1.0:1788271812.506723:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e85808e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:956fb91b-4885-4e88-90fb-3061936b51ca+5:2396:x1875138577464960:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271812.506746:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e85808e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:956fb91b-4885-4e88-90fb-3061936b51ca+5:2396:x1875138577464960:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 24us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271812.506751:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 260 00000100:00080000:1.0:1788271812.506777:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788271812.506780:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788271812.516353:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271812.516497:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577465344 00000100:00100000:0.0:1788271812.516509:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577465344 00000100:00100000:0.0:1788271812.516661:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 46 00000100:00100000:0.0:1788271812.516673:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+9:11115:x1875138577465344:12345-192.168.201.3@tcp:36:lfs.0 00010000:00010000:0.0:1788271812.516732:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271812.516759:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38ea12 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3f7 expref: 9 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.516778:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6e87187b00) 00010000:00010000:0.0:1788271812.516790:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788271812.516921:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078c00/0x99288105fd38ea6d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.516936:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078c00/0x99288105fd38ea6d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.516946:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078c00/0x99288105fd38ea6d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.516972:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078200/0x99288105fd38ea74 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.516979:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078200/0x99288105fd38ea74 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.516986:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078200/0x99288105fd38ea74 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.518193:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078800/0x99288105fd38ea7b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.518209:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078800/0x99288105fd38ea7b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.518218:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078800/0x99288105fd38ea7b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788271812.518233:0:6485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cb80b701 reply state 000000000549be11 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078800/0x99288105fd38ea7b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.518243:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078800/0x99288105fd38ea7b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.518250:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f6d83058800) 00010000:00010000:0.0:1788271812.518266:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788271812.518270:0:6485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788271812.518275:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788271812.518282:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078c00/0x99288105fd38ea6d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.518288:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078c00/0x99288105fd38ea6d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.518303:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078c00/0x99288105fd38ea6d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.518308:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4078c00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271812.518313:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078c00/0x99288105fd38ea6d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.518321:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078c00/0x99288105fd38ea6d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.518330:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6d83058400) 00010000:00010000:0.0:1788271812.518333:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271812.518336:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078c00/0x99288105fd38ea6d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.518342:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078c00/0x99288105fd38ea6d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788271812.518357:0:6485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cb80b701 reply state 000000000549be11 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078200/0x99288105fd38ea74 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.518365:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078200/0x99288105fd38ea74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.518371:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8f6d83058d00) 00010000:00010000:0.0:1788271812.518373:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788271812.518375:0:6485:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788271812.518503:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+10:11115:x1875138577465344:12345-192.168.201.3@tcp:36:lfs.0 Request processed in 1830us (2159us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788271812.518514:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 46 00000100:00100000:1.0:1788271812.623907:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271812.624102:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577465472 00000100:00100000:0.0:1788271812.624113:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577465472 00000100:00100000:0.0:1788271812.624194:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 47 00000100:00100000:0.0:1788271812.624206:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e85808a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+10:11123:x1875138577465472:12345-192.168.201.3@tcp:101:lctl.0 00010000:00010000:0.0:1788271812.624232:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271812.624258:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078c00/0x99288105fd38ea82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd413 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.624324:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079800/0x99288105fd38ea89 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.624338:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079800/0x99288105fd38ea89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.624347:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079800/0x99288105fd38ea89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271812.624389:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788271812.624392:0:6484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788271812.624447:0:6484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079800/0x99288105fd38ea89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.624474:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078c00/0x99288105fd38ea82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd413 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.624495:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079800/0x99288105fd38ea89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd413 expref: 11 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.624504:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6d83058400) 00010000:00010000:0.0:1788271812.624507:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788271812.624525:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4079800, rc 0) 00000100:00100000:0.0:1788271812.624784:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e85808a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+11:11123:x1875138577465472:12345-192.168.201.3@tcp:101:lctl.0 Request processed in 580us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271812.624792:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 47 00000100:00100000:3.0:1788271812.690442:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271812.690581:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577465600 00000100:00100000:0.0:1788271812.690596:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577465600 00000100:00100000:0.0:1788271812.690735:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 48 00000100:00100000:0.0:1788271812.690745:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+11:11129:x1875138577465600:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:0.0:1788271812.690768:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271812.690789:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078c00/0x99288105fd38ea90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd41a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.690915:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38ea97 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.690930:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38ea97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.690940:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38ea97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.690951:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38ea9e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.690958:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38ea9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.690965:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38ea9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.691039:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079e00/0x99288105fd38eaa5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.691061:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079e00/0x99288105fd38eaa5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.691068:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079e00/0x99288105fd38eaa5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271812.691110:0:6483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788271812.691114:0:6483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788271812.691254:0:6483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079e00/0x99288105fd38eaa5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.691266:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38ea97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.691273:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38ea97 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.691279:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38ea97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.691285:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4078400 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271812.691289:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38ea97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.691296:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38ea97 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.691309:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6d83058400) 00010000:00010000:0.0:1788271812.691312:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271812.691316:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38ea97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.691333:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38ea97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.691348:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38ea9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.691353:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38ea9e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.691358:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38ea9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.691363:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4079a00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271812.691366:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38ea9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.691371:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38ea9e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.691379:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8f6d83058d00) 00010000:00010000:0.0:1788271812.691382:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271812.691384:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38ea9e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.691391:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38ea9e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.691416:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078c00/0x99288105fd38ea90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd41a expref: 13 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.691439:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079e00/0x99288105fd38eaa5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd41a expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.691453:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f6d83058800) 00010000:00010000:0.0:1788271812.691455:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788271812.691458:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4079e00, rc 0) 00000100:00100000:0.0:1788271812.691515:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+12:11129:x1875138577465600:12345-192.168.201.3@tcp:101:bash.0 Request processed in 772us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271812.691523:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 48 00000100:00100000:0.0:1788271812.697312:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271812.697407:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577465856 00000100:00100000:1.0:1788271812.697415:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577465856 00000100:00100000:1.0:1788271812.697494:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 49 00000100:00100000:1.0:1788271812.697505:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+12:11129:x1875138577465856:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:1.0:1788271812.697526:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271812.697547:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38eaac lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd421 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271812.697716:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38eab3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271812.697731:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38eab3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271812.697741:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38eab3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271812.697756:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38eaba lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271812.697763:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38eaba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271812.697783:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38eaba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788271812.698112:0:6485:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:1.0:1788271812.699046:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5400/0x99288105fd38eac1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271812.699060:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5400/0x99288105fd38eac1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271812.699069:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5400/0x99288105fd38eac1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271812.699104:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38eab3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271812.699111:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38eab3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271812.699125:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38eab3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271812.699132:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4ed5e00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271812.699136:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38eab3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271812.699144:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38eab3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271812.699158:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f6d83058800) 00010000:00010000:1.0:1788271812.699161:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271812.699177:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38eab3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271812.699183:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38eab3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788271812.699198:0:6485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fe423966 reply state 00000000cd3a87db transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38eaba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271812.699208:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38eaba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271812.699214:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f6d82060600) 00010000:00010000:1.0:1788271812.699216:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788271812.699219:0:6485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788271812.699252:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38eaac lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd421 expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271812.699266:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5400/0x99288105fd38eac1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd421 expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271812.699273:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060800) 00010000:00010000:1.0:1788271812.699275:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788271812.699277:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4ed5400, rc 0) 00000100:00100000:1.0:1788271812.699477:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+15:11129:x1875138577465856:12345-192.168.201.3@tcp:101:bash.0 Request processed in 1971us (2172us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788271812.699485:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 49 00000100:00100000:1.0:1788271812.713452:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271812.713584:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577465984 00000100:00100000:2.0:1788271812.713595:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577465984 00000100:00100000:2.0:1788271812.713785:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 28 00000100:00100000:2.0:1788271812.713794:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e8580ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2394:x1875138577465984:12345-192.168.201.3@tcp:8:bash.0 00010000:00080000:2.0:1788271812.714426:0:8397:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from ef8df183-a1b1-4e56-bce5-924a894c4a71@192.168.201.3@tcp t0 exp 0000000000000000 cur 373 last 0 00000020:00000080:2.0:1788271812.714472:0:8397:0:(genops.c:1385:class_connect()) connect: client ef8df183-a1b1-4e56-bce5-924a894c4a71, cookie 0x99288105fd38eacf 00002000:00100000:2.0:1788271812.714485:0:8397:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ef8df183-a1b1-4e56-bce5-924a894c4a71/ffff8f6d83922000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788271812.714519:0:8397:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788271812.714604:0:8397:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788271812.714660:0:8397:0:(import.c:65:import_set_state_nolock()) ffff8f6d83920000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788271812.714786:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e8580ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2394:x1875138577465984:12345-192.168.201.3@tcp:8:bash.0 Request processed in 991us (1344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271812.714795:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 28 00000100:00100000:2.0:1788271812.718888:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271812.719002:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577466112 00000100:00100000:3.0:1788271812.719015:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577466112 00000100:00100000:3.0:1788271812.719107:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 29 00000100:00100000:3.0:1788271812.719121:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:0:x1875138577466112:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:3.0:1788271812.719148:0:8396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271812.719179:0:8396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ca0a625/0x99288105fd38ead6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd428 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788271812.719216:0:8396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788271812.719243:0:8396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=373s v=(0 0) 00010000:00010000:3.0:1788271812.719250:0:8396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271812.719263:0:8396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ca0a625/0x99288105fd38ead6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd428 expref: 7 pid: 8396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271812.719289:0:8396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001ca0a625/0x99288105fd38ead6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd428 expref: 7 pid: 8396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271812.719308:0:8396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c5600, rc 0) 00000100:00100000:3.0:1788271812.719393:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:0:x1875138577466112:12345-192.168.201.3@tcp:101:bash.0 Request processed in 274us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271812.719401:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 29 00000100:00080000:1.0:1788271812.720266:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788271812.723062:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271812.724054:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577466240 00000100:00100000:1.0:1788271812.724086:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577466240 00000100:00100000:1.0:1788271812.724175:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 30 00000100:00100000:1.0:1788271812.724188:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:11129:x1875138577466240:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:1.0:1788271812.724209:0:8398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271812.724234:0:8398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021470cef/0x99288105fd38eadd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd42f expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271812.724271:0:8398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001ca0a625/0x99288105fd38ead6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd428 expref: 8 pid: 8396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271812.724279:0:8398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271812.724284:0:8398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271812.724289:0:8398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021470cef/0x99288105fd38eadd lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd42f expref: 8 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271812.724325:0:8398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001ca0a625/0x99288105fd38ead6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd428 expref: 8 pid: 8396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271812.724341:0:8398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001ca0a625/0x99288105fd38ead6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd428 expref: 8 pid: 8396 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271812.724354:0:8398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e85809180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8398:1875138590137216:192.168.201.3@tcp:104: 00000100:00100000:1.0:1788271812.724473:0:8398:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8387c900 going to sleep for 11 seconds 00000100:00100000:2.0:1788271812.728503:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271812.728610:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577466368 00000100:00100000:1.0:1788271812.728681:0:8398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e85809180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8398:1875138590137216:192.168.201.3@tcp:104: 00010000:00010000:1.0:1788271812.728720:0:8398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000021470cef/0x99288105fd38eadd lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd42f expref: 8 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271812.728731:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577466368 00010000:00010000:1.0:1788271812.728766:0:8398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4ed4a00, rc 0) 00010000:00010000:0.0:1788271812.728800:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001ca0a625/0x99288105fd38ead6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd428 expref: 9 pid: 8396 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271812.728918:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 52 00000100:00100000:0.0:1788271812.728939:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+9:2398:x1875138577466368:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271812.728959:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271812.728990:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001ca0a625/0x99288105fd38ead6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd428 expref: 9 pid: 8396 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.729007:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001ca0a625/0x99288105fd38ead6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd428 expref: 9 pid: 8396 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.729042:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ca0a625/0x99288105fd38ead6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd428 expref: 9 pid: 8396 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.729089:0:6468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271812.729094:0:6468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271812.729106:0:6468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000021470cef/0x99288105fd38eadd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd42f expref: 8 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.729118:0:6468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021470cef/0x99288105fd38eadd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd42f expref: 8 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.729163:0:6468:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000021470cef/0x99288105fd38eadd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd42f expref: 8 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271812.729194:0:6468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6468:1875138590137344:192.168.201.3@tcp:105: 00000100:00100000:0.0:1788271812.730556:0:6468:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830a6780 going to sleep for 11 seconds 00000100:00100000:1.0:1788271812.730912:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+8:11129:x1875138577466240:12345-192.168.201.3@tcp:101:bash.0 Request processed in 6716us (7853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271812.730924:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 30 00000100:00100000:0.0:1788271812.742393:0:6468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6468:1875138590137344:192.168.201.3@tcp:105: 00010000:00010000:0.0:1788271812.742437:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271812.742569:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2398:x1875138577466368:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 13640us (14075us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271812.742581:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 52 00000100:00100000:2.0:1788271812.748036:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271812.748157:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577466624 00000100:00100000:0.0:1788271812.748167:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577466624 00000100:00100000:0.0:1788271812.748472:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 6 00000100:00100000:0.0:1788271812.748484:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+15:11129:x1875138577466624:12345-192.168.201.3@tcp:35:bash.0 00000100:00100000:0.0:1788271812.748815:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+16:11129:x1875138577466624:12345-192.168.201.3@tcp:35:bash.0 Request processed in 333us (788us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788271812.749177:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 6 00000100:00100000:2.0:1788271812.820134:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271812.820239:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577466880 00000100:00100000:1.0:1788271812.820252:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577466880 00000100:00100000:1.0:1788271812.820328:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 50 00000100:00100000:1.0:1788271812.820337:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+16:11139:x1875138577466880:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:1.0:1788271812.820368:0:9899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271812.820391:0:9899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38eae4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd436 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271812.820821:0:9899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788271812.820941:0:9899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38eae4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd436 expref: 18 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271812.820960:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6d83058400) 00010000:00010000:1.0:1788271812.820963:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788271812.820969:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38eae4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd436 expref: 18 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271812.820986:0:9899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4ed5e00, rc 0) 00000100:00100000:1.0:1788271812.821121:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+17:11139:x1875138577466880:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 783us (997us total) trans 4294967315 rc 301/301 00000100:00100000:1.0:1788271812.821130:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 50 00000100:00100000:2.0:1788271812.823084:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271812.823162:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577467136 00000100:00100000:3.0:1788271812.823173:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577467136 00000100:00100000:3.0:1788271812.823246:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:3.0:1788271812.823256:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+17:11139:x1875138577467136:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:3.0:1788271812.823502:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+18:11139:x1875138577467136:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 247us (429us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788271812.823508:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:2.0:1788271812.894292:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271812.894445:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577467264 00000100:00100000:1.0:1788271812.894459:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577467264 00000100:00100000:1.0:1788271812.894536:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 51 00000100:00100000:1.0:1788271812.894548:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+18:11145:x1875138577467264:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:1.0:1788271812.894580:0:12164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271812.894607:0:12164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38eaf2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd43d expref: -99 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271812.894839:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38eaf9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271812.894858:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38eaf9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271812.894871:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38eaf9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271812.894923:0:12164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788271812.894927:0:12164:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788271812.894951:0:12164:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38eaf9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271812.894985:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38eaf2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd43d expref: 20 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271812.895007:0:12164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38eaf9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd43d expref: 19 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271812.895017:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f6d83058800) 00010000:00010000:1.0:1788271812.895021:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788271812.895043:0:12164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e92d32600, rc 0) 00000100:00100000:1.0:1788271812.895164:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+19:11145:x1875138577467264:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 617us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271812.895173:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 51 00000100:00100000:2.0:1788271812.903980:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271812.904137:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577467520 00000100:00100000:0.0:1788271812.904151:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577467520 00000100:00100000:0.0:1788271812.904231:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 52 00000100:00100000:0.0:1788271812.904345:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+19:11145:x1875138577467520:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:0.0:1788271812.904376:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271812.904404:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38eb00 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd444 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.904594:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079400/0x99288105fd38eb07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.904610:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079400/0x99288105fd38eb07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.905071:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079400/0x99288105fd38eb07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271812.905087:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788271812.905232:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38eb00 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd444 expref: 22 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.906038:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079400/0x99288105fd38eb07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd444 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.906052:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060800) 00010000:00010000:0.0:1788271812.906056:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788271812.906060:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4079400, rc 0) 00000100:00100000:0.0:1788271812.906169:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+21:11145:x1875138577467520:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 1926us (2205us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788271812.906179:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 52 00000100:00100000:1.0:1788271812.913500:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271812.913603:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271812.913764:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577467904 00000100:00100000:3.0:1788271812.913777:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577467904 00000100:00100000:3.0:1788271812.913866:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 3 00000100:00100000:3.0:1788271812.913879:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e85809500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+21:2397:x1875138577467904:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788271812.913900:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271812.913945:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079400/0x99288105fd38eb07 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd444 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271812.913967:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060800) 00010000:00010000:3.0:1788271812.913972:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271812.914039:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e85809500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+20:2397:x1875138577467904:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 162us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271812.914047:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 3 00000100:00100000:0.0:1788271812.916055:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577467776 00000100:00100000:0.0:1788271812.916071:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577467776 00000100:00100000:0.0:1788271812.916204:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 53 00000100:00100000:0.0:1788271812.916217:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e85809180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+20:11145:x1875138577467776:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:0.0:1788271812.916248:0:9899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271812.916274:0:9899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078a00/0x99288105fd38eb15 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd44b expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.916436:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079000/0x99288105fd38eb1c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.916456:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079000/0x99288105fd38eb1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.916470:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079000/0x99288105fd38eb1c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271812.916486:0:9899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788271812.916659:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078a00/0x99288105fd38eb15 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd44b expref: 23 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.916781:0:9899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079000/0x99288105fd38eb1c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd44b expref: 22 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.916791:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060800) 00010000:00010000:0.0:1788271812.916795:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788271812.916820:0:9899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4079000, rc 0) 00000100:00100000:0.0:1788271812.917215:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e85809180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+22:11145:x1875138577467776:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 999us (3729us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788271812.917224:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 53 00000100:00100000:1.0:1788271812.923427:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271812.923541:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577468032 00000100:00100000:2.0:1788271812.923553:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577468032 00000100:00100000:2.0:1788271812.923674:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 31 00000100:00100000:2.0:1788271812.923688:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e85809c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2396:x1875138577468032:12345-192.168.201.3@tcp:1:lfs.0 00010000:00010000:2.0:1788271812.923750:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da52b1b3/0x99288105fd38eb2a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271812.923776:0:8397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000021470cef/0x99288105fd38eadd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd42f expref: 7 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271812.923786:0:8397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788271812.923791:0:8397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788271812.923796:0:8397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da52b1b3/0x99288105fd38eb2a lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271812.923865:0:8397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000021470cef/0x99288105fd38eadd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd42f expref: 7 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271812.923882:0:8397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000021470cef/0x99288105fd38eadd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd42f expref: 7 pid: 8398 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271812.923899:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ecea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8397:1875138590137472:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788271812.924026:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d81d58240 going to sleep for 11 seconds 00000100:00100000:2.0:1788271812.927899:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271812.927966:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ecea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8397:1875138590137472:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788271812.928009:0:8397:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000da52b1b3/0x99288105fd38eb2a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271812.928276:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577468160 00000100:00100000:3.0:1788271812.928288:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577468160 00002000:00100000:3.0:1788271812.928348:0:8401:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff8f6d82ece680 x1875138577468160/t0(0) o4->ef8df183-a1b1-4e56-bce5-924a894c4a71@192.168.201.3@tcp:718/0 lens 504/0 e 0 to 0 dl 1788271823 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788271812.928359:0:8401:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f6d82ece680 with x1875138577468160 ext(0->12) 00010000:00010000:3.0:1788271812.928368:0:8401:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000021470cef/0x99288105fd38eadd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd42f expref: 8 pid: 8398 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271812.928402:0:8401:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000021470cef/0x99288105fd38eadd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd42f expref: 8 pid: 8398 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788271812.928410:0:8401:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8f6d82ece680 00000100:00100000:3.0:1788271812.928461:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 0 00000100:00100000:3.0:1788271812.928481:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ece680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+8:2398:x1875138577468160:12345-192.168.201.3@tcp:4:lfs.0 00000001:00100000:1.0:1788271812.934799:0:8391:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ef8df183-a1b1-4e56-bce5-924a894c4a71 00000100:00100000:1.0:1788271812.935936:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ece680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+9:2398:x1875138577468160:12345-192.168.201.3@tcp:4:lfs.0 Request processed in 7450us (8040us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788271812.935955:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 0 00002000:00100000:1.0:1788271812.935968:0:8401:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff8f6d82ece680 x1875138577468160/t4294967300(0) o4->ef8df183-a1b1-4e56-bce5-924a894c4a71@192.168.201.3@tcp:718/0 lens 504/448 e 0 to 0 dl 1788271823 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788271812.935980:0:8401:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f6d82ece680 with x1875138577468160 ext(0->12) 00010000:00010000:1.0:1788271812.935990:0:8401:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000021470cef/0x99288105fd38eadd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd42f expref: 9 pid: 8398 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271812.936008:0:8401:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000021470cef/0x99288105fd38eadd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd42f expref: 9 pid: 8398 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788271812.936017:0:8401:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8f6d82ece680 00000100:00100000:1.0:1788271812.940231:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271812.940847:0:9486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577468288 00000100:00100000:2.0:1788271812.940859:0:9486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577468288 00010000:00010000:2.0:1788271812.940917:0:9486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000021470cef/0x99288105fd38eadd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd42f expref: 9 pid: 8398 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271812.940967:0:9486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 53 00000100:00100000:2.0:1788271812.940977:0:9486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e8580bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+9:2395:x1875138577468288:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271812.940993:0:9486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788271812.941191:0:9486:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788271812.941195:0:9486:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788271812 00002000:00010000:2.0:1788271812.941198:0:9486:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788271812 00002000:00010000:2.0:1788271812.941200:0:9486:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788271812 00002000:00010000:2.0:1788271812.941202:0:9486:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788271812.941211:0:9486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000021470cef/0x99288105fd38eadd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd42f expref: 9 pid: 8398 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271812.941246:0:9486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000021470cef/0x99288105fd38eadd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd42f expref: 9 pid: 8398 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271812.941274:0:9486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021470cef/0x99288105fd38eadd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd42f expref: 9 pid: 8398 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271812.941291:0:9486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788271812.941296:0:9486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788271812.941302:0:9486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da52b1b3/0x99288105fd38eb2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271812.941312:0:9486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da52b1b3/0x99288105fd38eb2a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271812.941407:0:9486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788271812.941479:0:8397:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000da52b1b3/0x99288105fd38eb2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.941500:0:8397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da52b1b3/0x99288105fd38eb2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.941533:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da52b1b3/0x99288105fd38eb2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.941544:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da52b1b3/0x99288105fd38eb2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.941554:0:8397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da52b1b3/0x99288105fd38eb2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.941562:0:8397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e813a0a00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:0.0:1788271812.941575:0:8397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da52b1b3/0x99288105fd38eb2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271812.941576:0:9486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e8580bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+8:2395:x1875138577468288:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 589us (1342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271812.941610:0:9486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 53 00010000:00010000:0.0:1788271812.941660:0:8397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da52b1b3/0x99288105fd38eb2a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.941681:0:8397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da52b1b3/0x99288105fd38eb2a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.941690:0:8397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da52b1b3/0x99288105fd38eb2a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271812.941790:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e85809c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2396:x1875138577468032:12345-192.168.201.3@tcp:1:lfs.0 Request processed in 18101us (18388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271812.943408:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 31 00000100:00100000:2.0:1788271812.945703:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271812.945801:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577468544 00000100:00100000:3.0:1788271812.945814:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577468544 00000100:00100000:3.0:1788271812.945863:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 8 00000100:00100000:3.0:1788271812.945870:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+22:11145:x1875138577468544:12345-192.168.201.3@tcp:35:lfs.0 00000004:00010000:3.0:1788271812.945925:0:6487:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079000/0x99288105fd38eb1c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd44b expref: 22 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788271812.946114:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:3.0:1788271812.946143:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1788271812.946920:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:3.0:1788271812.946964:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38eb31 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271812.946981:0:6487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5400/0x99288105fd38eac1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd421 expref: 26 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271812.946990:0:6487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38eb31 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271812.947024:0:6487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5400/0x99288105fd38eac1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd421 expref: 26 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271812.947049:0:6487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5400/0x99288105fd38eac1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd421 expref: 26 pid: 6485 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271812.947064:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f40e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6487:1875138590137600:192.168.201.3@tcp:104: 00000100:00100000:3.0:1788271812.948233:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb3f2f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271812.952713:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271812.952959:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577468672 00000100:00100000:0.0:1788271812.952976:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577468672 00010000:00010000:0.0:1788271812.953049:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5400/0x99288105fd38eac1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd421 expref: 27 pid: 6485 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271812.953103:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 54 00000100:00100000:0.0:1788271812.953113:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+27:2397:x1875138577468672:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271812.953133:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271812.953140:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5400/0x99288105fd38eac1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd421 expref: 27 pid: 6485 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.953152:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5400/0x99288105fd38eac1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd421 expref: 27 pid: 6485 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.953196:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060800) 00010000:00010000:0.0:1788271812.953201:0:6468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38eb31 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.953209:0:6468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38eb31 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.953214:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38eb31 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.953230:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271812.953310:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+27:2397:x1875138577468672:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 197us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271812.953318:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 54 00010000:00010000:1.0:1788271812.956192:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5400/0x99288105fd38eac1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd421 expref: 26 pid: 6485 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271812.956224:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f40e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6487:1875138590137600:192.168.201.3@tcp:104: 00010000:00010000:1.0:1788271812.956270:0:6487:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38eb31 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271812.956280:0:6487:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38eb31 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271812.956286:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38eb31 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788271812.956411:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:1.0:1788271812.956550:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:1.0:1788271812.956736:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e84d02680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6487:1875138590137728:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788271812.956803:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271812.956839:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e8240f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788271812.956917:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590137728 00000100:00100000:2.0:1788271812.956987:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590137728 00000100:00080000:1.0:1788271812.957529:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788271812.957537:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788271812.957555:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e84d03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6487:x1875138590137728:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788271812.957736:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e84d03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6487:x1875138590137728:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 187us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271812.957830:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e84d02680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6487:1875138590137728:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788271812.957999:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:3.0:1788271812.958053:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f42d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6487:1875138590137856:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788271812.958096:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271812.958113:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb3f2f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788271812.958514:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1788271812.958528:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1788271812.958585:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788271812.958608:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590137856 00000100:00100000:2.0:1788271812.958613:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590137856 00000100:00100000:2.0:1788271812.958664:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788271812.958672:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6487:x1875138590137856:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788271812.958869:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6487:x1875138590137856:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 198us (772us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788271812.958876:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788271812.958897:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f42d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6487:1875138590137856:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788271812.959297:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:0.0:1788271812.959342:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38eb31 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.959351:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38eb31 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.959358:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38eb31 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.959362:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c5a00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271812.959366:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38eb31 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.959381:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38eb31 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.959398:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060800) 00010000:00010000:0.0:1788271812.959400:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788271812.959404:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38eb31 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271812.959409:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38eb31 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788271812.960555:0:6487:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788271812.961450:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1788271812.961480:0:6487:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 374050860248ns, next at 375050854089ns, rc = 0 00000001:00080000:0.0:1788271812.961496:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:0.0:1788271812.961774:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060800) 00010000:00010000:0.0:1788271812.961779:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788271812.961794:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079000/0x99288105fd38eb1c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd44b expref: 30 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271812.961986:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+29:11145:x1875138577468544:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 16113us (16291us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1788271812.961996:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 8 00000020:00080000:0.0:1788271812.962012:0:6487:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788271812.968960:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271812.969083:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577468800 00000100:00100000:1.0:1788271812.969100:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577468800 00000100:00100000:1.0:1788271812.969176:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 54 00000100:00100000:1.0:1788271812.969197:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+29:11145:x1875138577468800:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:1.0:1788271812.969223:0:12164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271812.969363:0:12164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38eb38 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd452 expref: -99 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271812.969438:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38eb38 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd452 expref: 30 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271812.969453:0:12164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38eb38 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd452 expref: 30 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271812.969492:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:1.0:1788271812.969495:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788271812.969499:0:12164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e92d33e00, rc 0) 00000100:00100000:1.0:1788271812.969952:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+30:11145:x1875138577468800:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 755us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271812.969959:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 54 00000100:00100000:1.0:1788271812.981684:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271812.981946:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577469056 00000100:00100000:0.0:1788271812.981963:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577469056 00000100:00100000:0.0:1788271812.982060:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 9 00000100:00100000:0.0:1788271812.982076:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb36af450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+30:11145:x1875138577469056:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:0.0:1788271812.982402:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb36af450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+31:11145:x1875138577469056:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 330us (730us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1788271812.982411:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 9 00010000:00010000:1.0:1788271813.022879:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271813.063510:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271813.063653:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577469312 00000100:00100000:0.0:1788271813.063663:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577469312 00000100:00100000:0.0:1788271813.063732:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 55 00000100:00100000:0.0:1788271813.063742:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82eced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+31:11155:x1875138577469312:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:0.0:1788271813.063767:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271813.063787:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079000/0x99288105fd38eb3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd459 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271813.063886:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788271813.063985:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079000/0x99288105fd38eb3f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd459 expref: 33 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.064000:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6d83058400) 00010000:00010000:0.0:1788271813.064003:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788271813.064008:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079000/0x99288105fd38eb3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd459 expref: 33 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.064023:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4079000, rc 0) 00000100:00100000:0.0:1788271813.064094:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82eced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+32:11155:x1875138577469312:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 353us (594us total) trans 4294967329 rc 301/301 00000100:00100000:0.0:1788271813.064101:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 55 00000100:00100000:3.0:1788271813.072998:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271813.073119:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577469440 00000100:00100000:0.0:1788271813.073133:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577469440 00000100:00100000:0.0:1788271813.073217:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 56 00000100:00100000:0.0:1788271813.073252:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8233b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+32:11155:x1875138577469440:12345-192.168.201.3@tcp:34:lfs.0 00010000:00010000:0.0:1788271813.073360:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078a00/0x99288105fd38eb4d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.073382:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078a00/0x99288105fd38eb4d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.073397:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078a00/0x99288105fd38eb4d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.073410:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38eb54 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.073433:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38eb54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.073441:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38eb54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.073540:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38eb5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.073549:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38eb5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.073556:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38eb5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788271813.073787:0:9899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38eb5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.073804:0:9899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078a00/0x99288105fd38eb4d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.073819:0:9899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078a00/0x99288105fd38eb4d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.073827:0:9899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078a00/0x99288105fd38eb4d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.073834:0:9899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4078a00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271813.073840:0:9899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078a00/0x99288105fd38eb4d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.073849:0:9899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078a00/0x99288105fd38eb4d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.073866:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f6d83058800) 00010000:00010000:0.0:1788271813.073869:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271813.073876:0:9899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078a00/0x99288105fd38eb4d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.073882:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078a00/0x99288105fd38eb4d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.073896:0:9899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38eb54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.073903:0:9899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38eb54 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.073909:0:9899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38eb54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.073915:0:9899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4078400 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271813.073924:0:9899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38eb54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.073931:0:9899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38eb54 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.073938:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f6d82060600) 00010000:00010000:0.0:1788271813.073941:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271813.073945:0:9899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38eb54 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.073950:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38eb54 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.073961:0:9899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38eb5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.073967:0:9899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38eb5b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.073972:0:9899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38eb5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.073977:0:9899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4079a00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271813.073980:0:9899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38eb5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.073985:0:9899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38eb5b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.073993:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:0.0:1788271813.073995:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271813.074004:0:9899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38eb5b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.074011:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38eb5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271813.074116:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8233b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+32:11155:x1875138577469440:12345-192.168.201.3@tcp:34:lfs.0 Request processed in 866us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271813.074124:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 56 00000100:00100000:2.0:1788271813.087407:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271813.087591:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577469696 00000100:00100000:3.0:1788271813.087606:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577469696 00000100:00100000:3.0:1788271813.087727:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 10 00000100:00100000:3.0:1788271813.087739:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+32:11155:x1875138577469696:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:3.0:1788271813.088074:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+33:11155:x1875138577469696:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 336us (683us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1788271813.088083:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 10 00000100:00100000:3.0:1788271813.131006:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271813.131177:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577469952 00000100:00100000:1.0:1788271813.131188:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577469952 00000100:00100000:1.0:1788271813.131311:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 57 00000100:00100000:1.0:1788271813.131323:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+33:11158:x1875138577469952:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:1.0:1788271813.131347:0:12164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271813.131369:0:12164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38eb62 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd460 expref: -99 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.131460:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38eb69 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.131477:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38eb69 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.131489:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38eb69 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.131500:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38eb70 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.131526:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38eb70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.131533:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38eb70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.131703:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38eb77 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.131713:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38eb77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.131720:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38eb77 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271813.131730:0:12164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788271813.131813:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38eb69 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.131821:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38eb69 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.131828:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38eb69 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.131833:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e92d32c00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271813.131838:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38eb69 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.131844:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38eb69 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.131867:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f6d83058800) 00010000:00010000:1.0:1788271813.131871:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271813.131875:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38eb69 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.131881:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38eb69 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.131895:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38eb70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.131900:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38eb70 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.131906:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38eb70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.131911:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e92d33a00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271813.131914:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38eb70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.131919:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38eb70 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.131926:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f6d82060600) 00010000:00010000:1.0:1788271813.131929:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271813.131931:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38eb70 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.131935:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38eb70 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.131971:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38eb62 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd460 expref: 36 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.131981:0:12164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38eb77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd460 expref: 35 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.131986:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:1.0:1788271813.131987:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788271813.131989:0:12164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e92d33c00, rc 0) 00000100:00100000:1.0:1788271813.132031:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+35:11158:x1875138577469952:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 712us (1037us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1788271813.132035:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 57 00000100:00100000:3.0:1788271813.143333:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271813.143495:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577470080 00000100:00100000:0.0:1788271813.143505:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577470080 00000100:00100000:0.0:1788271813.143567:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 58 00000100:00100000:0.0:1788271813.143576:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8233a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+35:11158:x1875138577470080:12345-192.168.201.3@tcp:54:lfs.0 00010000:00010000:0.0:1788271813.143888:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38eb85 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.143906:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38eb85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.143919:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38eb85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.143969:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38eb85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.143976:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38eb85 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.143982:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38eb85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.143989:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4079a00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271813.144007:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38eb85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.144014:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38eb85 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.144026:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:0.0:1788271813.144029:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788271813.144034:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38eb85 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.144040:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38eb85 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271813.144107:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8233a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+35:11158:x1875138577470080:12345-192.168.201.3@tcp:54:lfs.0 Request processed in 532us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271813.144116:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 58 00000100:00100000:2.0:1788271813.149453:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271813.149531:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577470336 00000100:00100000:3.0:1788271813.149543:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577470336 00000100:00100000:3.0:1788271813.149649:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 11 00000100:00100000:3.0:1788271813.149661:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+35:11158:x1875138577470336:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:3.0:1788271813.149907:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+36:11158:x1875138577470336:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 247us (465us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1788271813.149914:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 11 00000100:00100000:2.0:1788271813.150879:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590137984:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788271813.150944:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271813.151150:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590138112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788271813.151199:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271813.151248:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590137984 00000100:00100000:3.0:1788271813.151254:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590137984 00000100:00100000:3.0:1788271813.151296:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590138112 00000100:00100000:3.0:1788271813.151299:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590138112 00000100:00100000:3.0:1788271813.151314:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788271813.151321:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590137984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788271813.151338:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271813.151371:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83156d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590137984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271813.151378:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788271813.151393:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788271813.151398:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e902a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3607:x1875138590138112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788271813.151407:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271813.151447:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e902a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3607:x1875138590138112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271813.151452:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:3.0:1788271813.151470:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788271813.151501:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590138112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788271813.151609:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590137984:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788271813.156478:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb4f3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590138240:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788271813.156565:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271813.156698:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590138240 00000100:00100000:2.0:1788271813.156707:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590138240 00000100:00100000:2.0:1788271813.156764:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788271813.156774:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e902a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590138240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788271813.156808:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788271813.161614:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e902a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590138240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4830us (5037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271813.161649:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788271813.161863:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb4f3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590138240:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1788271813.342307:0:13762:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788271813.407242:0:13766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788271813.442083:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271813.442525:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577470592 00000100:00100000:0.0:1788271813.442535:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577470592 00000100:00100000:1.0:1788271813.442759:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 59 00000100:00100000:1.0:1788271813.442769:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e902a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+36:11189:x1875138577470592:12345-192.168.201.3@tcp:101:cat.0 00010000:00010000:1.0:1788271813.442789:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271813.442806:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38eb8c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd467 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.442891:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38eb93 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.442902:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38eb93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.442910:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38eb93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271813.442935:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788271813.443043:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38eb8c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd467 expref: 39 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.443057:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38eb93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd467 expref: 38 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.443063:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:1.0:1788271813.443065:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788271813.443067:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e92d33a00, rc 0) 00000100:00100000:1.0:1788271813.443121:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e902a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+38:11189:x1875138577470592:12345-192.168.201.3@tcp:101:cat.0 Request processed in 355us (1050us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1788271813.443126:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 59 00000100:00100000:2.0:1788271813.446581:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271813.449016:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271813.449103:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577470976 00000100:00100000:0.0:1788271813.449112:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577470976 00000100:00100000:0.0:1788271813.449164:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 12 00000100:00100000:0.0:1788271813.449171:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e902a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+38:11189:x1875138577470976:12345-192.168.201.3@tcp:35:cat.0 00000100:00100000:0.0:1788271813.449416:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e902a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+39:11189:x1875138577470976:12345-192.168.201.3@tcp:35:cat.0 Request processed in 236us (399us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1788271813.449424:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 12 00000100:00100000:1.0:1788271813.449777:0:9485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577470720 00000100:00100000:1.0:1788271813.449783:0:9485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577470720 00000100:00100000:1.0:1788271813.449829:0:9485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 4 00000100:00100000:1.0:1788271813.449836:0:9485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3f65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+39:2395:x1875138577470720:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271813.449849:0:9485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271813.449872:0:9485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38eb93 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd467 expref: 39 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.449889:0:9485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:1.0:1788271813.449894:0:9485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271813.449934:0:9485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3f65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+38:2395:x1875138577470720:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 99us (3367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271813.449942:0:9485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 4 00000100:00100000:3.0:1788271813.548017:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271813.548353:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577471232 00000100:00100000:1.0:1788271813.548363:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577471232 00000100:00100000:1.0:1788271813.548444:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 60 00000100:00100000:1.0:1788271813.548455:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e902a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+38:11195:x1875138577471232:12345-192.168.201.3@tcp:101:dd.0 00010000:00010000:1.0:1788271813.548479:0:12164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271813.548482:0:12164:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788271813.548509:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38eaf9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd43d expref: 38 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.548528:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f6d83058800) 00010000:00010000:1.0:1788271813.548723:0:12164:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788271813.548740:0:12164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38eba1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd46e expref: -99 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.548851:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38eba8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.548865:0:12164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38eb77 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd460 expref: 38 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.548874:0:12164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38eba8 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.548906:0:12164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38eb77 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd460 expref: 38 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.549041:0:12164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38eb77 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd460 expref: 38 pid: 12164 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271813.549076:0:12164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e84d01f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12164:1875138590138368:192.168.201.3@tcp:104: 00000100:00100000:1.0:1788271813.549786:0:12164:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e85226840 going to sleep for 11 seconds 00000100:00100000:3.0:1788271813.553305:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271813.553800:0:9486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577471360 00000100:00100000:2.0:1788271813.553809:0:9486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577471360 00010000:00010000:2.0:1788271813.553859:0:9486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38eb77 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd460 expref: 39 pid: 12164 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271813.553909:0:9486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 55 00000100:00100000:2.0:1788271813.553919:0:9486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e902a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+39:2397:x1875138577471360:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271813.553935:0:9486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271813.553942:0:9486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38eb77 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd460 expref: 39 pid: 12164 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271813.553955:0:9486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38eb77 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd460 expref: 39 pid: 12164 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271813.553977:0:9486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:2.0:1788271813.553982:0:9486:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38eba8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271813.553991:0:9486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38eba8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271813.553999:0:9486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38eba8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271813.554016:0:9486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271813.554070:0:9486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e902a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+39:2397:x1875138577471360:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 152us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271813.554078:0:9486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 55 00010000:00010000:1.0:1788271813.556064:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38eb77 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd460 expref: 38 pid: 12164 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271813.556088:0:12164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e84d01f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12164:1875138590138368:192.168.201.3@tcp:104: 00010000:00010000:1.0:1788271813.556114:0:12164:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38eba8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.556124:0:12164:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38eba8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.556130:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38eba8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271813.556152:0:12164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788271813.556487:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38eba1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd46e expref: 39 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.556506:0:12164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38eba8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd46e expref: 38 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.556515:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:1.0:1788271813.556518:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788271813.556521:0:12164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e92d33000, rc 0) 00000100:00100000:1.0:1788271813.556744:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e902a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+38:11195:x1875138577471232:12345-192.168.201.3@tcp:101:dd.0 Request processed in 8288us (8733us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1788271813.556761:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 60 00000100:00100000:3.0:1788271813.558846:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271813.559042:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577471488 00000100:00100000:2.0:1788271813.559051:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577471488 00000100:00100000:2.0:1788271813.559106:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 61 00000100:00100000:2.0:1788271813.559129:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e902a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+38:11195:x1875138577471488:12345-192.168.201.3@tcp:101:dd.0 00010000:00010000:2.0:1788271813.559152:0:9899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271813.559171:0:9899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ebb6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd475 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271813.559205:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38ebbd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271813.559218:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38ebbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271813.559230:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38ebbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271813.559366:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ebb6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd475 expref: 40 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271813.559729:0:9899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38ebbd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd475 expref: 39 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271813.559741:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:2.0:1788271813.559744:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788271813.559747:0:9899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e813a0600, rc 0) 00000100:00100000:2.0:1788271813.559800:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e902a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+39:11195:x1875138577471488:12345-192.168.201.3@tcp:101:dd.0 Request processed in 673us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271813.559808:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 61 00000100:00100000:3.0:1788271813.567700:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271813.567954:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577471744 00000100:00100000:0.0:1788271813.567965:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577471744 00000100:00100000:0.0:1788271813.568028:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 62 00000100:00100000:0.0:1788271813.568053:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e902a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+39:11195:x1875138577471744:12345-192.168.201.3@tcp:36:dd.0 00010000:00010000:0.0:1788271813.568275:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38ebc4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.568294:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38ebc4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.568305:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38ebc4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788271813.568346:0:6483:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:0.0:1788271813.568365:0:6483:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000094c67933 reply state 00000000c67f1bfa transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38ebc4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.568378:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38ebc4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271813.568386:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:0.0:1788271813.568389:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788271813.568392:0:6483:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788271813.568494:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e902a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+42:11195:x1875138577471744:12345-192.168.201.3@tcp:36:dd.0 Request processed in 442us (803us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1788271813.568502:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 62 00000020:00080000:0.0:1788271813.568507:0:6483:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788271813.859949:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271813.860460:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577471872 00000100:00100000:1.0:1788271813.860471:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577471872 00000100:00100000:1.0:1788271813.860601:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 63 00000100:00100000:1.0:1788271813.860611:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e902a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+42:11209:x1875138577471872:12345-192.168.201.3@tcp:101:stat.0 00010000:00010000:1.0:1788271813.860664:0:12164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271813.860685:0:12164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38ebcb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd47c expref: -99 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.860762:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ebd2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.860777:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ebd2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.860787:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ebd2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.860798:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38ebd9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.860806:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38ebd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.860812:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38ebd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.860879:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ebe0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.860901:0:12164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38eba8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd46e expref: 43 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.860907:0:12164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ebe0 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.860933:0:12164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38eba8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd46e expref: 43 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.860943:0:12164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38eba8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd46e expref: 43 pid: 12164 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271813.860953:0:12164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e84d01f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12164:1875138590138496:192.168.201.3@tcp:104: 00000100:00100000:1.0:1788271813.861031:0:12164:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e852223c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271813.865171:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271813.865455:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577472128 00000100:00100000:0.0:1788271813.865464:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577472128 00000100:00100000:1.0:1788271813.865663:0:12164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e84d01f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12164:1875138590138496:192.168.201.3@tcp:104: 00010000:00010000:1.0:1788271813.865691:0:12164:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ebe0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271813.866660:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 13 00000100:00100000:0.0:1788271813.866675:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e902a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+44:6167:x1875138577472128:12345-192.168.201.3@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788271813.867012:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e902a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+45:6167:x1875138577472128:12345-192.168.201.3@tcp:35:ldlm_bl.0 Request processed in 342us (1851us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1788271813.867028:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 13 00000100:00100000:3.0:1788271813.869866:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271813.869958:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577472256 00000100:00100000:1.0:1788271813.869969:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577472256 00010000:00010000:1.0:1788271813.870009:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38eba8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd46e expref: 45 pid: 12164 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271813.870052:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 56 00000100:00100000:1.0:1788271813.870062:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e902a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+45:2398:x1875138577472256:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271813.870087:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271813.870107:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38eba8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd46e expref: 45 pid: 12164 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.870121:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38eba8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd46e expref: 45 pid: 12164 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.870144:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38eba8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd46e expref: 45 pid: 12164 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.870161:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:1.0:1788271813.870166:0:6469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ebe0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.870176:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ebe0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.870185:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ebe0 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271813.870219:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271813.870269:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e902a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+44:2398:x1875138577472256:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 208us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271813.870276:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 56 00010000:00010000:2.0:1788271813.870847:0:12164:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ebe0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271813.870863:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ebe0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271813.870906:0:12164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788271813.870909:0:12164:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788271813.870941:0:12164:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ebe0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271813.870952:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ebe0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271813.870958:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ebd2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271813.870963:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ebd2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271813.870967:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ebd2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271813.870971:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e92d33c00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271813.870974:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ebd2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271813.870979:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ebd2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271813.870985:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f6d83058800) 00010000:00010000:2.0:1788271813.870987:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271813.870989:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ebd2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271813.870999:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ebd2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271813.871007:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38ebd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271813.871011:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38ebd9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271813.871014:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38ebd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271813.871017:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e92d32600 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271813.871019:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38ebd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271813.871022:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38ebd9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271813.871026:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f6d82060600) 00010000:00010000:2.0:1788271813.871028:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271813.871029:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38ebd9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271813.871032:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38ebd9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271813.871056:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38ebcb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd47c expref: 44 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271813.871073:0:12164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ebe0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd47c expref: 43 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271813.871078:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:2.0:1788271813.871079:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788271813.871080:0:12164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e92d32c00, rc 0) 00000100:00100000:2.0:1788271813.871116:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e902a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+43:11209:x1875138577471872:12345-192.168.201.3@tcp:101:stat.0 Request processed in 10507us (11177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271813.871121:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 63 00000100:00100000:3.0:1788271813.941768:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271813.941873:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577472512 00000100:00100000:2.0:1788271813.941883:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577472512 00000100:00100000:2.0:1788271813.941942:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 64 00000100:00100000:2.0:1788271813.941952:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e902a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+43:11215:x1875138577472512:12345-192.168.201.3@tcp:36:truncate.0 00010000:00010000:2.0:1788271813.942008:0:9899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271813.942036:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ebe0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd47c expref: 43 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271813.942056:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:2.0:1788271813.942060:0:9899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788271813.942238:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ebe7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271813.942252:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ebe7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271813.942260:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ebe7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788271813.942317:0:9899:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:2.0:1788271813.942339:0:9899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a47ad016 reply state 0000000092f79ea3 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ebe7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271813.942352:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ebe7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271813.942358:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:2.0:1788271813.942361:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788271813.943502:0:9899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788271813.943869:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e902a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+45:11215:x1875138577472512:12345-192.168.201.3@tcp:36:truncate.0 Request processed in 1914us (2106us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1788271813.943877:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 64 00000020:00080000:2.0:1788271813.943882:0:9899:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788271814.048640:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271814.081745:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271814.081868:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577472640 00000100:00100000:1.0:1788271814.081879:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577472640 00000100:00100000:1.0:1788271814.081961:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 65 00000100:00100000:1.0:1788271814.081971:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e902a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+45:11229:x1875138577472640:12345-192.168.201.3@tcp:101:stat.0 00010000:00010000:1.0:1788271814.081996:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271814.082016:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38ebee lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd483 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.082097:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ebf5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.082113:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ebf5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.082123:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ebf5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.082133:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38ebfc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.082140:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38ebfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.082146:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38ebfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.082218:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38ec03 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.082226:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38ec03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.082233:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38ec03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271814.082274:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1788271814.082279:0:6484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788271814.082302:0:6484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38ec03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.082326:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38ec03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.082334:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ebf5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.082340:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ebf5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.082346:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ebf5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.082351:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e92d32c00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271814.082354:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ebf5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.082362:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ebf5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.082373:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f6d83058800) 00010000:00010000:1.0:1788271814.082377:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271814.082381:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ebf5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.082387:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ebf5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.082411:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38ebfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.082418:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38ebfc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.082429:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38ebfc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.082434:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e92d33a00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271814.082437:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38ebfc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.082443:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38ebfc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.082452:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f6d82060600) 00010000:00010000:1.0:1788271814.082455:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271814.082458:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38ebfc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.082464:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38ebfc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.082492:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38ebee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd483 expref: 47 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.082505:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38ec03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd483 expref: 46 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.082512:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:1.0:1788271814.082514:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788271814.082517:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e92d32600, rc 0) 00000100:00080000:3.0:1788271814.082658:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271814.082741:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e902a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+46:11229:x1875138577472640:12345-192.168.201.3@tcp:101:stat.0 Request processed in 771us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271814.082760:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 65 00000100:00100000:0.0:1788271814.174663:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e84d01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590138624:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788271814.174750:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271814.174961:0:14136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590138624 00000100:00100000:2.0:1788271814.174969:0:14136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590138624 00000100:00100000:2.0:1788271814.175013:0:14136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788271814.175022:0:14136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590138624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788271814.175053:0:14136:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1788271814.175103:0:14136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590138624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271814.175110:0:14136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788271814.175257:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e84d01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590138624:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788271814.194768:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271814.194848:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577472896 00000100:00100000:1.0:1788271814.194863:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577472896 00000100:00100000:1.0:1788271814.194950:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 66 00000100:00100000:1.0:1788271814.194966:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e902a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+46:11239:x1875138577472896:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:1.0:1788271814.194988:0:12164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271814.195010:0:12164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38ec0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd48a expref: -99 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271814.195136:0:12164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788271814.195240:0:12164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38ec0a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd48a expref: 48 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.195254:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6d83058400) 00010000:00010000:1.0:1788271814.195257:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788271814.195262:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38ec0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd48a expref: 48 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.195283:0:12164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e92d33000, rc 0) 00000100:00100000:1.0:1788271814.195361:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e902a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+47:11239:x1875138577472896:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 400us (612us total) trans 4294967341 rc 301/301 00000100:00100000:1.0:1788271814.195368:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 66 00000100:00100000:2.0:1788271814.198842:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271814.198994:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577473152 00000100:00100000:0.0:1788271814.199008:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577473152 00000100:00100000:0.0:1788271814.199083:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 14 00000100:00100000:0.0:1788271814.199096:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+47:11239:x1875138577473152:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:0.0:1788271814.199410:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+48:11239:x1875138577473152:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 316us (583us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1788271814.199419:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 14 00000100:00100000:3.0:1788271814.282291:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271814.282817:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577473408 00000100:00100000:2.0:1788271814.282831:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577473408 00000100:00100000:2.0:1788271814.282911:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 67 00000100:00100000:2.0:1788271814.282922:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e902a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+48:11245:x1875138577473408:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:2.0:1788271814.282976:0:9899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271814.283004:0:9899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38ec18 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd491 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.283148:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ec1f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.283168:0:9899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38ec03 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd483 expref: 49 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.283179:0:9899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ec1f lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.283227:0:9899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38ec03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd483 expref: 49 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.283312:0:9899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38ec03 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd483 expref: 49 pid: 6484 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271814.283330:0:9899:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3f67b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9899:1875138590138752:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788271814.283562:0:9899:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830d8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788271814.287068:0:9899:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3f67b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9899:1875138590138752:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788271814.287122:0:9899:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ec1f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271814.288757:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271814.289241:0:9485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577473536 00000100:00100000:1.0:1788271814.289256:0:9485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577473536 00010000:00010000:1.0:1788271814.289317:0:9485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38ec03 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd483 expref: 50 pid: 6484 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271814.289463:0:9485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 57 00000100:00100000:1.0:1788271814.289477:0:9485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3598850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+50:2398:x1875138577473536:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271814.289497:0:9485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271814.289505:0:9485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38ec03 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd483 expref: 50 pid: 6484 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.289521:0:9485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38ec03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd483 expref: 50 pid: 6484 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.289560:0:9485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38ec03 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd483 expref: 50 pid: 6484 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.289581:0:9485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:1.0:1788271814.289587:0:9485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ec1f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.289599:0:9485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ec1f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.289607:0:9485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ec1f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.289704:0:9485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271814.289778:0:9485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3598850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+49:2398:x1875138577473536:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 304us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271814.289786:0:9485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 57 00010000:00010000:0.0:1788271814.290259:0:9899:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ec1f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.290269:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ec1f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271814.290295:0:9899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1788271814.290490:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38ec18 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd491 expref: 50 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.290510:0:9899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ec1f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd491 expref: 49 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.290518:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:0.0:1788271814.290520:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788271814.290533:0:9899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e813a0e00, rc 0) 00000100:00100000:0.0:1788271814.290570:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e902a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+49:11245:x1875138577473408:12345-192.168.201.3@tcp:101:bash.0 Request processed in 7651us (8294us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788271814.290579:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 67 00000100:00100000:3.0:1788271814.293528:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271814.295409:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577473792 00000100:00100000:0.0:1788271814.295431:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577473792 00000100:00100000:0.0:1788271814.295531:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 68 00000100:00100000:0.0:1788271814.295555:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e902a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+49:11245:x1875138577473792:12345-192.168.201.3@tcp:36:bash.0 00010000:00010000:0.0:1788271814.295945:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078a00/0x99288105fd38ec2d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.295970:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078a00/0x99288105fd38ec2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.295984:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078a00/0x99288105fd38ec2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788271814.296608:0:6485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:0.0:1788271814.297340:0:6485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ff276977 reply state 00000000bb4bab83 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078a00/0x99288105fd38ec2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.297366:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078a00/0x99288105fd38ec2d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.297375:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:0.0:1788271814.297378:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788271814.297384:0:6485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788271814.299343:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e902a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+52:11245:x1875138577473792:12345-192.168.201.3@tcp:36:bash.0 Request processed in 3788us (5817us total) trans 4294967345 rc 0/0 00000100:00100000:0.0:1788271814.299357:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 68 00000020:00080000:0.0:1788271814.299383:0:6485:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788271814.309298:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271814.311135:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577473920 00000100:00100000:3.0:1788271814.311155:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577473920 00000100:00100000:3.0:1788271814.311253:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 69 00000100:00100000:3.0:1788271814.311269:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+52:11245:x1875138577473920:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:3.0:1788271814.311303:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271814.311333:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5e00/0x99288105fd38ec34 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd498 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.311485:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4600/0x99288105fd38ec3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.311524:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ec1f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd491 expref: 53 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.311535:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4600/0x99288105fd38ec3b lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.312357:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ec1f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd491 expref: 53 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.312378:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ec1f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd491 expref: 53 pid: 9899 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271814.312470:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e902a2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6483:1875138590138880:192.168.201.3@tcp:104: 00000100:00100000:3.0:1788271814.313707:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb3f2f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271814.320167:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e902a2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6483:1875138590138880:192.168.201.3@tcp:104: 00000100:00100000:1.0:1788271814.320167:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00010000:00010000:3.0:1788271814.320207:0:6483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4600/0x99288105fd38ec3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271814.320289:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577474048 00000100:00100000:0.0:1788271814.320297:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577474048 00010000:00010000:0.0:1788271814.320347:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ec1f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd491 expref: 54 pid: 9899 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271814.320512:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 58 00000100:00100000:0.0:1788271814.320526:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e84d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+54:2397:x1875138577474048:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271814.320556:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271814.320565:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ec1f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd491 expref: 54 pid: 9899 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.320580:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ec1f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd491 expref: 54 pid: 9899 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.320607:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ec1f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd491 expref: 54 pid: 9899 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.320776:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:0.0:1788271814.320782:0:6468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4600/0x99288105fd38ec3b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.320795:0:6468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4600/0x99288105fd38ec3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.320804:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4600/0x99288105fd38ec3b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.320828:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271814.320914:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e84d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+53:2397:x1875138577474048:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 389us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271814.320923:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 58 00010000:00010000:3.0:1788271814.321336:0:6483:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4600/0x99288105fd38ec3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.321345:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4600/0x99288105fd38ec3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271814.321438:0:6483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788271814.321443:0:6483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788271814.321473:0:6483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4600/0x99288105fd38ec3b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.321526:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5e00/0x99288105fd38ec34 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd498 expref: 53 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.321768:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4600/0x99288105fd38ec3b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd498 expref: 52 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.321777:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:3.0:1788271814.321780:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788271814.321783:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c4600, rc 0) 00000100:00100000:3.0:1788271814.321830:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+52:11245:x1875138577473920:12345-192.168.201.3@tcp:101:bash.0 Request processed in 10566us (12549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271814.321838:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 69 00000100:00100000:1.0:1788271814.329257:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271814.329575:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577474304 00000100:00100000:0.0:1788271814.329588:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577474304 00000100:00100000:1.0:1788271814.329854:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 15 00000100:00100000:1.0:1788271814.329870:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb36ad050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+52:11245:x1875138577474304:12345-192.168.201.3@tcp:35:bash.0 00000100:00100000:1.0:1788271814.330236:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb36ad050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+53:11245:x1875138577474304:12345-192.168.201.3@tcp:35:bash.0 Request processed in 370us (993us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1788271814.330245:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 15 00000100:00100000:0.0:1788271814.419317:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271814.419568:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577474560 00000100:00100000:2.0:1788271814.419583:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577474560 00000100:00100000:2.0:1788271814.419700:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 70 00000100:00100000:2.0:1788271814.419731:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+53:11255:x1875138577474560:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788271814.419780:0:9899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271814.419809:0:9899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ec42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd49f expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271814.419966:0:9899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788271814.420096:0:9899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ec42 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd49f expref: 55 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.420114:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6d83058400) 00010000:00010000:2.0:1788271814.420117:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788271814.420122:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ec42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd49f expref: 55 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.420142:0:9899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e813a0e00, rc 0) 00000100:00100000:2.0:1788271814.420222:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+54:11255:x1875138577474560:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 495us (922us total) trans 4294967347 rc 301/301 00000100:00100000:2.0:1788271814.420230:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 70 00000100:00100000:1.0:1788271814.423072:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271814.423146:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577474688 00000100:00100000:0.0:1788271814.423159:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577474688 00000100:00100000:0.0:1788271814.423234:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 71 00000100:00100000:0.0:1788271814.423246:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e84d01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+54:11255:x1875138577474688:12345-192.168.201.3@tcp:34:lfs.0 00010000:00010000:0.0:1788271814.423346:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078c00/0x99288105fd38ec50 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.423370:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078c00/0x99288105fd38ec50 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.423384:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078c00/0x99288105fd38ec50 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.423481:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079000/0x99288105fd38ec57 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.423491:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079000/0x99288105fd38ec57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.423499:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079000/0x99288105fd38ec57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.423597:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38ec5e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.423607:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38ec5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.423678:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38ec5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788271814.423759:0:6485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38ec5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.423776:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078c00/0x99288105fd38ec50 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.423784:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078c00/0x99288105fd38ec50 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.423792:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078c00/0x99288105fd38ec50 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.423798:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4078c00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271814.423804:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078c00/0x99288105fd38ec50 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.423823:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078c00/0x99288105fd38ec50 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.423838:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f6d83058800) 00010000:00010000:0.0:1788271814.423841:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271814.423846:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078c00/0x99288105fd38ec50 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.423853:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078c00/0x99288105fd38ec50 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.423868:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079000/0x99288105fd38ec57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.423890:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079000/0x99288105fd38ec57 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.423897:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079000/0x99288105fd38ec57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.423903:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4079000 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271814.423906:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079000/0x99288105fd38ec57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.423912:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079000/0x99288105fd38ec57 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.423921:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f6d82060600) 00010000:00010000:0.0:1788271814.423924:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271814.423927:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079000/0x99288105fd38ec57 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.423933:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079000/0x99288105fd38ec57 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.423952:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38ec5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.423959:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38ec5e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.423965:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38ec5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.423971:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4078400 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271814.423981:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38ec5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.423988:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38ec5e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.423997:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:0.0:1788271814.424000:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271814.424002:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38ec5e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.424009:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38ec5e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271814.424103:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e84d01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+54:11255:x1875138577474688:12345-192.168.201.3@tcp:34:lfs.0 Request processed in 857us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271814.424112:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 71 00000100:00100000:1.0:1788271814.426171:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271814.426273:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577474944 00000100:00100000:3.0:1788271814.426286:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577474944 00000100:00100000:3.0:1788271814.426349:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 16 00000100:00100000:3.0:1788271814.426369:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e84d00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+54:11255:x1875138577474944:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:3.0:1788271814.426706:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e84d00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+55:11255:x1875138577474944:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 346us (546us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1788271814.426716:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 16 00000100:00100000:3.0:1788271814.461419:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271814.461660:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577475200 00000100:00100000:0.0:1788271814.461675:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577475200 00000100:00100000:0.0:1788271814.461769:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 72 00000100:00100000:0.0:1788271814.461782:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e902a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+55:11258:x1875138577475200:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:0.0:1788271814.461826:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271814.461855:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38ec65 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd4a6 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.461975:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079000/0x99288105fd38ec6c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.461993:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079000/0x99288105fd38ec6c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.462029:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079000/0x99288105fd38ec6c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.462045:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078c00/0x99288105fd38ec73 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.462053:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078c00/0x99288105fd38ec73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.462060:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078c00/0x99288105fd38ec73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.462221:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079400/0x99288105fd38ec7a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.462233:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079400/0x99288105fd38ec7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.462240:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079400/0x99288105fd38ec7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271814.462251:0:6483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788271814.462966:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079000/0x99288105fd38ec6c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.462977:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079000/0x99288105fd38ec6c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.462986:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079000/0x99288105fd38ec6c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.462992:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4079000 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271814.463006:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079000/0x99288105fd38ec6c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.463016:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079000/0x99288105fd38ec6c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.463031:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f6d83058800) 00010000:00010000:0.0:1788271814.463035:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271814.463042:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079000/0x99288105fd38ec6c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.463049:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079000/0x99288105fd38ec6c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.463065:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078c00/0x99288105fd38ec73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.463071:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078c00/0x99288105fd38ec73 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.463077:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078c00/0x99288105fd38ec73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.463083:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4078c00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271814.463086:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078c00/0x99288105fd38ec73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.463093:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078c00/0x99288105fd38ec73 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.463101:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f6d82060600) 00010000:00010000:0.0:1788271814.463103:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271814.463113:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078c00/0x99288105fd38ec73 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.463120:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078c00/0x99288105fd38ec73 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.463167:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078400/0x99288105fd38ec65 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4a6 expref: 58 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.463196:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079400/0x99288105fd38ec7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4a6 expref: 57 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.463205:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:0.0:1788271814.463208:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788271814.463211:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4079400, rc 0) 00000100:00100000:0.0:1788271814.464115:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e902a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+57:11258:x1875138577475200:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 2331us (2704us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788271814.464127:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 72 00000100:00100000:2.0:1788271814.467616:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271814.467696:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271814.467763:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577475456 00000100:00100000:3.0:1788271814.467778:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577475456 00000100:00100000:0.0:1788271814.467805:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577475328 00000100:00100000:0.0:1788271814.467821:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577475328 00000100:00100000:3.0:1788271814.467859:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 5 00000100:00100000:0.0:1788271814.467867:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 73 00000100:00100000:3.0:1788271814.467874:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3f64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+58:2398:x1875138577475456:12345-192.168.201.3@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788271814.467889:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+58:11258:x1875138577475328:12345-192.168.201.3@tcp:54:lfs.0 00010000:00010000:3.0:1788271814.467897:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271814.467962:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079400/0x99288105fd38ec7a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4a6 expref: 58 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.467986:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:3.0:1788271814.467993:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788271814.467999:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38ec88 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.468018:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38ec88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.468031:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38ec88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271814.468068:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3f64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+57:2398:x1875138577475456:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 197us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271814.468077:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 5 00010000:00010000:0.0:1788271814.468089:0:9899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38ec88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.468098:0:9899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38ec88 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.468106:0:9899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38ec88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.468113:0:9899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511c200 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271814.468119:0:9899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38ec88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.468129:0:9899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38ec88 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.468140:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:0.0:1788271814.468143:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788271814.468148:0:9899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38ec88 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.468155:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38ec88 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271814.468211:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+56:11258:x1875138577475328:12345-192.168.201.3@tcp:54:lfs.0 Request processed in 335us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271814.468219:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 73 00000100:00100000:1.0:1788271814.471245:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271814.471329:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577475712 00000100:00100000:3.0:1788271814.471341:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577475712 00000100:00100000:3.0:1788271814.471426:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 17 00000100:00100000:3.0:1788271814.471439:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e84d03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+56:11258:x1875138577475712:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:3.0:1788271814.471766:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e84d03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+57:11258:x1875138577475712:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 329us (534us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1788271814.471775:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 17 00000100:00100000:3.0:1788271814.643726:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271814.643856:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577475968 00000100:00100000:0.0:1788271814.643871:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577475968 00000100:00100000:0.0:1788271814.643967:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 74 00000100:00100000:0.0:1788271814.644000:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e902a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+57:11276:x1875138577475968:12345-192.168.201.3@tcp:101:cat.0 00010000:00010000:0.0:1788271814.644034:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271814.644060:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38ec8f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd4ad expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.644234:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38ec96 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.644254:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38ec96 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.644269:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38ec96 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271814.644283:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788271814.644437:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38ec8f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4ad expref: 60 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.644460:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38ec96 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4ad expref: 59 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.644470:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:0.0:1788271814.644474:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788271814.644478:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e8511da00, rc 0) 00000100:00100000:0.0:1788271814.644561:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e902a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+59:11276:x1875138577475968:12345-192.168.201.3@tcp:101:cat.0 Request processed in 564us (850us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1788271814.644569:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 74 00000100:00100000:3.0:1788271814.674482:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271814.680558:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577476096 00000100:00100000:0.0:1788271814.680582:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577476096 00000100:00100000:0.0:1788271814.681824:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 75 00000100:00100000:0.0:1788271814.681846:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e902a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+59:11277:x1875138577476096:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:0.0:1788271814.681887:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271814.681918:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38eca4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd4b4 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.683118:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c600/0x99288105fd38ecab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.688253:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c600/0x99288105fd38ecab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.688274:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c600/0x99288105fd38ecab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271814.688345:0:6483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788271814.688350:0:6483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788271814.688377:0:6483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c600/0x99288105fd38ecab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.688442:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38eca4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4b4 expref: 61 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.688470:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c600/0x99288105fd38ecab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4b4 expref: 60 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271814.688480:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f6d83058800) 00010000:00010000:0.0:1788271814.688484:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788271814.688490:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e8511c600, rc 0) 00000100:00100000:0.0:1788271814.688588:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e902a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+60:11277:x1875138577476096:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 6750us (14122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271814.688637:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 75 00000100:00100000:3.0:1788271814.688911:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e902a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875138590139136:0@lo:400:kworker.0 00000100:00100000:3.0:1788271814.688992:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271814.689066:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfc75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3607:1875138590139648:0@lo:400:kworker.0 00000100:00100000:3.0:1788271814.689091:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271814.689107:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfc77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3607:1875138590140160:0@lo:400:kworker.0 00000100:00100000:3.0:1788271814.689128:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271814.689151:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788271814.689157:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e902a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590139008:0@lo:400:kworker.0 00000100:00100000:3.0:1788271814.689190:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271814.689223:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfc77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3607:1875138590139520:0@lo:400:kworker.0 00000100:00100000:3.0:1788271814.689247:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271814.689262:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfc74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3607:1875138590140032:0@lo:400:kworker.0 00000100:00100000:3.0:1788271814.689284:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271814.689313:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590139008 00000100:00100000:3.0:1788271814.689321:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590139008 00000100:00100000:3.0:1788271814.689372:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1788271814.689381:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3607:x1875138590139008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271814.689441:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3607:x1875138590139008:12345-0@lo:400:kworker.0 Request processed in 61us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271814.689448:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1788271814.689485:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e902a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875138590139264:0@lo:400:kworker.0 00000100:00100000:3.0:1788271814.689509:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271814.689522:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfc77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590139776:0@lo:400:kworker.0 00000100:00100000:3.0:1788271814.689550:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271814.689566:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfc75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590140288:0@lo:400:kworker.0 00000100:00100000:3.0:1788271814.689587:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271814.689607:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788271814.689613:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfc76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590139392:0@lo:400:kworker.0 00000100:00100000:3.0:1788271814.689675:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271814.689692:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfc75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590139904:0@lo:400:kworker.0 00000100:00100000:3.0:1788271814.689726:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271814.689748:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfc74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590140416:0@lo:400:kworker.0 00000100:00100000:3.0:1788271814.689772:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271814.689800:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590139776 00000100:00100000:3.0:1788271814.689811:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590139776 00000100:00100000:3.0:1788271814.689839:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590140288 00000100:00100000:3.0:1788271814.689842:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590140288 00000100:00100000:3.0:1788271814.689864:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590139904 00000100:00100000:3.0:1788271814.689867:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590139904 00000100:00100000:3.0:1788271814.689879:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590140416 00000100:00100000:3.0:1788271814.689881:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590140416 00000100:00100000:3.0:1788271814.689895:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788271814.689901:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590139776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271814.689943:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590139776:12345-0@lo:400:kworker.0 Request processed in 42us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271814.689950:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788271814.689962:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788271814.689968:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590140288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271814.689996:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590140288:12345-0@lo:400:kworker.0 Request processed in 29us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271814.690003:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788271814.690014:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788271814.690019:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3608:x1875138590139904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271814.690045:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3608:x1875138590139904:12345-0@lo:400:kworker.0 Request processed in 26us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271814.690051:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788271814.690062:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788271814.690067:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590140416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271814.690093:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590140416:12345-0@lo:400:kworker.0 Request processed in 26us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271814.690098:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:3.0:1788271814.690127:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788271814.690132:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788271814.690166:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e902a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590139008:0@lo:400:kworker.0 00000100:00100000:3.0:1788271814.690204:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfc75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590139904:0@lo:400:kworker.0 00000100:00100000:3.0:1788271814.690214:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfc74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590140416:0@lo:400:kworker.0 00000100:00100000:3.0:1788271814.690223:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfc77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590139776:0@lo:400:kworker.0 00000100:00100000:3.0:1788271814.690231:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfc75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590140288:0@lo:400:kworker.0 00000100:00100000:3.0:1788271814.690258:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590139136 00000100:00100000:3.0:1788271814.690261:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590139136 00000100:00100000:3.0:1788271814.690281:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590139648 00000100:00100000:3.0:1788271814.690283:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590139648 00000100:00100000:3.0:1788271814.690302:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590140160 00000100:00100000:3.0:1788271814.690305:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590140160 00000100:00100000:3.0:1788271814.690318:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590139520 00000100:00100000:3.0:1788271814.690321:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590139520 00000100:00100000:3.0:1788271814.690332:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590140032 00000100:00100000:3.0:1788271814.690334:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590140032 00000100:00100000:3.0:1788271814.690344:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590139264 00000100:00100000:3.0:1788271814.690346:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590139264 00000100:00100000:3.0:1788271814.690359:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788271814.690365:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875138590139136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271814.690421:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875138590139136:12345-0@lo:400:kworker.0 Request processed in 55us (1429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271814.690427:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788271814.690440:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788271814.690446:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875138590139648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271814.690476:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875138590139648:12345-0@lo:400:kworker.0 Request processed in 31us (1384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271814.690489:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788271814.690502:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788271814.690508:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875138590140160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271814.690550:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875138590140160:12345-0@lo:400:kworker.0 Request processed in 42us (1421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271814.690557:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788271814.690569:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788271814.690575:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875138590139520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271814.690602:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875138590139520:12345-0@lo:400:kworker.0 Request processed in 28us (1354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271814.690608:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788271814.690648:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788271814.690654:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875138590140032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271814.690682:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875138590140032:12345-0@lo:400:kworker.0 Request processed in 29us (1397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271814.690688:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788271814.690699:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788271814.690704:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875138590139264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271814.690734:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875138590139264:12345-0@lo:400:kworker.0 Request processed in 31us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271814.690740:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:3.0:1788271814.690756:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788271814.690759:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788271814.690778:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfc77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3607:1875138590139520:0@lo:400:kworker.0 00000100:00100000:3.0:1788271814.690801:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfc74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3607:1875138590140032:0@lo:400:kworker.0 00000100:00100000:3.0:1788271814.690812:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e902a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875138590139136:0@lo:400:kworker.0 00010000:00080000:3.0:1788271814.690825:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6ebfc75f80 x1875138590139648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271814.690836:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfc75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3607:1875138590139648:0@lo:400:kworker.0 00010000:00080000:3.0:1788271814.690848:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6ebfc77100 x1875138590140160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271814.690856:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfc77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3607:1875138590140160:0@lo:400:kworker.0 00000100:00100000:3.0:1788271814.690896:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e902a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875138590139264:0@lo:400:kworker.0 00000100:00100000:2.0:1788271814.691295:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590139392 00000100:00100000:2.0:1788271814.691301:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590139392 00000100:00100000:2.0:1788271814.691339:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788271814.691347:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590139392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271814.691409:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590139392:12345-0@lo:400:kworker.0 Request processed in 63us (1734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271814.691416:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788271814.691457:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfc76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590139392:0@lo:400:kworker.0 00000100:00100000:0.0:1788271814.691589:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3f65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590140544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788271814.691654:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271814.691699:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590140544 00000100:00100000:0.0:1788271814.691703:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590140544 00000100:00100000:0.0:1788271814.691740:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788271814.691748:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590140544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788271814.691773:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788271814.691813:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590140544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271814.691819:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788271814.691852:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3f65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590140544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788271814.692446:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788271814.692458:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590140672:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788271814.692496:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271814.692577:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590140672 00000100:00100000:2.0:1788271814.692582:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590140672 00000100:00100000:2.0:1788271814.692642:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788271814.692650:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e84d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590140672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788271814.692664:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788271814.692699:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e84d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590140672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271814.692705:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788271814.692734:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590140672:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788271814.704328:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271814.704438:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577476480 00000100:00100000:3.0:1788271814.704451:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577476480 00000100:00100000:3.0:1788271814.704521:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 18 00000100:00100000:3.0:1788271814.704533:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e84d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+60:11277:x1875138577476480:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:3.0:1788271814.705192:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e84d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+61:11277:x1875138577476480:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 656us (873us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788271814.705203:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 18 00000100:00100000:3.0:1788271814.711852:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271814.714089:0:9485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577476608 00000100:00100000:1.0:1788271814.714109:0:9485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577476608 00000100:00100000:1.0:1788271814.715097:0:9485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 6 00000100:00100000:1.0:1788271814.715114:0:9485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+61:11277:x1875138577476608:12345-192.168.201.3@tcp:103:lfs.0 00010000:00010000:1.0:1788271814.715135:0:9485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788271814.715496:0:9485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4600/0x99288105fd38ec3b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd498 expref: 61 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.715532:0:9485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38ec96 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4ad expref: 60 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.715546:0:9485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38eb38 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd452 expref: 59 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271814.715584:0:9485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:1.0:1788271814.715590:0:9485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271814.715771:0:9485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+58:11277:x1875138577476608:12345-192.168.201.3@tcp:103:lfs.0 Request processed in 662us (3929us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271814.715781:0:9485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 6 00000100:00100000:1.0:1788271814.720522:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271814.723820:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577476736 00000100:00100000:3.0:1788271814.723843:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577476736 00000100:00100000:3.0:1788271814.724001:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 76 00000100:00100000:3.0:1788271814.724016:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e84d00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+58:11277:x1875138577476736:12345-192.168.201.3@tcp:58:lfs.0 00010000:00010000:3.0:1788271814.724236:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5800/0x99288105fd38ecb2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.724266:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5800/0x99288105fd38ecb2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271814.724281:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5800/0x99288105fd38ecb2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788271814.724657:0:12164:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788271814.724858:0:12164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1788271814.724957:0:12164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1788271814.725086:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e84d00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+58:11277:x1875138577476736:12345-192.168.201.3@tcp:58:lfs.0 Request processed in 1071us (4577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271814.725095:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 76 00000100:00100000:3.0:1788271814.760241:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271814.760356:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577476864 00000100:00100000:2.0:1788271814.760370:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577476864 00000100:00100000:2.0:1788271814.760464:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 77 00000100:00100000:2.0:1788271814.760477:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+58:11279:x1875138577476864:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788271814.760503:0:9899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271814.760531:0:9899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ecb9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd4bb expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.760695:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38ecc0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.760713:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38ecc0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.760726:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38ecc0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.760740:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38ecc7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.760755:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38ecc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.760762:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38ecc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.760867:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38ecce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.760878:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38ecce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.760884:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38ecce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271814.760936:0:9899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788271814.760941:0:9899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788271814.760965:0:9899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38ecce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.760979:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38ecce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.760987:0:9899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38ecc0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.760994:0:9899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38ecc0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.761001:0:9899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38ecc0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.761016:0:9899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e813a1600 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271814.761021:0:9899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38ecc0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.761028:0:9899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38ecc0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.761042:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f6d83058800) 00010000:00010000:2.0:1788271814.761046:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271814.761051:0:9899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38ecc0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.761057:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38ecc0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.761074:0:9899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38ecc7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.761080:0:9899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38ecc7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.761086:0:9899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38ecc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.761091:0:9899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e20200 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271814.761093:0:9899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38ecc7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.761099:0:9899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38ecc7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.761119:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f6d82060600) 00010000:00010000:2.0:1788271814.761122:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271814.761125:0:9899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38ecc7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.761132:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38ecc7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.761512:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ecb9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4bb expref: 60 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.761531:0:9899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38ecce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4bb expref: 59 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271814.761540:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:2.0:1788271814.761543:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788271814.761546:0:9899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e21000, rc 0) 00000100:00100000:2.0:1788271814.761712:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+59:11279:x1875138577476864:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 1237us (1485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271814.761721:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 77 00010000:00010000:3.0:1788271815.071313:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788271815.390887:0:13762:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788271815.390895:0:13762:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788271815.390931:0:13762:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788271815.390938:0:13762:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788271815.391276:0:13762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfc7aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13762:1875138590140800:192.168.201.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788271815.391416:0:13762:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb3ded300 going to sleep for 11 seconds 00000100:00100000:1.0:1788271815.397349:0:13762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfc7aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13762:1875138590140800:192.168.201.3@tcp:107:hsm_cdtr.0 00000001:00080000:2.0:1788271815.399866:0:6462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000004:00080000:2.0:1788271815.399942:0:6462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:3.0:1788271815.400143:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078200/0x99288105fd38ea74 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.400163:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078200/0x99288105fd38ea74 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.400172:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078200/0x99288105fd38ea74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.400199:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4078200 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271815.400207:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078200/0x99288105fd38ea74 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.400216:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078200/0x99288105fd38ea74 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.400241:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8f6d83058d00) 00010000:00010000:3.0:1788271815.400245:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271815.400251:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078200/0x99288105fd38ea74 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.400258:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078200/0x99288105fd38ea74 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.400286:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078800/0x99288105fd38ea7b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.400293:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078800/0x99288105fd38ea7b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.400299:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078800/0x99288105fd38ea7b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.400304:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4078800 already unused, calling callback (ffffffffc174a4f0) 00000100:00100000:0.0:1788271815.400337:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271815.400386:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577476992 00000100:00100000:0.0:1788271815.400397:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577476992 00000100:00100000:0.0:1788271815.400452:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 78 00000100:00100000:0.0:1788271815.400462:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+33:11290:x1875138577476992:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 00010000:00010000:3.0:1788271815.400481:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078800/0x99288105fd38ea7b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.400493:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078800/0x99288105fd38ea7b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00000080:0.0:1788271815.400494:0:6483:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00010000:00010000:3.0:1788271815.400527:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f6d83058800) 00010000:00010000:3.0:1788271815.400530:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271815.400534:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078800/0x99288105fd38ea7b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.400540:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078800/0x99288105fd38ea7b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.400559:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38eaba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.400566:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38eaba lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.400574:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38eaba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271815.400658:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+32:11290:x1875138577476992:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 Request processed in 195us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271815.400667:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 78 00010000:00010000:3.0:1788271815.400692:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4ed4c00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271815.400696:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38eaba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.400702:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38eaba lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.400712:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f6d82060600) 00010000:00010000:3.0:1788271815.400714:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271815.400718:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38eaba lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.400724:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38eaba lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.400765:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38ebc4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.400772:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38ebc4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.400778:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38ebc4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.400784:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4079a00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271815.400788:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38ebc4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.400794:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38ebc4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.400804:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:3.0:1788271815.400806:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271815.400809:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38ebc4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.400815:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079a00/0x99288105fd38ebc4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.400826:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ebe7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.400831:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ebe7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.400837:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ebe7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.400849:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e813a0a00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271815.400853:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ebe7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.400859:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ebe7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.401006:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:3.0:1788271815.401009:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271815.401012:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ebe7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.401019:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ebe7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.401036:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078a00/0x99288105fd38ec2d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.401043:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078a00/0x99288105fd38ec2d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.401049:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078a00/0x99288105fd38ec2d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.401055:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4078a00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271815.401058:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078a00/0x99288105fd38ec2d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.401065:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078a00/0x99288105fd38ec2d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.401085:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:3.0:1788271815.401087:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271815.401091:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078a00/0x99288105fd38ec2d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.401097:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4078a00/0x99288105fd38ec2d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271815.401424:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788271815.401443:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e84d02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590140928:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788271815.401494:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271815.401573:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590140928 00000100:00100000:1.0:1788271815.401579:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590140928 00000100:00100000:1.0:1788271815.401645:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788271815.401655:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d833d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3609:x1875138590140928:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788271815.401676:0:8398:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:1.0:1788271815.401706:0:8398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a96dcc4, atime: 0x6a96dcc4, ctime: 0x6a96dcc4, blocks: 0x8 00010000:00010000:1.0:1788271815.401714:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9748023/0x99288105fd38ecd5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.401730:0:8398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=376s v=(0 0) 00010000:00010000:1.0:1788271815.401734:0:8398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271815.401741:0:8398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9748023/0x99288105fd38ecd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.401758:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9748023/0x99288105fd38ecd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.401769:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9748023/0x99288105fd38ecd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.401791:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9748023/0x99288105fd38ecd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.401806:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788271815.401939:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d833d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3609:x1875138590140928:12345-0@lo:6:osp-syn-0-0.0 Request processed in 286us (444us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788271815.401946:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1788271815.402194:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271815.402207:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9748023/0x99288105fd38ecd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.402215:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e92d32600 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:0.0:1788271815.402219:0:6471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9748023/0x99288105fd38ecd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.402228:0:6471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9748023/0x99288105fd38ecd5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.402245:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9748023/0x99288105fd38ecd5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.402251:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9748023/0x99288105fd38ecd5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.402272:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271815.402274:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271815.402275:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788271815.402304:0:3609:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f6e84d02300/2, rc 0, transno 4294967302 00000100:00100000:0.0:1788271815.402310:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e84d02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590140928:0@lo:6:osp-syn-0-0.0 00000020:00080000:2.0:1788271815.402455:0:6462:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f6eb3f2f900 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1788271815.402461:0:6462:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f6eb4f1de00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f6eb3f2fc00 00000020:00080000:2.0:1788271815.402465:0:6462:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f6eb4f1dc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f6eb0c66c00 00000020:00080000:0.0:1788271815.402657:0:6515:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1788271815.402815:0:6515:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1788271815.412167:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271815.412401:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577477120 00000100:00100000:0.0:1788271815.412415:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577477120 00000100:00100000:0.0:1788271815.412491:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 79 00000100:00100000:0.0:1788271815.412503:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+12:11290:x1875138577477120:12345-192.168.201.3@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788271815.412591:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c000/0x99288105fd38ecdc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.412609:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c000/0x99288105fd38ecdc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.412912:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c000/0x99288105fd38ecdc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.412973:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ece3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.412985:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ece3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.412993:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ece3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.413022:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38ecea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.413031:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38ecea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.413038:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38ecea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271815.413084:0:12164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788271815.413088:0:12164:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788271815.413105:0:12164:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38ecea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.413116:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c000/0x99288105fd38ecdc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.413129:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c000/0x99288105fd38ecdc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.413136:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c000/0x99288105fd38ecdc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.413142:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511c000 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271815.413146:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c000/0x99288105fd38ecdc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.413153:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c000/0x99288105fd38ecdc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.413165:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f6e90141900) 00010000:00010000:0.0:1788271815.413168:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271815.413173:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c000/0x99288105fd38ecdc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.413179:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c000/0x99288105fd38ecdc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.413192:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ece3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.413197:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ece3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.413202:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ece3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.413206:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511dc00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271815.413215:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ece3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.413220:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ece3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.413227:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff8f6d83058600) 00010000:00010000:0.0:1788271815.413341:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271815.413347:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ece3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.413353:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ece3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.413369:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38ecea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.413385:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38ecea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.413392:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38ecea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.413397:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511d200 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271815.413400:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38ecea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.413407:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38ecea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.413415:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:0.0:1788271815.413417:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271815.413427:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38ecea lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.413433:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38ecea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271815.413562:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+12:11290:x1875138577477120:12345-192.168.201.3@tcp:34:lhsmtool_posix.0 Request processed in 1060us (1409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271815.413571:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 79 00000100:00100000:0.0:1788271815.421445:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271815.422728:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577477376 00000100:00100000:2.0:1788271815.422739:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577477376 00000100:00100000:2.0:1788271815.422803:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 80 00000100:00100000:2.0:1788271815.422811:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d833d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+12:11290:x1875138577477376:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788271815.422829:0:9899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271815.422846:0:9899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ecf1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd4c2 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271815.422934:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21200/0x99288105fd38ecf8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271815.422946:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21200/0x99288105fd38ecf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271815.422955:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21200/0x99288105fd38ecf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271815.422963:0:9899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788271815.423029:0:9899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21200/0x99288105fd38ecf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271815.423035:0:9899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21200/0x99288105fd38ecf8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271815.423039:0:9899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21200/0x99288105fd38ecf8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271815.423043:0:9899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e21200 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271815.423046:0:9899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21200/0x99288105fd38ecf8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271815.423051:0:9899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21200/0x99288105fd38ecf8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271815.423068:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:2.0:1788271815.423070:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788271815.423073:0:9899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21200/0x99288105fd38ecf8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271815.423078:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21200/0x99288105fd38ecf8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271815.423108:0:9899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ecf1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4c2 expref: 14 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271815.423114:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f6e90141900) 00010000:00010000:2.0:1788271815.423115:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788271815.423118:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ecf1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4c2 expref: 14 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271815.423124:0:9899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e21e00, rc 0) 00000100:00100000:2.0:1788271815.427536:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d833d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+13:11290:x1875138577477376:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 4708us (6084us total) trans 4294967353 rc 301/301 00000100:00100000:2.0:1788271815.427549:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 80 00000100:00100000:1.0:1788271815.435175:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271815.435411:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577477504 00000100:00100000:0.0:1788271815.435423:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577477504 00000100:00100000:1.0:1788271815.435790:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 81 00000100:00100000:1.0:1788271815.435802:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e84d00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+13:11290:x1875138577477504:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788271815.435838:0:6484:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788271815.435953:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e84d00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+13:11290:x1875138577477504:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 Request processed in 153us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271815.435961:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 81 00000100:00100000:3.0:1788271815.447179:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271815.447387:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577477760 00000100:00100000:1.0:1788271815.447398:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577477760 00000100:00100000:1.0:1788271815.447464:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 82 00000100:00100000:1.0:1788271815.447475:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+13:11290:x1875138577477760:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788271815.447496:0:12164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271815.447500:0:12164:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788271815.447527:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c600/0x99288105fd38ecab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4b4 expref: 13 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.447548:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f6d83058800) 00010000:00010000:1.0:1788271815.447571:0:12164:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788271815.447588:0:12164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38ed06 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd4c9 expref: -99 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788271815.448451:0:12164:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1788271815.448594:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ed0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.448606:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ed0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.448616:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ed0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.449046:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38ed06 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4c9 expref: 15 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.449068:0:12164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ed0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4c9 expref: 14 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.449076:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f6d82060300) 00010000:00010000:1.0:1788271815.449079:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788271815.449082:0:12164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e92d32c00, rc 0) 00000100:00100000:1.0:1788271815.449273:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+14:11290:x1875138577477760:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 1798us (2104us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1788271815.449282:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 82 00000100:00100000:0.0:1788271815.464597:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271815.464840:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577478016 00000100:00100000:1.0:1788271815.464850:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577478016 00000100:00100000:1.0:1788271815.464904:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 83 00000100:00100000:1.0:1788271815.464915:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d833d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+14:11290:x1875138577478016:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788271815.465001:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271815.465028:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ed0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4c9 expref: 14 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.465044:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f6d82060300) 00010000:00010000:1.0:1788271815.465055:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788271815.465077:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ed1b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.465092:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ed1b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.465102:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ed1b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.465148:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38ed22 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x77b2c9d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.465156:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38ed22 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x77b2c9d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.465163:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38ed22 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x77b2c9d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.465209:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ed1b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.465217:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ed1b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.465223:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ed1b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.465235:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e92d33c00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271815.465240:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ed1b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.465246:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ed1b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.465255:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f6d83058800) 00010000:00010000:1.0:1788271815.465258:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271815.465262:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ed1b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.465268:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ed1b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.465278:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38ed22 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x77b2c9d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.465283:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38ed22 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x77b2c9d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.465289:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38ed22 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x77b2c9d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.465294:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e92d33000 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271815.465297:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38ed22 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x77b2c9d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.465303:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38ed22 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x77b2c9d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.465322:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x77b2c9d2 (ffff8f6d82060e00) 00010000:00010000:1.0:1788271815.465324:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271815.465327:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38ed22 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x77b2c9d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.465333:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38ed22 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x77b2c9d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271815.465422:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d833d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+13:11290:x1875138577478016:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 Request processed in 508us (831us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788271815.465430:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 83 00000100:00100000:2.0:1788271815.472133:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271815.472243:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577478144 00000100:00100000:3.0:1788271815.472254:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577478144 00000100:00100000:3.0:1788271815.472311:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 84 00000100:00100000:3.0:1788271815.472322:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+13:11290:x1875138577478144:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788271815.472344:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271815.472367:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5e00/0x99288105fd38ed29 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd4d0 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.472417:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ed30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.472430:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ed30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.472442:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ed30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.472555:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5e00/0x99288105fd38ed29 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4d0 expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.472586:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ed30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4d0 expref: 14 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.472595:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f6e8d1d8100) 00010000:00010000:3.0:1788271815.472598:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788271815.472601:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c4800, rc 0) 00000100:00100000:3.0:1788271815.472758:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+14:11290:x1875138577478144:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 437us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271815.472767:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 84 00000100:00100000:3.0:1788271815.477560:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271815.477694:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577478400 00000100:00100000:3.0:1788271815.477709:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577478400 00000100:00100000:3.0:1788271815.477784:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 85 00000100:00100000:3.0:1788271815.477796:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+14:11290:x1875138577478400:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788271815.478066:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5c00/0x99288105fd38ed37 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.478090:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5c00/0x99288105fd38ed37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.478104:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5c00/0x99288105fd38ed37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788271815.478352:0:12164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1788271815.478364:0:12164:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 376567744090ns, next at 377567740454ns, rc = 0 00000004:00010000:3.0:1788271815.478444:0:12164:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000701bb2ee reply state 000000004dac15d2 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5c00/0x99288105fd38ed37 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.478477:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5c00/0x99288105fd38ed37 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.478486:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f6e8d1d8100) 00010000:00010000:3.0:1788271815.478489:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788271815.478493:0:12164:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788271815.478654:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+16:11290:x1875138577478400:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 Request processed in 825us (1076us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788271815.478663:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 85 00000100:00100000:2.0:1788271815.486974:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271815.487050:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577478528 00000100:00100000:1.0:1788271815.487060:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577478528 00000100:00100000:1.0:1788271815.487117:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 86 00000100:00100000:1.0:1788271815.487131:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+16:11290:x1875138577478528:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788271815.487156:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271815.487178:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38ed3e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd4d7 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.487237:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38ed3e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4d7 expref: 17 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.487252:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38ed3e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4d7 expref: 17 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.487271:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f6e8d1d8100) 00010000:00010000:1.0:1788271815.487274:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788271815.487298:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e92d33000, rc 0) 00000100:00100000:1.0:1788271815.487365:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+17:11290:x1875138577478528:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 238us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271815.487383:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 86 00000100:00100000:2.0:1788271815.490046:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271815.490109:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577478656 00000100:00100000:3.0:1788271815.490119:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577478656 00000100:00100000:3.0:1788271815.490163:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 33 00000100:00100000:3.0:1788271815.490172:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83031c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2394:x1875138577478656:12345-192.168.201.3@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788271815.490206:0:8396:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from ef8df183-a1b1-4e56-bce5-924a894c4a71@192.168.201.3@tcp t0 exp 0000000000000000 cur 376 last 0 00000020:00000080:3.0:1788271815.490239:0:8396:0:(genops.c:1385:class_connect()) connect: client ef8df183-a1b1-4e56-bce5-924a894c4a71, cookie 0x99288105fd38ed45 00002000:00100000:3.0:1788271815.490252:0:8396:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ef8df183-a1b1-4e56-bce5-924a894c4a71/ffff8f6d838cb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788271815.490263:0:8396:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788271815.490344:0:8396:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788271815.490385:0:8396:0:(import.c:65:import_set_state_nolock()) ffff8f6d838cc800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788271815.490500:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83031c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2394:x1875138577478656:12345-192.168.201.3@tcp:8:lhsmtool_posix.0 Request processed in 327us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271815.490509:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 33 00000100:00100000:3.0:1788271815.494837:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271815.495107:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577478784 00000100:00100000:0.0:1788271815.495117:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577478784 00000100:00100000:0.0:1788271815.495189:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 34 00000100:00100000:0.0:1788271815.495200:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:0:x1875138577478784:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788271815.495392:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1788271815.503814:0:9475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:2.0:1788271815.503829:0:9475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ef8df183-a1b1-4e56-bce5-924a894c4a71 00000100:00100000:0.0:1788271815.504130:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:0:x1875138577478784:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 Request processed in 8926us (9297us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788271815.504142:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 34 00000100:00100000:0.0:1788271815.510716:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271815.510943:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577479040 00000100:00100000:1.0:1788271815.510953:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577479040 00000100:00100000:1.0:1788271815.511008:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 19 00000100:00100000:1.0:1788271815.511017:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d833d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+17:11290:x1875138577479040:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788271815.511228:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d833d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+18:11290:x1875138577479040:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 Request processed in 211us (521us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1788271815.511237:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 19 00000100:00100000:2.0:1788271815.514365:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271815.514739:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577479296 00000100:00100000:3.0:1788271815.514752:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577479296 00000100:00100000:3.0:1788271815.514807:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 87 00000100:00100000:3.0:1788271815.514824:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+18:11290:x1875138577479296:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788271815.514933:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83033480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+18:11290:x1875138577479296:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 Request processed in 111us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271815.514941:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 87 00000100:00100000:0.0:1788271815.533464:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271815.533799:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577479424 00000100:00100000:3.0:1788271815.533807:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577479424 00000100:00100000:3.0:1788271815.533857:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 88 00000100:00100000:3.0:1788271815.533867:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d833d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+18:11290:x1875138577479424:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788271815.533898:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271815.533918:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38ed4c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd4de expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.533989:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5200/0x99288105fd38ed53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.534001:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5200/0x99288105fd38ed53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.534009:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5200/0x99288105fd38ed53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271815.534048:0:6483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788271815.534062:0:6483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5200/0x99288105fd38ed53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.534080:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38ed4c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4de expref: 20 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.534093:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5200/0x99288105fd38ed53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4de expref: 19 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.534103:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f6e8d1d8100) 00010000:00010000:3.0:1788271815.534106:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788271815.534108:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c5200, rc 0) 00000100:00100000:3.0:1788271815.534164:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d833d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+19:11290:x1875138577479424:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 298us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271815.534171:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 88 00000100:00100000:0.0:1788271815.548690:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271815.548890:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577479552 00000100:00100000:1.0:1788271815.548901:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577479552 00000100:00100000:1.0:1788271815.548992:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 35 00000100:00100000:1.0:1788271815.549003:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2398:x1875138577479552:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788271815.549022:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271815.549045:0:8452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003cfd1bbe/0x99288105fd38ed5a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd4e5 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788271815.549070:0:8452:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96dcc6, blocks: 0x0 00010000:00010000:1.0:1788271815.549088:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=376s v=(0 0) 00010000:00010000:1.0:1788271815.549093:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271815.549102:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003cfd1bbe/0x99288105fd38ed5a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4e5 expref: 6 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.549121:0:8452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003cfd1bbe/0x99288105fd38ed5a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4e5 expref: 6 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.549142:0:8452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e92d32c00, rc 0) 00000100:00100000:1.0:1788271815.549205:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2398:x1875138577479552:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 204us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271815.549213:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 35 00000100:00100000:1.0:1788271815.554022:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271815.554100:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577479808 00000100:00100000:2.0:1788271815.554111:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577479808 00000100:00100000:2.0:1788271815.554169:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 89 00000100:00100000:2.0:1788271815.554180:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e84d02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+19:11290:x1875138577479808:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788271815.554293:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e84d02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+19:11290:x1875138577479808:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 Request processed in 114us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271815.554300:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 89 00000100:00100000:0.0:1788271815.565014:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271815.568805:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577479936 00000100:00100000:1.0:1788271815.568818:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577479936 00000100:00100000:1.0:1788271815.568887:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 36 00000100:00100000:1.0:1788271815.568898:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:11290:x1875138577479936:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788271815.568916:0:12967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271815.568935:0:12967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058ac21f9/0x99288105fd38ed61 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd4ec expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.568966:0:12967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003cfd1bbe/0x99288105fd38ed5a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4e5 expref: 7 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.568975:0:12967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271815.568979:0:12967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271815.568983:0:12967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058ac21f9/0x99288105fd38ed61 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4ec expref: 7 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.569014:0:12967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003cfd1bbe/0x99288105fd38ed5a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4e5 expref: 7 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.569028:0:12967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003cfd1bbe/0x99288105fd38ed5a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4e5 expref: 7 pid: 8452 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271815.569050:0:12967:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e84d00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12967:1875138590141056:192.168.201.3@tcp:104: 00000100:00100000:1.0:1788271815.569143:0:12967:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8161c180 going to sleep for 11 seconds 00000100:00100000:0.0:1788271815.583784:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271815.584073:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577480064 00000100:00100000:0.0:1788271815.584083:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577480064 00010000:00010000:0.0:1788271815.584121:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003cfd1bbe/0x99288105fd38ed5a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4e5 expref: 8 pid: 8452 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271815.584180:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 59 00000100:00100000:0.0:1788271815.584191:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0ccd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+8:2397:x1875138577480064:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271815.584206:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271815.584227:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003cfd1bbe/0x99288105fd38ed5a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4e5 expref: 8 pid: 8452 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.584243:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003cfd1bbe/0x99288105fd38ed5a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4e5 expref: 8 pid: 8452 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.584266:0:6468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271815.584270:0:6468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271815.584279:0:6468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000058ac21f9/0x99288105fd38ed61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4ec expref: 8 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.584290:0:6468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058ac21f9/0x99288105fd38ed61 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4ec expref: 8 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.584340:0:6468:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000058ac21f9/0x99288105fd38ed61 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4ec expref: 8 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271815.584355:0:6468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d839cc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6468:1875138590141184:192.168.201.3@tcp:105: 00000100:00100000:0.0:1788271815.584447:0:6468:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e856bb780 going to sleep for 11 seconds 00000040:00080000:1.0:1788271815.585238:0:14175:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788271815.585244:0:14175:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788271815.585268:0:14175:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788271815.585275:0:14175:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788271815.590721:0:6468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d839cc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6468:1875138590141184:192.168.201.3@tcp:105: 00010000:00010000:1.0:1788271815.590748:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271815.590802:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0ccd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+8:2397:x1875138577480064:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 6612us (7027us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271815.590813:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 59 00010000:00010000:2.0:1788271815.591111:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003cfd1bbe/0x99288105fd38ed5a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4e5 expref: 7 pid: 8452 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271815.591130:0:12967:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e84d00e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12967:1875138590141056:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788271815.591152:0:12967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000058ac21f9/0x99288105fd38ed61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4ec expref: 6 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271815.591167:0:12967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e92d33a00, rc 0) 00000100:00100000:2.0:1788271815.591194:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:11290:x1875138577479936:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 22299us (26190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271815.591201:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 36 00000100:00100000:0.0:1788271815.610758:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271815.613919:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577480192 00000100:00100000:1.0:1788271815.613935:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577480192 00002000:00100000:1.0:1788271815.613990:0:8403:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8f6d839cca80 x1875138577480192/t0(0) o4->ef8df183-a1b1-4e56-bce5-924a894c4a71@192.168.201.3@tcp:721/0 lens 504/0 e 0 to 0 dl 1788271826 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788271815.614002:0:8403:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f6d839cca80 with x1875138577480192 ext(0->8) 00002000:00010000:1.0:1788271815.614008:0:8403:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f6d839cca80 00000100:00100000:1.0:1788271815.614083:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 0 00000100:00100000:1.0:1788271815.614094:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2395:x1875138577480192:12345-192.168.201.3@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788271815.615191:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+8:2395:x1875138577480192:12345-192.168.201.3@tcp:4:lhsmtool_posix.0 Request processed in 1093us (4436us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788271815.615202:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 0 00002000:00100000:1.0:1788271815.615212:0:8403:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8f6d839cca80 x1875138577480192/t4294967303(0) o4->ef8df183-a1b1-4e56-bce5-924a894c4a71@192.168.201.3@tcp:721/0 lens 504/448 e 0 to 0 dl 1788271826 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788271815.615232:0:8403:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f6d839cca80 with x1875138577480192 ext(0->8) 00002000:00010000:1.0:1788271815.615237:0:8403:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f6d839cca80 00000100:00100000:1.0:1788271815.618200:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271815.618271:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577480320 00000100:00100000:3.0:1788271815.618280:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577480320 00000100:00100000:3.0:1788271815.618329:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 90 00000100:00100000:3.0:1788271815.618338:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e84d03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+19:11290:x1875138577480320:12345-192.168.201.3@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788271815.620273:0:6462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:2.0:1788271815.620287:0:6462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788271815.620317:0:6462:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:3.0:1788271815.620840:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e84d03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+15:11290:x1875138577480320:12345-192.168.201.3@tcp:44:lhsmtool_posix.0 Request processed in 2497us (2640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271815.620850:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 90 00000020:00080000:0.0:1788271815.621005:0:6515:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1788271815.621024:0:6515:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788271815.621497:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d839ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590141312:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788271815.621545:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271815.621676:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590141312 00000100:00100000:2.0:1788271815.621684:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590141312 00000100:00100000:2.0:1788271815.621734:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788271815.621743:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590141312:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788271815.621867:0:8397:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788271815.621878:0:8397:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788271815 00002000:00010000:2.0:1788271815.621881:0:8397:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788271815.621883:0:8397:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788271814 -> 1788271815 00002000:00010000:2.0:1788271815.621885:0:8397:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788271815.621923:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3609:x1875138590141312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 181us (377us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788271815.621931:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:3.0:1788271815.622055:0:3609:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f6d839ce300/2, rc 0, transno 4294967304 00000100:00100000:3.0:1788271815.622062:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d839ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590141312:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1788271815.624405:0:3592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5c00/0x99288105fd38ed37 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.624420:0:3592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5c00/0x99288105fd38ed37 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.624428:0:3592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5c00/0x99288105fd38ed37 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.624433:0:3592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c5c00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271815.624438:0:3592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5c00/0x99288105fd38ed37 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.624446:0:3592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5c00/0x99288105fd38ed37 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.624463:0:3592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f6e8d1d8100) 00010000:00010000:1.0:1788271815.624466:0:3592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788271815.624470:0:3592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5c00/0x99288105fd38ed37 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.624476:0:3592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5c00/0x99288105fd38ed37 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271815.629030:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271815.629104:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577480448 00000100:00100000:2.0:1788271815.629113:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577480448 00000100:00100000:2.0:1788271815.629168:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 38 00000100:00100000:2.0:1788271815.629178:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e84d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+8:2397:x1875138577480448:12345-192.168.201.3@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788271815.633020:0:9475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1788271815.633042:0:9475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1788271815.633195:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e84d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2397:x1875138577480448:12345-192.168.201.3@tcp:16:lhsmtool_posix.0 Request processed in 4013us (4170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271815.633220:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 38 00000100:00100000:3.0:1788271815.635575:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271815.635695:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577480704 00000100:00100000:1.0:1788271815.635706:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577480704 00000100:00100000:1.0:1788271815.635773:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 91 00000100:00100000:1.0:1788271815.635784:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+14:11290:x1875138577480704:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788271815.635837:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271815.635865:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5200/0x99288105fd38ed53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4de expref: 14 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.635884:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f6e8d1d8100) 00010000:00010000:1.0:1788271815.635889:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788271815.635919:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ed68 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.635933:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ed68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.635943:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ed68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788271815.636060:0:6483:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c28730fd reply state 0000000016621389 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ed68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.636074:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ed68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.636080:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f6e8d1d8100) 00010000:00010000:1.0:1788271815.636083:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788271815.636093:0:6483:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788271815.636185:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+15:11290:x1875138577480704:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 Request processed in 402us (616us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1788271815.636193:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 91 00000100:00100000:0.0:1788271815.638608:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271815.638669:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577480832 00000100:00100000:2.0:1788271815.638680:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577480832 00000100:00100000:2.0:1788271815.638737:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 39 00000100:00100000:2.0:1788271815.638748:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2398:x1875138577480832:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788271815.638896:0:12967:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788271815.638899:0:12967:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788271815 -> 1788271813 00002000:00010000:2.0:1788271815.638902:0:12967:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788271812 00002000:00010000:2.0:1788271815.638905:0:12967:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788271815 -> 1788271813 00002000:00010000:2.0:1788271815.638907:0:12967:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788271815.638968:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2398:x1875138577480832:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 Request processed in 222us (370us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788271815.638977:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 39 00000100:00100000:3.0:1788271815.642023:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271815.642435:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577481088 00000100:00100000:2.0:1788271815.642444:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577481088 00000100:00100000:2.0:1788271815.642505:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 92 00000100:00100000:2.0:1788271815.642514:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+15:11290:x1875138577481088:12345-192.168.201.3@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788271815.642577:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ed6f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271815.642594:0:9899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ed30 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4d0 expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271815.642603:0:9899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ed6f lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271815.642656:0:9899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ed30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4d0 expref: 15 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271815.642671:0:9899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ed30 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4d0 expref: 15 pid: 6484 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271815.642686:0:9899:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83030380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9899:1875138590141440:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788271815.642778:0:9899:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e830210c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271815.650422:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271815.650454:0:9486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577481216 00000100:00100000:0.0:1788271815.650463:0:9486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577481216 00010000:00010000:0.0:1788271815.650503:0:9486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ed30 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4d0 expref: 16 pid: 6484 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271815.650534:0:9486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 60 00000100:00100000:0.0:1788271815.650542:0:9486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+16:2397:x1875138577481216:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271815.650556:0:9486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271815.650564:0:9486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ed30 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4d0 expref: 16 pid: 6484 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.650578:0:9486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ed30 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4d0 expref: 16 pid: 6484 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.650599:0:9486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f6e8d1d8100) 00010000:00010000:0.0:1788271815.650604:0:9486:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ed6f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.650660:0:9486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ed6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.650669:0:9486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ed6f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.650686:0:9486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271815.650732:0:9486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+16:2397:x1875138577481216:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 191us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271815.650749:0:9486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 60 00010000:00010000:3.0:1788271815.651474:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ed30 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4d0 expref: 15 pid: 6484 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271815.651494:0:9899:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83030380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9899:1875138590141440:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788271815.651514:0:9899:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ed6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.651531:0:9899:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ed6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.651538:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ed6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.651576:0:9899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ed6f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.651584:0:9899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ed6f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.651592:0:9899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ed6f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.651599:0:9899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e21e00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271815.651603:0:9899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ed6f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.651611:0:9899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ed6f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.651649:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f6e8d1d8100) 00010000:00010000:3.0:1788271815.651652:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788271815.651657:0:9899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ed6f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.651664:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ed6f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271815.651715:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+14:11290:x1875138577481088:12345-192.168.201.3@tcp:55:lhsmtool_posix.0 Request processed in 9202us (9702us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788271815.651730:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 92 00000100:00100000:0.0:1788271815.654298:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271815.654375:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577481344 00000100:00100000:3.0:1788271815.654385:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577481344 00000100:00100000:3.0:1788271815.654444:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 40 00000100:00100000:3.0:1788271815.654454:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2395:x1875138577481344:12345-192.168.201.3@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788271815.654504:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000faf53b37/0x99288105fd38ed76 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.654524:0:8396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000058ac21f9/0x99288105fd38ed61 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4ec expref: 7 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.654533:0:8396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271815.654537:0:8396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788271815.654542:0:8396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000faf53b37/0x99288105fd38ed76 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.654576:0:8396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000058ac21f9/0x99288105fd38ed61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4ec expref: 7 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.654590:0:8396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000058ac21f9/0x99288105fd38ed61 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4ec expref: 7 pid: 12967 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271815.654603:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfc79880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8396:1875138590141568:192.168.201.3@tcp:104: 00000100:00100000:3.0:1788271815.654810:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ea686a540 going to sleep for 11 seconds 00000100:00100000:3.0:1788271815.661245:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271815.661343:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfc79880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8396:1875138590141568:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788271815.661383:0:8396:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000faf53b37/0x99288105fd38ed76 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271815.661446:0:9485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577481472 00000100:00100000:1.0:1788271815.661454:0:9485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577481472 00010000:00010000:1.0:1788271815.661490:0:9485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000058ac21f9/0x99288105fd38ed61 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4ec expref: 8 pid: 12967 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271815.661532:0:9485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 61 00000100:00100000:1.0:1788271815.661539:0:9485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+8:2397:x1875138577481472:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271815.661553:0:9485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271815.661576:0:9485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000058ac21f9/0x99288105fd38ed61 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4ec expref: 8 pid: 12967 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.661589:0:9485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000058ac21f9/0x99288105fd38ed61 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4ec expref: 8 pid: 12967 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.661612:0:9485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058ac21f9/0x99288105fd38ed61 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4ec expref: 8 pid: 12967 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.661660:0:9485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788271815.661664:0:9485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788271815.661670:0:9485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000faf53b37/0x99288105fd38ed76 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.661680:0:9485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000faf53b37/0x99288105fd38ed76 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.661716:0:9485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271815.661769:0:9485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2397:x1875138577481472:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 229us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271815.661777:0:9485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 61 00010000:00010000:2.0:1788271815.661939:0:8396:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000faf53b37/0x99288105fd38ed76 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271815.661949:0:8396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000faf53b37/0x99288105fd38ed76 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271815.661977:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000faf53b37/0x99288105fd38ed76 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271815.661986:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000faf53b37/0x99288105fd38ed76 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271815.661995:0:8396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000faf53b37/0x99288105fd38ed76 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271815.662002:0:8396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4000 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:2.0:1788271815.662006:0:8396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000faf53b37/0x99288105fd38ed76 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271815.662016:0:8396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000faf53b37/0x99288105fd38ed76 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271815.662032:0:8396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000faf53b37/0x99288105fd38ed76 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271815.662040:0:8396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000faf53b37/0x99288105fd38ed76 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271815.662103:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2395:x1875138577481344:12345-192.168.201.3@tcp:1:lhsmtool_posix.0 Request processed in 7649us (7812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271815.662111:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 40 00000100:00100000:3.0:1788271815.664597:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271815.670852:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577481728 00000100:00100000:1.0:1788271815.670868:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577481728 00000100:00100000:1.0:1788271815.670985:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 93 00000100:00100000:1.0:1788271815.670996:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+14:11290:x1875138577481728:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788271815.671070:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38ed7d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.671088:0:12164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38ebbd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd475 expref: 14 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.671098:0:12164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38ed7d lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.671131:0:12164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38ebbd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd475 expref: 14 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.671144:0:12164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38ebbd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd475 expref: 14 pid: 9899 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271815.671158:0:12164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e84d01c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12164:1875138590141696:192.168.201.3@tcp:104: 00000100:00100000:1.0:1788271815.671249:0:12164:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e8d060840 going to sleep for 11 seconds 00000100:00100000:1.0:1788271815.674600:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271815.674726:0:12164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e84d01c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12164:1875138590141696:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788271815.674756:0:12164:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38ed7d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271815.678864:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577481856 00000100:00100000:0.0:1788271815.678944:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577481856 00010000:00010000:0.0:1788271815.678992:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38ebbd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd475 expref: 15 pid: 9899 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271815.679041:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 62 00000100:00100000:0.0:1788271815.679051:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3599850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+15:2398:x1875138577481856:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271815.679066:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271815.679073:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38ebbd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd475 expref: 15 pid: 9899 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.679087:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38ebbd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd475 expref: 15 pid: 9899 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.679108:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38ebbd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd475 expref: 15 pid: 9899 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.679123:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:0.0:1788271815.679128:0:6468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38ed7d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.679137:0:6468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38ed7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.679145:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38ed7d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.679240:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271815.679313:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3599850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+14:2398:x1875138577481856:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 262us (4718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271815.679322:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 62 00010000:00010000:1.0:1788271815.680081:0:12164:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38ed7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.680094:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38ed7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.680267:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ed84 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.680281:0:12164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38ed3e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4d7 expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.680289:0:12164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ed84 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.680322:0:12164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38ed3e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4d7 expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.680335:0:12164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38ed3e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4d7 expref: 14 pid: 6485 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271815.680349:0:12164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e84d02a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12164:1875138590141824:192.168.201.3@tcp:104: 00000100:00100000:1.0:1788271815.680467:0:12164:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb3f2f900 going to sleep for 11 seconds 00000100:00100000:1.0:1788271815.688048:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271815.688129:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577481984 00000100:00100000:2.0:1788271815.688137:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577481984 00010000:00010000:2.0:1788271815.688176:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38ed3e lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4d7 expref: 15 pid: 6485 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271815.688218:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 63 00000100:00100000:2.0:1788271815.688228:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e84d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+15:2397:x1875138577481984:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271815.688242:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271815.688249:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38ed3e lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4d7 expref: 15 pid: 6485 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271815.688263:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38ed3e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4d7 expref: 15 pid: 6485 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271815.688286:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f6e8d1d8100) 00010000:00010000:2.0:1788271815.688291:0:6469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ed84 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271815.688300:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ed84 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271815.688307:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ed84 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271815.688326:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271815.688392:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e84d03b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+15:2397:x1875138577481984:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 165us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271815.688400:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 63 00010000:00010000:3.0:1788271815.688814:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38ed3e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4d7 expref: 14 pid: 6485 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271815.688830:0:12164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e84d02a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12164:1875138590141824:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788271815.688851:0:12164:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ed84 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.688859:0:12164:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ed84 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.688865:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ed84 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788271815.688970:0:12164:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1788271815.689094:0:12164:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1788271815.689130:0:12164:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:3.0:1788271815.689202:0:12164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfc7a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12164:1875138590141952:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788271815.689247:0:12164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271815.689278:0:12164:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb35cf600 going to sleep for 11 seconds 00000100:00100000:1.0:1788271815.689331:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590141952 00000100:00100000:1.0:1788271815.689336:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590141952 00000100:00100000:1.0:1788271815.689384:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788271815.689392:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:12164:x1875138590141952:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788271815.689469:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:12164:x1875138590141952:12345-0@lo:1000:mdt00_004.0 Request processed in 78us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271815.689487:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788271815.689580:0:12164:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1788271815.689585:0:12164:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f6d839ce300, transno 4294967304 00000100:00100000:3.0:1788271815.689605:0:12164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfc7a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12164:1875138590141952:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1788271815.689723:0:12164:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1788271815.689759:0:12164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfc7a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12164:1875138590142080:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788271815.689791:0:12164:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271815.689813:0:12164:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb35cf000 going to sleep for 11 seconds 00000100:00100000:2.0:1788271815.689862:0:14136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590142080 00000100:00100000:2.0:1788271815.689872:0:14136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590142080 00000100:00100000:2.0:1788271815.689902:0:14136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788271815.689909:0:14136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:12164:x1875138590142080:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788271815.690004:0:14136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:12164:x1875138590142080:12345-0@lo:1000:mdt00_004.0 Request processed in 95us (211us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788271815.690011:0:14136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788271815.690134:0:12164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfc7a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12164:1875138590142080:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1788271815.690161:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ed84 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.690170:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ed84 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.690177:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ed84 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.690183:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e92d33c00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271815.690187:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ed84 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.690195:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ed84 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.690207:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f6e8d1d8100) 00010000:00010000:3.0:1788271815.690209:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788271815.690213:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ed84 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.690219:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ed84 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.690246:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5800/0x99288105fd38ecb2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.690253:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5800/0x99288105fd38ecb2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.690264:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5800/0x99288105fd38ecb2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.690270:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c5800 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271815.690273:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5800/0x99288105fd38ecb2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.690279:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5800/0x99288105fd38ecb2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.690287:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:3.0:1788271815.690289:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788271815.690292:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5800/0x99288105fd38ecb2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.690298:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5800/0x99288105fd38ecb2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.690322:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ed8b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.690333:0:12164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38ecce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4bb expref: 17 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.690341:0:12164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ed8b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.690363:0:12164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38ecce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4bb expref: 17 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.690396:0:12164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38ecce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4bb expref: 17 pid: 9899 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271815.690408:0:12164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfc79180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12164:1875138590142208:192.168.201.3@tcp:104: 00000100:00100000:3.0:1788271815.690499:0:12164:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e90c463c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271815.696031:0:12164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfc79180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12164:1875138590142208:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788271815.696061:0:12164:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ed8b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271815.696986:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271815.697064:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577482112 00000100:00100000:3.0:1788271815.697071:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577482112 00010000:00010000:3.0:1788271815.697107:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38ecce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4bb expref: 18 pid: 9899 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271815.697146:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 64 00000100:00100000:3.0:1788271815.697156:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83033100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+18:2398:x1875138577482112:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788271815.697171:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271815.697178:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38ecce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4bb expref: 18 pid: 9899 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.697190:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38ecce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4bb expref: 18 pid: 9899 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.697210:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38ecce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4bb expref: 18 pid: 9899 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.697238:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:3.0:1788271815.697243:0:6470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ed8b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.697253:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ed8b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.697260:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ed8b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271815.697295:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271815.697341:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83033100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+17:2398:x1875138577482112:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 185us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271815.697348:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 64 00010000:00010000:0.0:1788271815.697418:0:12164:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ed8b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.697426:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ed8b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.697438:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ed8b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.697445:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ed8b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.697452:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ed8b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.697458:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4800 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271815.697462:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ed8b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.697469:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ed8b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.697478:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:0.0:1788271815.697481:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271815.697484:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ed8b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.697502:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ed8b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.697517:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38ed7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.697523:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38ed7d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.697529:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38ed7d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.697534:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e92d33e00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271815.697537:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38ed7d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.697544:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38ed7d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.697552:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:0.0:1788271815.697554:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788271815.697557:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38ed7d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271815.697564:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38ed7d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271815.697729:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+16:11290:x1875138577481728:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 Request processed in 26735us (33140us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1788271815.697737:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 93 00000020:00080000:0.0:1788271815.697747:0:12164:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788271815.698024:0:13762:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788271815.698029:0:13762:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788271815.698045:0:13762:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788271815.698052:0:13762:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788271815.705848:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271815.705924:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577482368 00000100:00100000:2.0:1788271815.705934:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577482368 00000100:00100000:2.0:1788271815.705993:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 20 00000100:00100000:2.0:1788271815.706003:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e84d01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+16:11290:x1875138577482368:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788271815.706260:0:6486:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788271815.706294:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:2.0:1788271815.706329:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ed92 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271815.706345:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ed92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271815.706357:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ed92 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271815.706375:0:6486:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ed92 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271815.706381:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ed92 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271815.706388:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ed92 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271815.706412:0:6486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788271815.706486:0:8412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271815.706493:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ed92 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.706499:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e21e00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:1.0:1788271815.706503:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ed92 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.706511:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ed92 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.706524:0:8412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f6e8d1d8100) 00010000:00010000:1.0:1788271815.706527:0:8412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788271815.706531:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ed92 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.706537:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ed92 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271815.706548:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271815.706549:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271815.706551:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271815.708438:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e84d01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+18:11290:x1875138577482368:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 Request processed in 2431us (2594us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1788271815.708449:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 20 00000020:00080000:2.0:1788271815.708454:0:6486:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788271816.093936:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271817.119206:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788271817.266281:0:14226:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788271817.266290:0:14226:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788271817.266395:0:14226:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788271817.266403:0:14226:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788271817.421974:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271817.422124:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577482624 00000100:00100000:2.0:1788271817.422134:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577482624 00000100:00080000:3.0:1788271817.422193:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788271817.422292:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 94 00000100:00100000:2.0:1788271817.422305:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+18:11309:x1875138577482624:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788271817.422361:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271817.422384:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38ed99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd4f3 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.422491:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21200/0x99288105fd38eda0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.422502:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21200/0x99288105fd38eda0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.422511:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21200/0x99288105fd38eda0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271817.422519:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788271817.423742:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38ed99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4f3 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.423765:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21200/0x99288105fd38eda0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4f3 expref: 20 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.423785:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f6d83058800) 00010000:00010000:2.0:1788271817.423787:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788271817.423790:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e21200, rc 0) 00000100:00100000:2.0:1788271817.424006:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+20:11309:x1875138577482624:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 1703us (2041us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1788271817.424015:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 94 00000100:00100000:1.0:1788271817.432826:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271817.432934:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577482752 00000100:00100000:3.0:1788271817.432944:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577482752 00000100:00100000:3.0:1788271817.433038:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 95 00000100:00100000:3.0:1788271817.433050:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e84d00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+20:11309:x1875138577482752:12345-192.168.201.3@tcp:34:lfs.0 00010000:00010000:3.0:1788271817.433141:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5800/0x99288105fd38edae lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.433159:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5800/0x99288105fd38edae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.433170:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5800/0x99288105fd38edae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.433187:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5e00/0x99288105fd38edb5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.433194:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5e00/0x99288105fd38edb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.433200:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5e00/0x99288105fd38edb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.433280:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38edbc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.433288:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38edbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.433295:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38edbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788271817.433361:0:9899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38edbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.433373:0:9899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5800/0x99288105fd38edae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.433388:0:9899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5800/0x99288105fd38edae lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.433395:0:9899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5800/0x99288105fd38edae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.433401:0:9899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c5800 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271817.433406:0:9899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5800/0x99288105fd38edae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.433414:0:9899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5800/0x99288105fd38edae lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.433425:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f6d83058800) 00010000:00010000:3.0:1788271817.433429:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271817.433433:0:9899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5800/0x99288105fd38edae lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.433439:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5800/0x99288105fd38edae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.433453:0:9899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5e00/0x99288105fd38edb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.433458:0:9899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5e00/0x99288105fd38edb5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.433463:0:9899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5e00/0x99288105fd38edb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.433467:0:9899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c5e00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271817.433474:0:9899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5e00/0x99288105fd38edb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.433480:0:9899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5e00/0x99288105fd38edb5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.433486:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f6e8d1d8200) 00010000:00010000:3.0:1788271817.433489:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271817.433492:0:9899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5e00/0x99288105fd38edb5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.433497:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5e00/0x99288105fd38edb5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.433510:0:9899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38edbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.433515:0:9899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38edbc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.433521:0:9899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38edbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.433525:0:9899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c5000 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271817.433528:0:9899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38edbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.433534:0:9899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38edbc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.433540:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6e8d1d8e00) 00010000:00010000:3.0:1788271817.433542:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271817.433550:0:9899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38edbc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.433556:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38edbc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271817.433683:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e84d00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+20:11309:x1875138577482752:12345-192.168.201.3@tcp:34:lfs.0 Request processed in 634us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271817.433691:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 95 00000100:00100000:3.0:1788271817.479261:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271817.479389:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577483008 00000100:00100000:0.0:1788271817.479399:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577483008 00000100:00100000:0.0:1788271817.479449:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 96 00000100:00100000:0.0:1788271817.479458:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+20:11312:x1875138577483008:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:0.0:1788271817.479476:0:12164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271817.479494:0:12164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d000/0x99288105fd38edc3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd4fa expref: -99 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.479563:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c000/0x99288105fd38edca lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.479578:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c000/0x99288105fd38edca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.479590:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c000/0x99288105fd38edca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.479605:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38edd1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.479612:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38edd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.479661:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38edd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.479764:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c600/0x99288105fd38edd8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.479770:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c600/0x99288105fd38edd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.479789:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c600/0x99288105fd38edd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271817.479797:0:12164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:0.0:1788271817.479865:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c000/0x99288105fd38edca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.479872:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c000/0x99288105fd38edca lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.479879:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c000/0x99288105fd38edca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.479885:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511c000 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271817.479891:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c000/0x99288105fd38edca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.479898:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c000/0x99288105fd38edca lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.479910:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f6d83058800) 00010000:00010000:0.0:1788271817.479913:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271817.479917:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c000/0x99288105fd38edca lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.479921:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c000/0x99288105fd38edca lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.479930:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38edd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.479934:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38edd1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.479942:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38edd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.479945:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511dc00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271817.479947:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38edd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.479950:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38edd1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.479955:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f6d83058f00) 00010000:00010000:0.0:1788271817.479956:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271817.479958:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38edd1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.479961:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38edd1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.479991:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d000/0x99288105fd38edc3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4fa expref: 23 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.479999:0:12164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c600/0x99288105fd38edd8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4fa expref: 22 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.480004:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d83058600) 00010000:00010000:0.0:1788271817.480005:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788271817.480007:0:12164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e8511c600, rc 0) 00000100:00100000:0.0:1788271817.480050:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+22:11312:x1875138577483008:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 595us (801us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1788271817.480061:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 96 00000100:00100000:0.0:1788271817.482551:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271817.485752:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577483136 00000100:00100000:2.0:1788271817.485767:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577483136 00000100:00100000:3.0:1788271817.485912:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 97 00000100:00100000:3.0:1788271817.485922:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+22:11312:x1875138577483136:12345-192.168.201.3@tcp:54:lfs.0 00010000:00010000:3.0:1788271817.485991:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38ede6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.486008:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38ede6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.486018:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38ede6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.486051:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38ede6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.486058:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38ede6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.486064:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38ede6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.486080:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c5000 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271817.486084:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38ede6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.486103:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38ede6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.486115:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d83058600) 00010000:00010000:3.0:1788271817.486118:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788271817.486122:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38ede6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.486129:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38ede6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271817.486211:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+22:11312:x1875138577483136:12345-192.168.201.3@tcp:54:lfs.0 Request processed in 290us (3670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271817.486219:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 97 00000100:00100000:1.0:1788271817.489286:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271817.489382:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577483392 00000100:00100000:2.0:1788271817.489392:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577483392 00000100:00100000:2.0:1788271817.489451:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 21 00000100:00100000:2.0:1788271817.489461:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb36ac450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+22:11312:x1875138577483392:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:2.0:1788271817.489711:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb36ac450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+23:11312:x1875138577483392:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 250us (432us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1788271817.489718:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 21 00000100:00100000:2.0:1788271817.525835:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271817.526183:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577483648 00000100:00100000:3.0:1788271817.526194:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577483648 00000100:00100000:3.0:1788271817.526263:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 98 00000100:00100000:3.0:1788271817.526274:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83030a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+23:10829:x1875138577483648:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:3.0:1788271817.526302:0:9899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271817.526326:0:9899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38eded lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd501 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.526443:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5e00/0x99288105fd38edf4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.526459:0:9899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c600/0x99288105fd38edd8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4fa expref: 24 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.526467:0:9899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5e00/0x99288105fd38edf4 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.526516:0:9899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c600/0x99288105fd38edd8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4fa expref: 24 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.526529:0:9899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c600/0x99288105fd38edd8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4fa expref: 24 pid: 12164 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271817.526542:0:9899:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfc79880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9899:1875138590142336:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788271817.527701:0:9899:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d821f8900 going to sleep for 11 seconds 00000100:00100000:2.0:1788271817.529695:0:9899:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfc79880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9899:1875138590142336:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788271817.529722:0:9899:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5e00/0x99288105fd38edf4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271817.530027:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271817.530104:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577483776 00000100:00100000:0.0:1788271817.530111:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577483776 00010000:00010000:0.0:1788271817.530150:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c600/0x99288105fd38edd8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4fa expref: 25 pid: 12164 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271817.530187:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 65 00000100:00100000:0.0:1788271817.530195:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83032680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+25:2398:x1875138577483776:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271817.530209:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271817.530215:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c600/0x99288105fd38edd8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4fa expref: 25 pid: 12164 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.530227:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c600/0x99288105fd38edd8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4fa expref: 25 pid: 12164 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.530249:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c600/0x99288105fd38edd8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4fa expref: 25 pid: 12164 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.530266:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d83058600) 00010000:00010000:0.0:1788271817.530271:0:6468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5e00/0x99288105fd38edf4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.530281:0:6468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5e00/0x99288105fd38edf4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.530287:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5e00/0x99288105fd38edf4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.530341:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271817.530397:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83032680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+24:2398:x1875138577483776:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 201us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271817.530404:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 65 00010000:00010000:3.0:1788271817.530517:0:9899:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5e00/0x99288105fd38edf4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.530525:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5e00/0x99288105fd38edf4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271817.530543:0:9899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788271817.530701:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38eded lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd501 expref: 25 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.530719:0:9899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5e00/0x99288105fd38edf4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd501 expref: 24 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.530726:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d83058600) 00010000:00010000:3.0:1788271817.530728:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788271817.530731:0:9899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c5e00, rc 0) 00000100:00100000:3.0:1788271817.530755:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83030a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+24:10829:x1875138577483648:12345-192.168.201.3@tcp:101:bash.0 Request processed in 4483us (4931us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1788271817.530761:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 98 00000100:00100000:0.0:1788271817.546395:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271817.546493:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577483904 00000100:00100000:3.0:1788271817.546515:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577483904 00000100:00100000:3.0:1788271817.546581:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 99 00000100:00100000:3.0:1788271817.546601:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+24:10829:x1875138577483904:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:3.0:1788271817.546662:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271817.546684:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38ee02 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd508 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.546725:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5800/0x99288105fd38ee09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.546740:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5800/0x99288105fd38ee09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.546752:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5800/0x99288105fd38ee09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.546869:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38ee02 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd508 expref: 26 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.546893:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5800/0x99288105fd38ee09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd508 expref: 25 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.546901:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d83058600) 00010000:00010000:3.0:1788271817.546904:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788271817.546908:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c5800, rc 0) 00000100:00100000:3.0:1788271817.546972:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+25:10829:x1875138577483904:12345-192.168.201.3@tcp:101:bash.0 Request processed in 373us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271817.546979:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 99 00000100:00100000:1.0:1788271817.558483:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271817.558585:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577484160 00000100:00100000:3.0:1788271817.558669:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577484160 00000100:00100000:3.0:1788271817.558755:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 100 00000100:00100000:3.0:1788271817.558769:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e84d01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+25:10829:x1875138577484160:12345-192.168.201.3@tcp:36:bash.0 00010000:00010000:3.0:1788271817.560240:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38ee10 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.560268:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38ee10 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.560281:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38ee10 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788271817.560349:0:6483:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:3.0:1788271817.560377:0:6483:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec76ba35 reply state 0000000082ac75d5 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38ee10 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.560392:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38ee10 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.560401:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d83058600) 00010000:00010000:3.0:1788271817.560405:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788271817.560410:0:6483:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788271817.560451:0:6483:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:3.0:1788271817.560599:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e84d01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+29:10829:x1875138577484160:12345-192.168.201.3@tcp:36:bash.0 Request processed in 1828us (2121us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1788271817.560609:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 100 00000020:00080000:3.0:1788271817.560649:0:6483:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788271817.564406:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271817.564518:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577484288 00000100:00100000:3.0:1788271817.564529:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577484288 00000100:00100000:3.0:1788271817.564688:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 101 00000100:00100000:3.0:1788271817.564698:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83030380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+29:10829:x1875138577484288:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:3.0:1788271817.564734:0:9899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271817.564754:0:9899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38ee17 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd50f expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.564811:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38ee17 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd50f expref: 30 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.564824:0:9899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38ee17 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd50f expref: 30 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.564841:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d83058600) 00010000:00010000:3.0:1788271817.564844:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788271817.564848:0:9899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c4400, rc 0) 00000100:00100000:3.0:1788271817.564903:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83030380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+30:10829:x1875138577484288:12345-192.168.201.3@tcp:101:bash.0 Request processed in 206us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271817.564911:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 101 00000100:00100000:0.0:1788271817.571788:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271817.571896:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577484416 00000100:00100000:1.0:1788271817.571906:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577484416 00000100:00100000:1.0:1788271817.571977:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 41 00000100:00100000:1.0:1788271817.571988:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:10829:x1875138577484416:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:1.0:1788271817.572017:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271817.572036:0:8452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066172fcb/0x99288105fd38ee1e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd516 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788271817.572060:0:8452:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a96dcc5, atime: 0x6a96dcc4, ctime: 0x6a96dcc5, blocks: 0x8 00010000:00010000:1.0:1788271817.572089:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=378s v=(0 0) 00010000:00010000:1.0:1788271817.572094:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271817.572103:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066172fcb/0x99288105fd38ee1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd516 expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271817.572120:0:8452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000066172fcb/0x99288105fd38ee1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd516 expref: 7 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271817.572133:0:8452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e92d33000, rc 0) 00000100:00100000:1.0:1788271817.572191:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:10829:x1875138577484416:12345-192.168.201.3@tcp:101:bash.0 Request processed in 205us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271817.572198:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 41 00000100:00080000:3.0:1788271817.572511:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788271817.578224:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271817.578394:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577484544 00000100:00100000:1.0:1788271817.578404:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577484544 00002000:00010000:1.0:1788271817.578440:0:8401:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:1.0:1788271817.578444:0:8401:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f6d833d5880 with x1875138577484544 ext(0->18446744073709551615) 00002000:00010000:1.0:1788271817.578455:0:8401:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f6d833d5880. 00000100:00100000:1.0:1788271817.578483:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 1 00000100:00100000:1.0:1788271817.578490:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d833d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2397:x1875138577484544:12345-192.168.201.3@tcp:10:bash.0 00002000:00010000:1.0:1788271817.578746:0:8401:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788271817.578756:0:8401:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788271813 -> 1788271816 00002000:00010000:1.0:1788271817.578758:0:8401:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1788271812 -> 1788271812 00002000:00010000:1.0:1788271817.578760:0:8401:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788271813 -> 1788271816 00002000:00010000:1.0:1788271817.578761:0:8401:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1788271817.578812:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d833d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+8:2397:x1875138577484544:12345-192.168.201.3@tcp:10:bash.0 Request processed in 323us (598us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788271817.578818:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 1 00002000:00010000:1.0:1788271817.578820:0:8401:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:1.0:1788271817.578822:0:8401:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f6d833d5880 with x1875138577484544 ext(0->18446744073709551615) 00002000:00010000:1.0:1788271817.578825:0:8401:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f6d833d5880. 00000100:00100000:2.0:1788271817.626684:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271817.626750:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271817.626822:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577484672 00000100:00100000:1.0:1788271817.626830:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577484672 00000100:00100000:1.0:1788271817.626895:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 378 00000100:00100000:1.0:1788271817.626905:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2398:x1875138577484672:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271817.626978:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2398:x1875138577484672:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 74us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271817.626986:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 378 00000100:00100000:2.0:1788271817.627294:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271817.627325:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271817.627358:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271817.627380:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577485184 00000100:00100000:2.0:1788271817.627384:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577485184 00000100:00100000:2.0:1788271817.627417:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577484800 00000100:00100000:2.0:1788271817.627420:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577484800 00000100:00100000:2.0:1788271817.627439:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577485056 00000100:00100000:2.0:1788271817.627441:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577485056 00000100:00100000:2.0:1788271817.627458:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 267 00000100:00100000:2.0:1788271817.627465:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfd1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:956fb91b-4885-4e88-90fb-3061936b51ca+5:2398:x1875138577485184:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788271817.627502:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfd1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:956fb91b-4885-4e88-90fb-3061936b51ca+5:2398:x1875138577485184:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 38us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271817.627508:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 267 00000100:00100000:2.0:1788271817.627520:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 268 00000100:00100000:2.0:1788271817.627526:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfd1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2398:x1875138577484800:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788271817.627549:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfd1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2398:x1875138577484800:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 23us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271817.627554:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 268 00000100:00100000:2.0:1788271817.627565:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 269 00000100:00100000:2.0:1788271817.627571:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfd1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:956fb91b-4885-4e88-90fb-3061936b51ca+5:2398:x1875138577485056:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788271817.627591:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfd1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:956fb91b-4885-4e88-90fb-3061936b51ca+5:2398:x1875138577485056:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 21us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271817.627597:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 269 00000100:00080000:2.0:1788271817.627613:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788271817.627617:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788271817.632485:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577484928 00000100:00100000:3.0:1788271817.632500:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577484928 00000100:00100000:2.0:1788271817.632835:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 104 00000100:00100000:2.0:1788271817.632848:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfd1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2398:x1875138577484928:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788271817.632937:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfd1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2398:x1875138577484928:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 92us (6186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271817.632946:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 104 00000100:00080000:3.0:1788271817.633082:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788271817.650535:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271817.650687:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577485312 00000100:00100000:0.0:1788271817.650697:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577485312 00000100:00100000:0.0:1788271817.650761:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 102 00000100:00100000:0.0:1788271817.650771:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfd1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+30:11326:x1875138577485312:12345-192.168.201.3@tcp:34:lfs.0 00010000:00010000:0.0:1788271817.650845:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d000/0x99288105fd38ee25 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.650863:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d000/0x99288105fd38ee25 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.650875:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d000/0x99288105fd38ee25 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.650890:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ee2c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.650898:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ee2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.650905:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ee2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.650977:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c000/0x99288105fd38ee33 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.651001:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c000/0x99288105fd38ee33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.651008:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c000/0x99288105fd38ee33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788271817.651055:0:12164:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c000/0x99288105fd38ee33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.651067:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d000/0x99288105fd38ee25 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.651074:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d000/0x99288105fd38ee25 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.651080:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d000/0x99288105fd38ee25 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.651087:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511d000 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271817.651091:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d000/0x99288105fd38ee25 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.651099:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d000/0x99288105fd38ee25 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.651110:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f6d83058800) 00010000:00010000:0.0:1788271817.651113:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271817.651118:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d000/0x99288105fd38ee25 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.651123:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d000/0x99288105fd38ee25 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.651144:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ee2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.651149:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ee2c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.651154:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ee2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.651159:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511dc00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271817.651162:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ee2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.651167:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ee2c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.651175:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f6d83058f00) 00010000:00010000:0.0:1788271817.651177:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271817.651180:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ee2c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.651185:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ee2c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.651197:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c000/0x99288105fd38ee33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.651203:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c000/0x99288105fd38ee33 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.651208:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c000/0x99288105fd38ee33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.651218:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511c000 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271817.651221:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c000/0x99288105fd38ee33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.651227:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c000/0x99288105fd38ee33 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.651235:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d83058600) 00010000:00010000:0.0:1788271817.651237:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271817.651240:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c000/0x99288105fd38ee33 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.651246:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c000/0x99288105fd38ee33 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271817.651329:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfd1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+30:11326:x1875138577485312:12345-192.168.201.3@tcp:34:lfs.0 Request processed in 559us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271817.651346:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 102 00000100:00100000:2.0:1788271817.691440:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271817.691688:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577485568 00000100:00100000:3.0:1788271817.691698:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577485568 00000100:00100000:3.0:1788271817.691899:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 103 00000100:00100000:3.0:1788271817.691909:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfd1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+30:11329:x1875138577485568:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:3.0:1788271817.691929:0:9899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271817.691947:0:9899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4e00/0x99288105fd38ee3a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd51d expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.692030:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ee41 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.692044:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ee41 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.692055:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ee41 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.692069:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38ee48 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.692076:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38ee48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.692082:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38ee48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.692860:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5200/0x99288105fd38ee4f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.692873:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5200/0x99288105fd38ee4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.692880:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5200/0x99288105fd38ee4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271817.692892:0:9899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788271817.692961:0:9899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ee41 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.692969:0:9899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ee41 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.692982:0:9899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ee41 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.692988:0:9899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4800 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271817.692992:0:9899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ee41 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.692999:0:9899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ee41 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.693010:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f6d83058800) 00010000:00010000:3.0:1788271817.693013:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271817.693017:0:9899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ee41 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.693023:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ee41 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.693038:0:9899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38ee48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.693044:0:9899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38ee48 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.693050:0:9899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38ee48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.693055:0:9899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4000 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271817.693057:0:9899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38ee48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.693070:0:9899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38ee48 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.693077:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f6e8d1d8e00) 00010000:00010000:3.0:1788271817.693079:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271817.693082:0:9899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38ee48 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.693087:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38ee48 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.693123:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4e00/0x99288105fd38ee3a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd51d expref: 33 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.693136:0:9899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5200/0x99288105fd38ee4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd51d expref: 32 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.693143:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d83058600) 00010000:00010000:3.0:1788271817.693145:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788271817.693147:0:9899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c5200, rc 0) 00000100:00100000:3.0:1788271817.693977:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfd1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+32:11329:x1875138577485568:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 2065us (2542us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1788271817.693987:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 103 00000100:00100000:3.0:1788271817.696857:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271817.698324:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577485696 00000100:00100000:1.0:1788271817.698348:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577485696 00000100:00100000:1.0:1788271817.698417:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 104 00000100:00100000:1.0:1788271817.698428:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+32:11329:x1875138577485696:12345-192.168.201.3@tcp:54:lfs.0 00010000:00010000:1.0:1788271817.698499:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ee5d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271817.698515:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5e00/0x99288105fd38edf4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd501 expref: 32 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271817.698541:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ee5d lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271817.698576:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5e00/0x99288105fd38edf4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd501 expref: 32 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271817.698589:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5e00/0x99288105fd38edf4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd501 expref: 32 pid: 9899 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271817.698602:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e84d02680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1875138590142464:192.168.201.3@tcp:104: 00000100:00100000:1.0:1788271817.698717:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830a6540 going to sleep for 11 seconds 00000100:00100000:2.0:1788271817.704992:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271817.705086:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577485952 00000100:00100000:3.0:1788271817.705107:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577485952 00000100:00100000:3.0:1788271817.705196:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 22 00000100:00100000:1.0:1788271817.705203:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e84d02680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1875138590142464:192.168.201.3@tcp:104: 00000100:00100000:3.0:1788271817.705216:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfd1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+33:6637:x1875138577485952:12345-192.168.201.3@tcp:35:ldlm_bl.0 00010000:00010000:1.0:1788271817.705237:0:6485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ee5d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788271817.705940:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967373 00000100:00100000:3.0:1788271817.706135:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfd1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+35:6637:x1875138577485952:12345-192.168.201.3@tcp:35:ldlm_bl.0 Request processed in 922us (1152us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1788271817.706145:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 22 00000020:00080000:3.0:1788271817.706151:0:6487:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788271817.708743:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271817.708873:0:9485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577486080 00000100:00100000:1.0:1788271817.708888:0:9485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577486080 00010000:00010000:1.0:1788271817.709002:0:9485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5e00/0x99288105fd38edf4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd501 expref: 35 pid: 9899 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271817.709058:0:9485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 66 00000100:00100000:1.0:1788271817.709068:0:9485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+35:2398:x1875138577486080:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271817.709085:0:9485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271817.709092:0:9485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5e00/0x99288105fd38edf4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd501 expref: 35 pid: 9899 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271817.709124:0:9485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5e00/0x99288105fd38edf4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd501 expref: 35 pid: 9899 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271817.709233:0:9485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5e00/0x99288105fd38edf4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd501 expref: 35 pid: 9899 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271817.709254:0:9485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d83058600) 00010000:00010000:1.0:1788271817.709260:0:9485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ee5d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271817.709269:0:9485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ee5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271817.709275:0:9485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ee5d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271817.709305:0:9485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788271817.709365:0:6485:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ee5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.709475:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ee5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.709531:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ee5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.709541:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ee5d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.709549:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ee5d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.709570:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e92d33c00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271817.709576:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ee5d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.709749:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ee5d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.709766:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d83058600) 00010000:00010000:0.0:1788271817.709770:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788271817.709775:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ee5d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.709782:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ee5d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271817.710154:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+34:11329:x1875138577485696:12345-192.168.201.3@tcp:54:lfs.0 Request processed in 11723us (13318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271817.710167:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 104 00000100:00100000:1.0:1788271817.710183:0:9485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+34:2398:x1875138577486080:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 1112us (1447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271817.710194:0:9485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 66 00000100:00100000:2.0:1788271817.716421:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271817.719497:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577486336 00000100:00100000:1.0:1788271817.719512:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577486336 00000100:00100000:1.0:1788271817.719582:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 23 00000100:00100000:1.0:1788271817.719594:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfd1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+33:11329:x1875138577486336:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:1.0:1788271817.719881:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfd1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+34:11329:x1875138577486336:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 289us (3470us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1788271817.719889:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 23 00000100:00100000:2.0:1788271817.781550:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271817.788447:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577486592 00000100:00100000:3.0:1788271817.788462:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577486592 00000100:00100000:3.0:1788271817.788543:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 105 00000100:00100000:3.0:1788271817.788554:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfd1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+34:11340:x1875138577486592:12345-192.168.201.3@tcp:101:cat.0 00010000:00010000:3.0:1788271817.788581:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271817.788603:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5c00/0x99288105fd38ee64 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd524 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.788879:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ee6b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.788896:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ee6b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.788908:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ee6b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.788925:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38ee72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.788932:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38ee72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.788939:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38ee72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.789056:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ee79 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.789090:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ee79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.789098:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ee79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271817.789112:0:6483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1788271817.789198:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ee6b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.789205:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ee6b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.789212:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ee6b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.789218:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e20a00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271817.789223:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ee6b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.789231:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ee6b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.789243:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f6d83058800) 00010000:00010000:2.0:1788271817.789247:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271817.789251:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ee6b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.789258:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ee6b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.789270:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38ee72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.789282:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38ee72 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.789287:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38ee72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.789292:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e20200 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271817.789295:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38ee72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.789301:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38ee72 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.789309:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f6e90141100) 00010000:00010000:2.0:1788271817.789311:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271817.789314:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38ee72 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.789319:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38ee72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.789371:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5c00/0x99288105fd38ee64 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd524 expref: 37 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.789388:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ee79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd524 expref: 36 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.789395:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d83058600) 00010000:00010000:2.0:1788271817.789398:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788271817.789406:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e21e00, rc 0) 00000100:00100000:2.0:1788271817.789484:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfd1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+36:11340:x1875138577486592:12345-192.168.201.3@tcp:101:cat.0 Request processed in 931us (7943us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1788271817.789491:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 105 00000100:00100000:3.0:1788271817.792793:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271817.792907:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577486848 00000100:00100000:2.0:1788271817.792926:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577486848 00000100:00100000:2.0:1788271817.792989:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 24 00000100:00100000:2.0:1788271817.793000:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+36:11340:x1875138577486848:12345-192.168.201.3@tcp:35:cat.0 00000100:00100000:2.0:1788271817.793298:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+37:11340:x1875138577486848:12345-192.168.201.3@tcp:35:cat.0 Request processed in 299us (513us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1788271817.793306:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 24 00000100:00100000:3.0:1788271817.815383:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271817.815544:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577487104 00000100:00100000:2.0:1788271817.815555:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577487104 00000100:00100000:2.0:1788271817.815644:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 106 00000100:00100000:2.0:1788271817.815655:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+37:11341:x1875138577487104:12345-192.168.201.3@tcp:36:rm.0 00010000:00010000:2.0:1788271817.815712:0:9899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1788271817.815738:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38ee17 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd50f expref: 37 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.815763:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ee79 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd524 expref: 36 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.815776:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5200/0x99288105fd38ee4f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd51d expref: 35 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.815789:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5800/0x99288105fd38ee09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd508 expref: 34 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.815818:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d83058600) 00010000:00010000:2.0:1788271817.815823:0:9899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788271817.815843:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38ee87 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.815855:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38ee87 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.815865:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38ee87 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.815880:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ee8e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.815886:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ee8e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.815893:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ee8e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.815969:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38ee95 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.815977:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38ee95 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.815984:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38ee95 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788271817.816190:0:9899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1788271817.816201:0:9899:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 378905580567ns, next at 379905578206ns, rc = 0 00010000:00010000:2.0:1788271817.816257:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38ee9c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.816266:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38ee9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.816274:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38ee9c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.816280:0:9899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38ee9c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.816286:0:9899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38ee9c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.816293:0:9899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38ee9c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.817231:0:9899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788271817.817252:0:9899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38ee95 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.817258:0:9899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38ee95 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.817263:0:9899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38ee95 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.817266:0:9899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e21000 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271817.817269:0:9899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38ee95 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.817274:0:9899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38ee95 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.817290:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d83058600) 00010000:00010000:2.0:1788271817.817292:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788271817.817294:0:9899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38ee95 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.817298:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38ee95 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.817312:0:9899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38ee87 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.817315:0:9899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38ee87 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.817318:0:9899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38ee87 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.817322:0:9899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e20200 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271817.817323:0:9899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38ee87 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.817326:0:9899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38ee87 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.817343:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f6d83058800) 00010000:00010000:2.0:1788271817.817346:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271817.817349:0:9899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38ee87 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.817354:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38ee87 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788271817.817379:0:9899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002aaf2adb reply state 00000000aa1f73c4 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ee8e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.817394:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ee8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.817400:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f6e90141100) 00010000:00010000:2.0:1788271817.817403:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788271817.817406:0:9899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788271817.817493:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+35:11341:x1875138577487104:12345-192.168.201.3@tcp:36:rm.0 Request processed in 1838us (2118us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1788271817.817500:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 106 00010000:00010000:3.0:1788271817.820035:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788271817.820048:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38ee9c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.820060:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e813a0600 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:3.0:1788271817.820065:0:6471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38ee9c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.820074:0:6471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38ee9c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.820092:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d83058600) 00010000:00010000:3.0:1788271817.820111:0:6471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788271817.820116:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38ee9c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.820123:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38ee9c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271817.820139:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271817.820141:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271817.820143:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271817.879948:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271817.880053:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577487360 00000100:00100000:0.0:1788271817.880063:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577487360 00000100:00100000:0.0:1788271817.880127:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 107 00000100:00100000:0.0:1788271817.880137:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+35:11347:x1875138577487360:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:0.0:1788271817.880177:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271817.880197:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38eea3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd52b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.880298:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d000/0x99288105fd38eeaa lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.880340:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d000/0x99288105fd38eeaa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.880351:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d000/0x99288105fd38eeaa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.880365:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c800/0x99288105fd38eeb1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.880378:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c800/0x99288105fd38eeb1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.880386:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c800/0x99288105fd38eeb1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788271817.880850:0:6485:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:0.0:1788271817.880991:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38eeb8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.881002:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38eeb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.881010:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38eeb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.881042:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d000/0x99288105fd38eeaa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.881049:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d000/0x99288105fd38eeaa lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.881055:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d000/0x99288105fd38eeaa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.881067:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511d000 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271817.881072:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d000/0x99288105fd38eeaa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.881079:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d000/0x99288105fd38eeaa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.881096:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f6d83058800) 00010000:00010000:0.0:1788271817.881099:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271817.881103:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d000/0x99288105fd38eeaa lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.881109:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d000/0x99288105fd38eeaa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788271817.881122:0:6485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000049f442f reply state 00000000a2648553 transno 4294967379 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c800/0x99288105fd38eeb1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.881132:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c800/0x99288105fd38eeb1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.881138:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f6e90141100) 00010000:00010000:0.0:1788271817.881140:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788271817.881143:0:6485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788271817.881171:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38eea3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd52b expref: 38 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.881185:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38eeb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd52b expref: 37 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.881204:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6d8305a800) 00010000:00010000:0.0:1788271817.881206:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788271817.881208:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e8511d800, rc 0) 00000100:00100000:0.0:1788271817.881345:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+38:11347:x1875138577487360:12345-192.168.201.3@tcp:101:bash.0 Request processed in 1208us (1406us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1788271817.881353:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 107 00000100:00100000:0.0:1788271817.888223:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271817.888320:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577487488 00000100:00100000:2.0:1788271817.888340:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577487488 00000100:00100000:2.0:1788271817.888409:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 42 00000100:00100000:2.0:1788271817.888420:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2397:x1875138577487488:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:2.0:1788271817.888440:0:8396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271817.888463:0:8396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da52b1b3/0x99288105fd38eec6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd532 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788271817.888757:0:8396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788271817.889010:0:8396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=378s v=(0 0) 00010000:00010000:2.0:1788271817.889016:0:8396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271817.889028:0:8396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da52b1b3/0x99288105fd38eec6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd532 expref: 8 pid: 8396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.889050:0:8396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da52b1b3/0x99288105fd38eec6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd532 expref: 8 pid: 8396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.889080:0:8396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e813a0a00, rc 0) 00000100:00100000:2.0:1788271817.889144:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+8:2397:x1875138577487488:12345-192.168.201.3@tcp:101:bash.0 Request processed in 725us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271817.889152:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 42 00000100:00100000:3.0:1788271817.895343:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271817.895451:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577487616 00000100:00100000:0.0:1788271817.895462:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577487616 00000100:00100000:0.0:1788271817.895534:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 43 00000100:00100000:0.0:1788271817.895544:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+8:11347:x1875138577487616:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:0.0:1788271817.895562:0:8397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271817.895589:0:8397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bcb75c8/0x99288105fd38eecd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd539 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.895650:0:8397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da52b1b3/0x99288105fd38eec6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd532 expref: 9 pid: 8396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.895660:0:8397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271817.895664:0:8397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271817.895669:0:8397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bcb75c8/0x99288105fd38eecd lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd539 expref: 9 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.895704:0:8397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000da52b1b3/0x99288105fd38eec6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd532 expref: 9 pid: 8396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.895734:0:8397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000da52b1b3/0x99288105fd38eec6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd532 expref: 9 pid: 8396 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271817.895748:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d839cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8397:1875138590142592:192.168.201.3@tcp:104: 00000100:00100000:0.0:1788271817.895888:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8387cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788271817.900080:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271817.900157:0:9486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577487744 00000100:00100000:2.0:1788271817.900166:0:9486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577487744 00010000:00010000:2.0:1788271817.900199:0:9486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000da52b1b3/0x99288105fd38eec6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd532 expref: 10 pid: 8396 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271817.900236:0:9486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 67 00000100:00100000:2.0:1788271817.900249:0:9486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+10:2398:x1875138577487744:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271817.900260:0:9486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271817.900279:0:9486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000da52b1b3/0x99288105fd38eec6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd532 expref: 10 pid: 8396 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.900293:0:9486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000da52b1b3/0x99288105fd38eec6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd532 expref: 10 pid: 8396 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.900316:0:9486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271817.900321:0:9486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271817.900339:0:9486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008bcb75c8/0x99288105fd38eecd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd539 expref: 10 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.900347:0:9486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bcb75c8/0x99288105fd38eecd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd539 expref: 10 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271817.900393:0:9486:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008bcb75c8/0x99288105fd38eecd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd539 expref: 10 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271817.900403:0:9486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfd1ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9486:1875138590142720:192.168.201.3@tcp:105: 00000100:00100000:2.0:1788271817.900472:0:9486:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84c8f000 going to sleep for 11 seconds 00000100:00100000:2.0:1788271817.903020:0:9486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfd1ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9486:1875138590142720:192.168.201.3@tcp:105: 00010000:00010000:2.0:1788271817.903048:0:9486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271817.903107:0:9486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+10:2398:x1875138577487744:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 2862us (3035us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271817.903117:0:9486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 67 00010000:00010000:0.0:1788271817.904681:0:8397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da52b1b3/0x99288105fd38eec6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd532 expref: 9 pid: 8396 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271817.904706:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d839cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8397:1875138590142592:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788271817.904735:0:8397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008bcb75c8/0x99288105fd38eecd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd539 expref: 8 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271817.904750:0:8397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e8511dc00, rc 0) 00000100:00100000:0.0:1788271817.904987:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+8:11347:x1875138577487616:12345-192.168.201.3@tcp:101:bash.0 Request processed in 9443us (9662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271817.904997:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 43 00000100:00100000:1.0:1788271817.909502:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271817.909679:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577488000 00000100:00100000:2.0:1788271817.909690:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577488000 00000100:00100000:2.0:1788271817.909757:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 25 00000100:00100000:2.0:1788271817.909769:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e84d02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+38:11347:x1875138577488000:12345-192.168.201.3@tcp:35:bash.0 00000100:00100000:2.0:1788271817.910280:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e84d02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+39:11347:x1875138577488000:12345-192.168.201.3@tcp:35:bash.0 Request processed in 512us (797us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1788271817.910289:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 25 00000100:00100000:3.0:1788271818.065294:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271818.065376:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577488128 00000100:00100000:2.0:1788271818.065386:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577488128 00000100:00100000:2.0:1788271818.065458:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 108 00000100:00100000:2.0:1788271818.065468:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+39:11363:x1875138577488128:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788271818.065495:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271818.065516:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38eed4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd540 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.065596:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38eedb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.065610:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38eedb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.065651:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38eedb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271818.065949:0:6483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788271818.065954:0:6483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788271818.065974:0:6483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38eedb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.066000:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38eed4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd540 expref: 41 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.066021:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38eedb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd540 expref: 40 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.066031:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f6d83058800) 00010000:00010000:2.0:1788271818.066034:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788271818.066037:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e813a1600, rc 0) 00000100:00100000:2.0:1788271818.066103:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+40:11363:x1875138577488128:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 636us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271818.066109:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 108 00000100:00100000:3.0:1788271818.069192:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271818.069287:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577488384 00000100:00100000:2.0:1788271818.069297:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577488384 00000100:00100000:2.0:1788271818.069389:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 109 00000100:00100000:2.0:1788271818.069402:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+40:11363:x1875138577488384:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788271818.069427:0:9899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271818.069450:0:9899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38eee2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd547 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.069558:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38eee9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.069664:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38eee9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.069745:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38eee9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271818.069757:0:9899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788271818.070099:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38eee2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd547 expref: 43 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.070118:0:9899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38eee9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd547 expref: 42 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.070126:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6d8305a800) 00010000:00010000:2.0:1788271818.070129:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788271818.070132:0:9899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e813a0600, rc 0) 00000100:00100000:2.0:1788271818.070195:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+42:11363:x1875138577488384:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 796us (1013us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1788271818.070202:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 109 00000100:00100000:1.0:1788271818.079640:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271818.080307:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577488640 00000100:00100000:0.0:1788271818.080318:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577488640 00000100:00100000:0.0:1788271818.080394:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 110 00000100:00100000:0.0:1788271818.080405:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e84d00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+42:11363:x1875138577488640:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:0.0:1788271818.080432:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271818.080453:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d000/0x99288105fd38eef7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd54e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.081924:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511de00/0x99288105fd38eefe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.081940:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511de00/0x99288105fd38eefe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.081950:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511de00/0x99288105fd38eefe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271818.081963:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788271818.082066:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d000/0x99288105fd38eef7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd54e expref: 45 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.082085:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511de00/0x99288105fd38eefe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd54e expref: 44 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.082094:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6d8305a800) 00010000:00010000:0.0:1788271818.082097:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788271818.082100:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e8511de00, rc 0) 00000100:00100000:0.0:1788271818.082166:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e84d00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+44:11363:x1875138577488640:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 1763us (2555us total) trans 4294967382 rc 0/0 00000100:00100000:0.0:1788271818.082173:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 110 00000100:00100000:3.0:1788271818.082734:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271818.082814:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577488768 00000100:00100000:0.0:1788271818.082822:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577488768 00000100:00100000:0.0:1788271818.082882:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:0.0:1788271818.082894:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+44:2395:x1875138577488768:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271818.082905:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271818.082929:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38eee9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd547 expref: 44 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.082943:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6d8305a800) 00010000:00010000:0.0:1788271818.082947:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271818.082989:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+43:2395:x1875138577488768:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 98us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271818.082996:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:3.0:1788271818.094093:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271818.094217:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577488896 00000100:00100000:0.0:1788271818.094230:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577488896 00000100:00100000:0.0:1788271818.094600:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 44 00000100:00100000:0.0:1788271818.094612:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+8:2397:x1875138577488896:12345-192.168.201.3@tcp:1:lfs.0 00010000:00010000:0.0:1788271818.094709:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa7c8ac9/0x99288105fd38ef0c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.094735:0:8398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008bcb75c8/0x99288105fd38eecd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd539 expref: 8 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.094745:0:8398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788271818.094751:0:8398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788271818.094756:0:8398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa7c8ac9/0x99288105fd38ef0c lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.094800:0:8398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008bcb75c8/0x99288105fd38eecd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd539 expref: 8 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.094816:0:8398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008bcb75c8/0x99288105fd38eecd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd539 expref: 8 pid: 8397 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271818.094860:0:8398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d839cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8398:1875138590142848:192.168.201.3@tcp:104: 00000100:00100000:0.0:1788271818.094969:0:8398:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8387c900 going to sleep for 11 seconds 00000100:00100000:3.0:1788271818.102657:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271818.103008:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577489024 00000100:00100000:2.0:1788271818.103035:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577489024 00002000:00100000:2.0:1788271818.103108:0:8403:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8f6e902a0000 x1875138577489024/t0(0) o4->ef8df183-a1b1-4e56-bce5-924a894c4a71@192.168.201.3@tcp:724/0 lens 504/0 e 0 to 0 dl 1788271829 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788271818.103121:0:8403:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f6e902a0000 with x1875138577489024 ext(0->8) 00010000:00010000:2.0:1788271818.103132:0:8403:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008bcb75c8/0x99288105fd38eecd lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd539 expref: 9 pid: 8397 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.103154:0:8403:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008bcb75c8/0x99288105fd38eecd lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd539 expref: 9 pid: 8397 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788271818.103163:0:8403:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8f6e902a0000 00000100:00100000:2.0:1788271818.103201:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 1 00000100:00100000:2.0:1788271818.103214:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e902a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+9:2397:x1875138577489024:12345-192.168.201.3@tcp:4:lfs.0 00000100:00100000:0.0:1788271818.105655:0:8398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d839cea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8398:1875138590142848:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788271818.105702:0:8398:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa7c8ac9/0x99288105fd38ef0c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271818.106088:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e902a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+11:2397:x1875138577489024:12345-192.168.201.3@tcp:4:lfs.0 Request processed in 2869us (3463us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788271818.106101:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 1 00002000:00100000:2.0:1788271818.106112:0:8403:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8f6e902a0000 x1875138577489024/t4294967303(0) o4->ef8df183-a1b1-4e56-bce5-924a894c4a71@192.168.201.3@tcp:724/0 lens 504/448 e 0 to 0 dl 1788271829 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788271818.106119:0:8403:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f6e902a0000 with x1875138577489024 ext(0->8) 00010000:00010000:2.0:1788271818.106128:0:8403:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008bcb75c8/0x99288105fd38eecd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd539 expref: 11 pid: 8397 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.106142:0:8403:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008bcb75c8/0x99288105fd38eecd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd539 expref: 11 pid: 8397 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788271818.106155:0:8403:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8f6e902a0000 00000001:00080000:0.0:1788271818.108228:0:8391:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1788271818.108248:0:8391:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:2.0:1788271818.114085:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271818.117016:0:9485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577489152 00000100:00100000:1.0:1788271818.117035:0:9485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577489152 00010000:00010000:1.0:1788271818.117105:0:9485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008bcb75c8/0x99288105fd38eecd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd539 expref: 7 pid: 8397 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271818.117164:0:9485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 68 00000100:00100000:1.0:1788271818.117177:0:9485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2398:x1875138577489152:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271818.117197:0:9485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788271818.117220:0:9485:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788271818.117223:0:9485:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788271817 00002000:00010000:1.0:1788271818.117226:0:9485:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788271817 00002000:00010000:1.0:1788271818.117228:0:9485:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788271817 00002000:00010000:1.0:1788271818.117231:0:9485:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788271818.117237:0:9485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008bcb75c8/0x99288105fd38eecd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd539 expref: 7 pid: 8397 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271818.117263:0:9485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008bcb75c8/0x99288105fd38eecd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd539 expref: 7 pid: 8397 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271818.117292:0:9485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bcb75c8/0x99288105fd38eecd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd539 expref: 7 pid: 8397 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271818.117313:0:9485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788271818.117319:0:9485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788271818.117335:0:9485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa7c8ac9/0x99288105fd38ef0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271818.117365:0:9485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa7c8ac9/0x99288105fd38ef0c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271818.117414:0:9485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271818.117493:0:9485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2398:x1875138577489152:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 320us (3417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271818.117502:0:9485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 68 00010000:00010000:3.0:1788271818.117760:0:8398:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa7c8ac9/0x99288105fd38ef0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.117772:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa7c8ac9/0x99288105fd38ef0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.117797:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa7c8ac9/0x99288105fd38ef0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.117805:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa7c8ac9/0x99288105fd38ef0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.117827:0:8398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa7c8ac9/0x99288105fd38ef0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.117834:0:8398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511d000 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:3.0:1788271818.117849:0:8398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa7c8ac9/0x99288105fd38ef0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.117859:0:8398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa7c8ac9/0x99288105fd38ef0c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.117873:0:8398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa7c8ac9/0x99288105fd38ef0c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.117881:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa7c8ac9/0x99288105fd38ef0c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271818.117951:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2397:x1875138577488896:12345-192.168.201.3@tcp:1:lfs.0 Request processed in 23341us (23872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271818.117959:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 44 00000100:00100000:2.0:1788271818.121694:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271818.121781:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577489408 00000100:00100000:1.0:1788271818.121798:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577489408 00000100:00100000:1.0:1788271818.121886:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 26 00000100:00100000:1.0:1788271818.121900:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb36af850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+43:11363:x1875138577489408:12345-192.168.201.3@tcp:35:lfs.0 00000004:00010000:1.0:1788271818.121986:0:6486:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511de00/0x99288105fd38eefe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd54e expref: 43 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788271818.122891:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1788271818.122926:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:1.0:1788271818.123370:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00010000:00010000:1.0:1788271818.123424:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38ef13 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271818.123445:0:6486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38eeb8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd52b expref: 47 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271818.123454:0:6486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38ef13 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271818.123507:0:6486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38eeb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd52b expref: 47 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271818.123549:0:6486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38eeb8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd52b expref: 47 pid: 6485 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271818.123567:0:6486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e84d03b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6486:1875138590142976:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788271818.123855:0:6486:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830a6840 going to sleep for 11 seconds 00000100:00100000:0.0:1788271818.127694:0:6486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e84d03b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6486:1875138590142976:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788271818.127714:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00010000:00010000:0.0:1788271818.127727:0:6486:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38ef13 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271818.127797:0:9486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577489536 00000100:00100000:3.0:1788271818.127806:0:9486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577489536 00010000:00010000:3.0:1788271818.127849:0:9486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38eeb8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd52b expref: 48 pid: 6485 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271818.127882:0:9486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 69 00000100:00100000:3.0:1788271818.127907:0:9486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfd1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+48:2398:x1875138577489536:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788271818.127922:0:9486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271818.127930:0:9486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38eeb8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd52b expref: 48 pid: 6485 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.127941:0:9486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38eeb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd52b expref: 48 pid: 6485 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.127958:0:9486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38eeb8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd52b expref: 48 pid: 6485 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.127971:0:9486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6d8305a800) 00010000:00010000:3.0:1788271818.127975:0:9486:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38ef13 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.127981:0:9486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38ef13 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.127985:0:9486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38ef13 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.128013:0:9486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271818.128064:0:9486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfd1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+47:2398:x1875138577489536:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 158us (349us total) trans 0 rc 0/0 00010000:00010000:2.0:1788271818.128068:0:6486:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38ef13 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271818.128072:0:9486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 69 00010000:00010000:2.0:1788271818.128082:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38ef13 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788271818.128351:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000001:00080000:2.0:1788271818.128930:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:2.0:1788271818.129018:0:6486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfd1f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6486:1875138590143104:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788271818.129068:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271818.129105:0:6486:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb36ab540 going to sleep for 11 seconds 00000100:00100000:3.0:1788271818.129351:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590143104 00000100:00100000:3.0:1788271818.129358:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590143104 00000100:00100000:3.0:1788271818.129488:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788271818.129497:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfd1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6486:x1875138590143104:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788271818.129585:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfd1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6486:x1875138590143104:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 88us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271818.129592:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:2.0:1788271818.130498:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788271818.130537:0:6486:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:2.0:1788271818.130543:0:6486:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:2.0:1788271818.130563:0:6486:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f6e84d02300, transno 4294967302 00000100:00100000:2.0:1788271818.130588:0:6486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfd1f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6486:1875138590143104:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788271818.130765:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00000100:00100000:2.0:1788271818.130824:0:6486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfd1f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6486:1875138590143232:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788271818.130882:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271818.130902:0:6486:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8161c840 going to sleep for 11 seconds 00000100:00100000:3.0:1788271818.130984:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590143232 00000100:00100000:3.0:1788271818.130991:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590143232 00000100:00100000:3.0:1788271818.131036:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788271818.131047:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfd1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6486:x1875138590143232:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788271818.131187:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfd1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6486:x1875138590143232:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 142us (304us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788271818.131196:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788271818.131384:0:6486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfd1f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6486:1875138590143232:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788271818.131425:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:0.0:1788271818.131460:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38ef13 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.131469:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38ef13 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.131477:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38ef13 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.131482:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e92d32600 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271818.131487:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38ef13 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.131506:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38ef13 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.131523:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6d8305a800) 00010000:00010000:0.0:1788271818.131527:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788271818.131531:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38ef13 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.131537:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38ef13 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788271818.131787:0:6486:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788271818.131839:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1788271818.131849:0:6486:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 379221228981ns, next at 380221226924ns, rc = 0 00000001:00080000:0.0:1788271818.131855:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967390 00010000:00010000:0.0:1788271818.131876:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6d8305a800) 00010000:00010000:0.0:1788271818.131879:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788271818.131887:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511de00/0x99288105fd38eefe lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd54e expref: 51 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271818.131989:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb36af850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+50:11363:x1875138577489408:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 10091us (10303us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1788271818.131997:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 26 00000020:00080000:0.0:1788271818.132002:0:6486:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788271818.136580:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271818.136863:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577489664 00000100:00100000:3.0:1788271818.136873:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577489664 00000100:00100000:3.0:1788271818.137454:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 111 00000100:00100000:3.0:1788271818.137466:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfd1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+50:11363:x1875138577489664:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:3.0:1788271818.137491:0:12164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271818.137513:0:12164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38ef1a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd555 expref: -99 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.137569:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38ef1a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd555 expref: 51 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.137584:0:12164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38ef1a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd555 expref: 51 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.137603:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6e8d1d8e00) 00010000:00010000:3.0:1788271818.137607:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788271818.137643:0:12164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c4000, rc 0) 00000100:00100000:3.0:1788271818.137716:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfd1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+51:11363:x1875138577489664:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 252us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271818.137724:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 111 00010000:00010000:1.0:1788271818.142797:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271818.145728:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271818.145951:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577489920 00000100:00100000:2.0:1788271818.145961:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577489920 00000100:00100000:2.0:1788271818.146021:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 27 00000100:00100000:2.0:1788271818.146031:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+51:11363:x1875138577489920:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:2.0:1788271818.146268:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+52:11363:x1875138577489920:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 237us (550us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1788271818.146277:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 27 00000100:00100000:1.0:1788271818.261736:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271818.261961:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577490048 00000100:00100000:2.0:1788271818.261971:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577490048 00000100:00100000:2.0:1788271818.262041:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 112 00000100:00100000:2.0:1788271818.262053:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e84d03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+52:11373:x1875138577490048:12345-192.168.201.3@tcp:34:lfs.0 00010000:00010000:2.0:1788271818.262132:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ef21 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.262149:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ef21 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.262161:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ef21 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.262173:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ef28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.262181:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ef28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.262187:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ef28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.262269:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38ef2f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.262278:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38ef2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.262302:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38ef2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788271818.262365:0:6484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38ef2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.262591:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ef21 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.262598:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ef21 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.262604:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ef21 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.262611:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e813a0e00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271818.262615:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ef21 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.262653:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ef21 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.262665:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f6d83058800) 00010000:00010000:2.0:1788271818.262668:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271818.262673:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ef21 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.262678:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ef21 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.262691:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ef28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.262702:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ef28 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.262707:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ef28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.262711:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e813a0a00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271818.262714:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ef28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.262720:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ef28 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.262726:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f6e90141100) 00010000:00010000:2.0:1788271818.262729:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271818.262731:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ef28 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.262737:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ef28 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.262853:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38ef2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.262861:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38ef2f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.262866:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38ef2f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.262871:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e813a0600 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271818.262880:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38ef2f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.262886:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38ef2f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.262894:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6e8d1d8e00) 00010000:00010000:2.0:1788271818.262896:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271818.262899:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38ef2f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.262905:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38ef2f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271818.262990:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e84d03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+52:11373:x1875138577490048:12345-192.168.201.3@tcp:34:lfs.0 Request processed in 938us (1263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271818.262998:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 112 00000100:00100000:0.0:1788271818.270141:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788271818.270163:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d839ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590143360:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788271818.270233:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271818.270522:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590143360 00000100:00100000:0.0:1788271818.270529:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590143360 00000100:00100000:0.0:1788271818.270598:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788271818.270607:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590143360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788271818.270646:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3691950080 00000100:00100000:0.0:1788271818.270690:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590143360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271818.270697:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:0.0:1788271818.270716:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788271818.270950:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d839ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590143360:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788271818.271776:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788271818.271789:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e84d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590143488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788271818.271830:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271818.271870:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590143488 00000100:00100000:1.0:1788271818.271875:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590143488 00000100:00100000:1.0:1788271818.271906:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788271818.271915:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e84d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3606:x1875138590143488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788271818.271929:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3691950080 00000100:00100000:1.0:1788271818.271972:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e84d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3606:x1875138590143488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271818.271979:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788271818.272012:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e84d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590143488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788271818.273050:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfd1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590143616:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788271818.273094:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271818.273290:0:14136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590143616 00000100:00100000:0.0:1788271818.273296:0:14136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590143616 00000100:00100000:0.0:1788271818.273439:0:14136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788271818.273448:0:14136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e902a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590143616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788271818.273478:0:14136:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788271818.273529:0:14136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e902a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590143616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271818.273536:0:14136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788271818.273616:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfd1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590143616:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788271818.311756:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271818.311899:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577490304 00000100:00100000:0.0:1788271818.311908:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577490304 00000100:00100000:0.0:1788271818.311966:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 113 00000100:00100000:0.0:1788271818.311974:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e902a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+52:11376:x1875138577490304:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:0.0:1788271818.311993:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271818.312015:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511de00/0x99288105fd38ef36 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd55c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.312082:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38ef3d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.312108:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38ef3d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.312118:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38ef3d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.312130:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ef44 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.312137:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ef44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.312143:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ef44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.312236:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d000/0x99288105fd38ef4b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.312243:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d000/0x99288105fd38ef4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.312249:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d000/0x99288105fd38ef4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271818.312258:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788271818.312340:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38ef3d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.312348:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38ef3d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.312354:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38ef3d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.312365:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511d800 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271818.312537:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38ef3d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.312547:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38ef3d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.312560:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f6d83058800) 00010000:00010000:0.0:1788271818.312563:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271818.312567:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38ef3d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.312574:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38ef3d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.312597:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ef44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.312604:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ef44 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.312610:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ef44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.312615:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511dc00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271818.312658:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ef44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.312665:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ef44 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.312682:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f6e90141100) 00010000:00010000:0.0:1788271818.312684:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271818.312687:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ef44 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.312693:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ef44 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.312725:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511de00/0x99288105fd38ef36 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd55c expref: 55 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.312737:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d000/0x99288105fd38ef4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd55c expref: 54 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.312744:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6e8d1d8e00) 00010000:00010000:0.0:1788271818.312746:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788271818.312748:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e8511d000, rc 0) 00000100:00100000:0.0:1788271818.312904:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e902a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+54:11376:x1875138577490304:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 930us (1157us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1788271818.312911:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 113 00000100:00100000:0.0:1788271818.327420:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271818.327551:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577490432 00000100:00100000:3.0:1788271818.327561:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577490432 00000100:00100000:3.0:1788271818.327671:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 114 00000100:00100000:3.0:1788271818.327682:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+54:11376:x1875138577490432:12345-192.168.201.3@tcp:54:lfs.0 00010000:00010000:3.0:1788271818.327754:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4e00/0x99288105fd38ef59 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.327770:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4e00/0x99288105fd38ef59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.327780:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4e00/0x99288105fd38ef59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.327813:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4e00/0x99288105fd38ef59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.327821:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4e00/0x99288105fd38ef59 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.327828:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4e00/0x99288105fd38ef59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.327844:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4e00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271818.327864:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4e00/0x99288105fd38ef59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.328045:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4e00/0x99288105fd38ef59 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.328061:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6e8d1d8e00) 00010000:00010000:3.0:1788271818.328065:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788271818.328069:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4e00/0x99288105fd38ef59 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.328075:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4e00/0x99288105fd38ef59 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271818.328160:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+54:11376:x1875138577490432:12345-192.168.201.3@tcp:54:lfs.0 Request processed in 479us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271818.328168:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 114 00000100:00100000:1.0:1788271818.332063:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271818.332204:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577490688 00000100:00100000:2.0:1788271818.332214:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577490688 00000100:00100000:2.0:1788271818.332313:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 28 00000100:00100000:2.0:1788271818.332335:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e84d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+54:11376:x1875138577490688:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:2.0:1788271818.332585:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e84d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+55:11376:x1875138577490688:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 261us (531us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788271818.332593:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 28 00000100:00100000:2.0:1788271818.404507:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271818.404644:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577490944 00000100:00100000:1.0:1788271818.404658:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577490944 00000100:00100000:1.0:1788271818.404759:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 115 00000100:00100000:1.0:1788271818.404770:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfd1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+55:11386:x1875138577490944:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:1.0:1788271818.404828:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271818.404831:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788271818.404868:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38eedb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd540 expref: 55 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271818.404888:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f6d83058800) 00010000:00010000:1.0:1788271818.404892:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788271818.404908:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ef60 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd563 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271818.405142:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38ef67 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271818.405155:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d000/0x99288105fd38ef4b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd55c expref: 55 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271818.405162:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38ef67 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271818.405195:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d000/0x99288105fd38ef4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd55c expref: 55 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271818.405207:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d000/0x99288105fd38ef4b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd55c expref: 55 pid: 6485 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271818.405219:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e84d02a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1875138590143744:192.168.201.3@tcp:104: 00000100:00100000:1.0:1788271818.405776:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830a6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788271818.409093:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e84d02a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1875138590143744:192.168.201.3@tcp:104: 00010000:00010000:1.0:1788271818.409155:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38ef67 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271818.409656:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271818.409752:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577491072 00000100:00100000:0.0:1788271818.409763:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577491072 00010000:00010000:0.0:1788271818.409813:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d000/0x99288105fd38ef4b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd55c expref: 56 pid: 6485 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271818.409862:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 70 00000100:00100000:0.0:1788271818.409874:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfd1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+56:2397:x1875138577491072:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271818.409907:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271818.409918:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d000/0x99288105fd38ef4b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd55c expref: 56 pid: 6485 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.409932:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d000/0x99288105fd38ef4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd55c expref: 56 pid: 6485 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.409961:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d000/0x99288105fd38ef4b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd55c expref: 56 pid: 6485 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.409980:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6e8d1d8e00) 00010000:00010000:0.0:1788271818.409986:0:6469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38ef67 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.409997:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38ef67 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.410102:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38ef67 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.410135:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271818.410402:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfd1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+55:2397:x1875138577491072:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 350us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271818.410411:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 70 00010000:00010000:1.0:1788271818.410773:0:6484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38ef67 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271818.410783:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38ef67 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271818.410806:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788271818.410973:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ef60 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd563 expref: 56 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271818.410992:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38ef67 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd563 expref: 55 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271818.411095:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6e8d1d8e00) 00010000:00010000:1.0:1788271818.411099:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788271818.411102:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e92d33e00, rc 0) 00000100:00100000:1.0:1788271818.411144:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfd1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+55:11386:x1875138577490944:12345-192.168.201.3@tcp:101:bash.0 Request processed in 6376us (6653us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1788271818.411152:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 115 00000100:00100000:3.0:1788271818.416294:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271818.416369:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577491200 00000100:00100000:0.0:1788271818.416385:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577491200 00000100:00100000:0.0:1788271818.416482:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 116 00000100:00100000:0.0:1788271818.416494:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83390380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+55:11386:x1875138577491200:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:0.0:1788271818.416544:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271818.416574:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d000/0x99288105fd38ef75 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd56a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.416658:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ef7c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.416678:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ef7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.416691:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ef7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.416850:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d000/0x99288105fd38ef75 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd56a expref: 57 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.416872:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ef7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd56a expref: 56 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.416883:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6e8d1d8e00) 00010000:00010000:0.0:1788271818.416886:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788271818.416891:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e8511dc00, rc 0) 00000100:00100000:0.0:1788271818.416961:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83390380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+56:11386:x1875138577491200:12345-192.168.201.3@tcp:101:bash.0 Request processed in 469us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271818.416969:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 116 00000100:00100000:0.0:1788271818.421405:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271818.421513:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577491456 00000100:00100000:3.0:1788271818.421528:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577491456 00000100:00100000:3.0:1788271818.421773:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 117 00000100:00100000:3.0:1788271818.421788:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+56:11386:x1875138577491456:12345-192.168.201.3@tcp:36:bash.0 00010000:00010000:3.0:1788271818.422128:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ef83 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.422151:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ef83 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.422164:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ef83 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788271818.422241:0:12164:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967396 00000004:00010000:3.0:1788271818.422270:0:12164:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a652238 reply state 0000000071d91def transno 4294967397 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ef83 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.422286:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ef83 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.422295:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6e8d1d8e00) 00010000:00010000:3.0:1788271818.422298:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788271818.422303:0:12164:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788271818.422449:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+59:11386:x1875138577491456:12345-192.168.201.3@tcp:36:bash.0 Request processed in 663us (1060us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1788271818.422457:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 117 00000020:00080000:3.0:1788271818.422464:0:12164:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788271818.427903:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271818.428139:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577491584 00000100:00100000:1.0:1788271818.428153:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577491584 00000100:00100000:1.0:1788271818.428239:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 118 00000100:00100000:1.0:1788271818.428252:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83393100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+59:11386:x1875138577491584:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:1.0:1788271818.428287:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271818.428317:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ef8a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd571 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271818.428473:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38ef91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271818.428488:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38ef67 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd563 expref: 60 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271818.428495:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38ef91 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271818.428529:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38ef67 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd563 expref: 60 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271818.428539:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38ef67 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd563 expref: 60 pid: 6484 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271818.428552:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e84d02a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1875138590143872:192.168.201.3@tcp:104: 00000100:00100000:1.0:1788271818.428689:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830a6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788271818.434794:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271818.434891:0:9485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577491712 00000100:00100000:0.0:1788271818.434904:0:9485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577491712 00010000:00010000:0.0:1788271818.434956:0:9485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38ef67 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd563 expref: 61 pid: 6484 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271818.435032:0:9485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 71 00000100:00100000:0.0:1788271818.435045:0:9485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e84d02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+61:2398:x1875138577491712:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271818.435067:0:9485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271818.435077:0:9485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38ef67 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd563 expref: 61 pid: 6484 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.435094:0:9485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38ef67 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd563 expref: 61 pid: 6484 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.435129:0:9485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6e8d1d8e00) 00010000:00010000:0.0:1788271818.435135:0:9485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38ef91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.435146:0:9485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38ef91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.435155:0:9485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38ef91 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.435179:0:9485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271818.435257:0:9485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e84d02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+61:2398:x1875138577491712:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 214us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271818.435266:0:9485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 71 00010000:00010000:2.0:1788271818.436996:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38ef67 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd563 expref: 60 pid: 6484 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271818.437479:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e84d02a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1875138590143872:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788271818.437512:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38ef91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.437523:0:6484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38ef91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.437530:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38ef91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271818.437778:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788271818.437784:0:6484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788271818.437814:0:6484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38ef91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.437857:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38ef8a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd571 expref: 60 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.437875:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38ef91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd571 expref: 59 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.437886:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6e8d1d8e00) 00010000:00010000:2.0:1788271818.437889:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788271818.437894:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e92d33a00, rc 0) 00000100:00100000:2.0:1788271818.437982:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83393100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+59:11386:x1875138577491584:12345-192.168.201.3@tcp:101:bash.0 Request processed in 9732us (10095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271818.437992:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 118 00000100:00100000:1.0:1788271818.442817:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271818.442915:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577491968 00000100:00100000:2.0:1788271818.442929:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577491968 00000100:00100000:2.0:1788271818.443010:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 29 00000100:00100000:2.0:1788271818.443030:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e84d02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+59:11386:x1875138577491968:12345-192.168.201.3@tcp:35:bash.0 00000100:00100000:2.0:1788271818.443305:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e84d02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+60:11386:x1875138577491968:12345-192.168.201.3@tcp:35:bash.0 Request processed in 277us (502us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1788271818.443314:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 29 00000100:00100000:3.0:1788271818.508688:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271818.508823:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577492096 00000100:00100000:2.0:1788271818.508839:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577492096 00000100:00100000:2.0:1788271818.508913:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 119 00000100:00100000:2.0:1788271818.508922:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83391880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+60:11392:x1875138577492096:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788271818.508952:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271818.508975:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ef98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd578 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.509075:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ef9f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.509094:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ef9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.509108:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ef9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271818.509158:0:6483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788271818.509160:0:6483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788271818.509178:0:6483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ef9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.509203:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38ef98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd578 expref: 62 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.509256:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ef9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd578 expref: 61 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.509266:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f6d83058800) 00010000:00010000:2.0:1788271818.509269:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788271818.509274:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e813a0e00, rc 0) 00000100:00100000:2.0:1788271818.509383:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83391880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+61:11392:x1875138577492096:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 460us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271818.509391:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 119 00000100:00100000:1.0:1788271818.512954:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271818.513164:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577492224 00000100:00100000:3.0:1788271818.513176:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577492224 00000100:00100000:3.0:1788271818.513292:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 120 00000100:00100000:3.0:1788271818.513308:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e84d03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+61:11392:x1875138577492224:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:3.0:1788271818.513349:0:12164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271818.513380:0:12164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4e00/0x99288105fd38efa6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd57f expref: -99 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.513461:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4600/0x99288105fd38efad lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.513476:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4600/0x99288105fd38efad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.513507:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4600/0x99288105fd38efad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.513522:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38efb4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.513529:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38efb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.513536:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38efb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.514228:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38efbb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.514960:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38efbb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.514976:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38efbb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271818.515176:0:12164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788271818.515182:0:12164:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788271818.515209:0:12164:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38efbb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.515225:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38efbb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.515236:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4600/0x99288105fd38efad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.515272:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4600/0x99288105fd38efad lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.515281:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4600/0x99288105fd38efad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.515288:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4600 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271818.515294:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4600/0x99288105fd38efad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.515302:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4600/0x99288105fd38efad lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.515328:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f6d83058800) 00010000:00010000:3.0:1788271818.515332:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271818.515337:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4600/0x99288105fd38efad lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.515344:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4600/0x99288105fd38efad lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.515365:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38efb4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.515371:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38efb4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.515377:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38efb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.515381:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c5a00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271818.515390:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38efb4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.515396:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38efb4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.515404:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f6e90141100) 00010000:00010000:3.0:1788271818.515406:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271818.515409:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38efb4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.515415:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38efb4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.515456:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4e00/0x99288105fd38efa6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd57f expref: 63 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.515471:0:12164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38efbb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd57f expref: 62 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.515478:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6e8d1d8e00) 00010000:00010000:3.0:1788271818.515480:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788271818.515483:0:12164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c4200, rc 0) 00000100:00100000:3.0:1788271818.515583:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e84d03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+62:11392:x1875138577492224:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 2278us (2641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271818.515594:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 120 00000100:00100000:1.0:1788271818.523127:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271818.523249:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271818.523359:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577492608 00000100:00100000:2.0:1788271818.523373:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577492608 00000100:00100000:2.0:1788271818.523463:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 121 00000100:00100000:2.0:1788271818.523477:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83033100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+62:11392:x1875138577492608:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788271818.523518:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271818.523550:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38efc2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd586 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.523745:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38efc9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.523775:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38ef91 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd571 expref: 63 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.523785:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38efbb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd57f expref: 63 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.523818:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38efc9 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.523867:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38efbb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd57f expref: 63 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.523883:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38efbb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd57f expref: 63 pid: 12164 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271818.523901:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfd1fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1875138590144000:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788271818.524348:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38ef91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd571 expref: 63 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.524359:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38ef91 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd571 expref: 63 pid: 6484 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271818.524368:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfd1e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1875138590144128:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788271818.524401:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4f0a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788271818.526969:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577492352 00000100:00100000:0.0:1788271818.526988:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577492352 00010000:00010000:0.0:1788271818.527156:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38efbb lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd57f expref: 64 pid: 12164 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271818.527302:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 72 00000100:00100000:0.0:1788271818.527315:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e84d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+64:2395:x1875138577492352:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271818.527347:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271818.527356:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38efbb lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd57f expref: 64 pid: 12164 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.527371:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38efbb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd57f expref: 64 pid: 12164 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.527401:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6e8d1d8e00) 00010000:00010000:0.0:1788271818.527407:0:6470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38efc9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.527418:0:6470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38efc9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.527426:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271818.527961:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e84d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+64:2395:x1875138577492352:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 646us (4964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271818.527970:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 72 00000100:00100000:2.0:1788271818.528843:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271818.529098:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577492736 00000100:00100000:0.0:1788271818.529109:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577492736 00010000:00010000:0.0:1788271818.529151:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38ef91 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd571 expref: 64 pid: 6484 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271818.529192:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 73 00000100:00100000:0.0:1788271818.529202:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfd1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+64:2397:x1875138577492736:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271818.529248:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271818.529256:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38ef91 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd571 expref: 64 pid: 6484 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.529269:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38ef91 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd571 expref: 64 pid: 6484 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.529293:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6e8d1d8e00) 00010000:00010000:0.0:1788271818.529299:0:6468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38efc9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.529310:0:6468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38efc9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.529331:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38efc9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.529356:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271818.529400:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfd1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+64:2397:x1875138577492736:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 199us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271818.529408:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 73 00010000:00010000:3.0:1788271818.531031:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38ef91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd571 expref: 63 pid: 6484 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271818.531061:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfd1e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1875138590144128:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788271818.531102:0:6484:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.3@tcp) returned -22 from blocking AST (req@000000004b0cc455 x1875138590144000) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38efbb lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd57f expref: 62 pid: 12164 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.531121:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38efbb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd57f expref: 62 pid: 12164 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271818.531137:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfd1fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1875138590144000:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788271818.531167:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6e8d1d8e00) 00010000:00010000:3.0:1788271818.531175:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38efc9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.531186:0:6484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38efc9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.531192:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38efc9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271818.531217:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788271818.531471:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38efc2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd586 expref: 63 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.531563:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38efc9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd586 expref: 62 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.531990:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6e8d1d8e00) 00010000:00010000:3.0:1788271818.531994:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788271818.531997:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e813a0600, rc 0) 00000100:00100000:3.0:1788271818.532080:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83033100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+62:11392:x1875138577492608:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 8604us (8828us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1788271818.532100:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 121 00000100:00100000:2.0:1788271818.534450:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271818.534880:0:9486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577492992 00000100:00100000:3.0:1788271818.534895:0:9486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577492992 00000100:00100000:3.0:1788271818.535034:0:9486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 8 00000100:00100000:3.0:1788271818.535047:0:9486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfd1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+62:11392:x1875138577492992:12345-192.168.201.3@tcp:103:lfs.0 00010000:00010000:3.0:1788271818.535066:0:9486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271818.535100:0:9486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38ef1a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd555 expref: 62 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.535127:0:9486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6e8d1d8e00) 00010000:00010000:3.0:1788271818.535132:0:9486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271818.535208:0:9486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfd1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+61:11392:x1875138577492992:12345-192.168.201.3@tcp:103:lfs.0 Request processed in 164us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271818.535216:0:9486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 8 00000100:00100000:1.0:1788271818.539523:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271818.539719:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577493120 00000100:00100000:3.0:1788271818.539733:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577493120 00000100:00100000:3.0:1788271818.539812:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 122 00000100:00100000:3.0:1788271818.539824:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83032680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+61:11392:x1875138577493120:12345-192.168.201.3@tcp:58:lfs.0 00010000:00010000:3.0:1788271818.539980:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38efd7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.540015:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38efd7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.540030:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38efd7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788271818.540178:0:9899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1788271818.540290:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83032680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+61:11392:x1875138577493120:12345-192.168.201.3@tcp:58:lfs.0 Request processed in 467us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271818.540300:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 122 00000100:00100000:2.0:1788271818.543525:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271818.543667:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577493248 00000100:00100000:3.0:1788271818.543681:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577493248 00000100:00100000:3.0:1788271818.543757:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 123 00000100:00100000:3.0:1788271818.543777:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfd1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+61:11392:x1875138577493248:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:3.0:1788271818.543803:0:12164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271818.543838:0:12164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4e00/0x99288105fd38efde lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd58d expref: -99 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.543915:0:12164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38efd7 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.543928:0:12164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4e00/0x99288105fd38efde lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd58d expref: 62 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.543953:0:12164:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38efd7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.543968:0:12164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4e00/0x99288105fd38efde lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd58d expref: 62 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.543985:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6e8d1d8e00) 00010000:00010000:3.0:1788271818.543989:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788271818.543993:0:12164:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4e00/0x99288105fd38efde lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd58d expref: 62 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.544020:0:12164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c4e00, rc 0) 00000100:00100000:3.0:1788271818.544099:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfd1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+62:11392:x1875138577493248:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 331us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271818.544108:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 123 00000040:00080000:1.0:1788271818.782114:0:13762:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788271818.782127:0:13762:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788271818.782191:0:13762:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1788271818.782205:0:13762:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788271818.782416:0:13762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfc79880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13762:1875138590144256:192.168.201.3@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788271818.782571:0:13762:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830a6840 going to sleep for 11 seconds 00000100:00100000:1.0:1788271818.789354:0:13762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfc79880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13762:1875138590144256:192.168.201.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788271818.790328:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271818.790539:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577493376 00000100:00100000:2.0:1788271818.790551:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577493376 00000100:00100000:2.0:1788271818.790689:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 124 00000100:00100000:2.0:1788271818.790704:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83390700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+62:11393:x1875138577493376:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788271818.790768:0:6484:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788271818.790917:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83390700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+62:11393:x1875138577493376:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 Request processed in 217us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271818.790926:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 124 00000100:00100000:2.0:1788271818.798869:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271818.799096:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577493504 00000100:00100000:0.0:1788271818.799110:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577493504 00000100:00100000:0.0:1788271818.799201:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 125 00000100:00100000:0.0:1788271818.799215:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfd1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+62:11393:x1875138577493504:12345-192.168.201.3@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788271818.799341:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38efe5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.799363:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38efe5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.799403:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38efe5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.799423:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38efec lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.799432:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38efec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.799439:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38efec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.799468:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38eff3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.799480:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38eff3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.799488:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38eff3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271818.799555:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788271818.799561:0:6485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788271818.799579:0:6485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38eff3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.799592:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38efe5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.799600:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38efe5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.799797:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38efe5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.799807:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511d800 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271818.799812:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38efe5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.799822:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38efe5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.799838:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f6e90141900) 00010000:00010000:0.0:1788271818.799841:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271818.799848:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38efe5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.799856:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38efe5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.799874:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38efec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.799882:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38efec lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.799889:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38efec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.799895:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511da00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271818.799898:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38efec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.799917:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38efec lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.799926:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff8f6d8305af00) 00010000:00010000:0.0:1788271818.799929:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271818.799932:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38efec lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.800041:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38efec lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.800060:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38eff3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.800067:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38eff3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.800073:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38eff3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.800078:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511c200 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271818.800081:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38eff3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.800086:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38eff3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.800094:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6e8d1d8e00) 00010000:00010000:0.0:1788271818.800096:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271818.800099:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38eff3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.800115:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38eff3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271818.800902:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfd1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+62:11393:x1875138577493504:12345-192.168.201.3@tcp:34:lhsmtool_posix.0 Request processed in 1683us (2044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271818.800913:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 125 00000100:00100000:3.0:1788271818.807867:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271818.808031:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577493760 00000100:00100000:2.0:1788271818.808046:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577493760 00000100:00100000:2.0:1788271818.808130:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 126 00000100:00100000:2.0:1788271818.808143:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83390a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+62:11393:x1875138577493760:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788271818.808172:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271818.808202:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38effa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd594 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.808359:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38f001 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.808377:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38f001 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.808389:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38f001 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271818.808402:0:6483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788271818.808512:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38f001 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.808520:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38f001 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.808527:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38f001 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.808552:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e813a1600 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271818.808557:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38f001 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.808566:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38f001 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.808581:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6e8d1d8e00) 00010000:00010000:2.0:1788271818.808585:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788271818.808590:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38f001 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.808596:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38f001 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.810818:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38effa lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd594 expref: 64 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.810846:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f6e90141900) 00010000:00010000:2.0:1788271818.810850:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788271818.810856:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38effa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd594 expref: 64 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.810879:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e813a0a00, rc 0) 00000100:00100000:2.0:1788271818.811397:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83390a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+63:11393:x1875138577493760:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 3252us (3552us total) trans 4294967400 rc 301/301 00000100:00100000:2.0:1788271818.811408:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 126 00000100:00100000:0.0:1788271818.819609:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271818.819847:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577493888 00000100:00100000:3.0:1788271818.819861:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577493888 00000100:00100000:3.0:1788271818.820290:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 127 00000100:00100000:3.0:1788271818.820307:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+63:11393:x1875138577493888:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788271818.820372:0:9899:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788271818.820862:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+63:11393:x1875138577493888:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 Request processed in 559us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271818.820872:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 127 00000100:00100000:1.0:1788271818.832342:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271818.837673:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577494144 00000100:00100000:0.0:1788271818.837700:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577494144 00000100:00100000:0.0:1788271818.837803:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 128 00000100:00100000:0.0:1788271818.837818:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+63:11393:x1875138577494144:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788271818.837846:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271818.837850:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788271818.837886:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38ef9f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd578 expref: 63 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.837916:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f6d83058800) 00010000:00010000:0.0:1788271818.837923:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788271818.837982:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38f00f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd59b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788271818.838565:0:6485:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:0.0:1788271818.838887:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38f016 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.838906:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38f016 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.838934:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38f016 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.839002:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38f00f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd59b expref: 65 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.839021:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38f016 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd59b expref: 64 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.839030:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f6d8305af00) 00010000:00010000:0.0:1788271818.839033:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788271818.839036:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e8511da00, rc 0) 00000100:00100000:0.0:1788271818.839128:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+64:11393:x1875138577494144:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 1313us (6816us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1788271818.839140:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 128 00000100:00100000:1.0:1788271818.848136:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271818.849146:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577494400 00000100:00100000:2.0:1788271818.849179:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577494400 00000100:00100000:2.0:1788271818.849264:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 129 00000100:00100000:2.0:1788271818.849278:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+64:11393:x1875138577494400:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788271818.849373:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271818.849410:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38f016 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd59b expref: 64 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.849436:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f6d8305af00) 00010000:00010000:2.0:1788271818.849449:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788271818.849478:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38f024 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.849496:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38f024 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.849508:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38f024 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.849955:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38f02b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x4e879a63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.849979:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38f02b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x4e879a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.849992:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38f02b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x4e879a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.850051:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38f024 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.850060:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38f024 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.850083:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38f024 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.850090:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e813a0a00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271818.850096:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38f024 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.850107:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38f024 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.850123:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f6d83058800) 00010000:00010000:2.0:1788271818.850126:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271818.850131:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38f024 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.850138:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38f024 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.850155:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38f02b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x4e879a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.850162:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38f02b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x4e879a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.850167:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38f02b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x4e879a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.850172:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e813a1600 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271818.850175:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38f02b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x4e879a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.850191:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38f02b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x4e879a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.850200:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x4e879a63 (ffff8f6eb35a5600) 00010000:00010000:2.0:1788271818.850203:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271818.850205:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38f02b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x4e879a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.850212:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38f02b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x4e879a63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271818.850429:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+63:11393:x1875138577494400:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 Request processed in 1147us (2304us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788271818.850439:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 129 00000100:00100000:1.0:1788271818.857007:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271818.857122:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577494528 00000100:00100000:0.0:1788271818.857136:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577494528 00000100:00100000:0.0:1788271818.857216:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 130 00000100:00100000:0.0:1788271818.857230:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+63:11393:x1875138577494528:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788271818.857259:0:12164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271818.857291:0:12164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38f032 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd5a2 expref: -99 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.857349:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38f039 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.857365:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38f039 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.857398:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38f039 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.857541:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38f032 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5a2 expref: 65 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.857575:0:12164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38f039 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5a2 expref: 64 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.857586:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f6d8305a800) 00010000:00010000:0.0:1788271818.857589:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788271818.857594:0:12164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e8511d800, rc 0) 00000100:00100000:0.0:1788271818.857717:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+64:11393:x1875138577494528:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 489us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271818.857724:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 130 00000100:00100000:1.0:1788271818.868186:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271818.868354:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577494784 00000100:00100000:3.0:1788271818.868369:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577494784 00000100:00100000:3.0:1788271818.868457:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 131 00000100:00100000:3.0:1788271818.868470:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+64:11393:x1875138577494784:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788271818.868645:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f040 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.868669:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f040 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.868705:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f040 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788271818.869064:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:3.0:1788271818.869076:0:6484:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 379958455899ns, next at 380958452813ns, rc = 0 00000004:00010000:3.0:1788271818.869145:0:6484:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000356fb0a7 reply state 0000000054098b40 transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f040 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.869172:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f040 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.869182:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f6d8305a800) 00010000:00010000:3.0:1788271818.869184:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788271818.869189:0:6484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788271818.869333:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+66:11393:x1875138577494784:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 Request processed in 862us (1163us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1788271818.869341:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 131 00000100:00100000:3.0:1788271818.873471:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271818.873802:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577494912 00000100:00100000:0.0:1788271818.873816:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577494912 00000100:00100000:0.0:1788271818.873964:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 132 00000100:00100000:0.0:1788271818.873978:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83392300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+66:11393:x1875138577494912:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788271818.874014:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271818.874045:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38f047 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd5a9 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.874129:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38f047 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5a9 expref: 67 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.874146:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38f047 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5a9 expref: 67 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.874191:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f6d8305a800) 00010000:00010000:0.0:1788271818.874195:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788271818.874200:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e8511c200, rc 0) 00000100:00100000:0.0:1788271818.874358:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83392300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+67:11393:x1875138577494912:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 382us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271818.874366:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 132 00000100:00100000:1.0:1788271818.881204:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271818.881861:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577495040 00000100:00100000:2.0:1788271818.881877:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577495040 00000100:00100000:2.0:1788271818.881964:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 45 00000100:00100000:2.0:1788271818.881978:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+8:2397:x1875138577495040:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788271818.882340:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+9:2397:x1875138577495040:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 Request processed in 363us (1150us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788271818.882353:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 45 00000100:00100000:1.0:1788271818.885430:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271818.888328:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577495296 00000100:00100000:2.0:1788271818.888351:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577495296 00000100:00100000:2.0:1788271818.888511:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 30 00000100:00100000:2.0:1788271818.888525:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+67:11393:x1875138577495296:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788271818.889172:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+68:11393:x1875138577495296:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 Request processed in 647us (3753us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1788271818.889181:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 30 00000100:00100000:1.0:1788271818.902594:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271818.902909:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577495552 00000100:00100000:0.0:1788271818.902925:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577495552 00000100:00100000:0.0:1788271818.903011:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 133 00000100:00100000:0.0:1788271818.903024:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e85809500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+68:11393:x1875138577495552:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788271818.903186:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e85809500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+68:11393:x1875138577495552:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 Request processed in 163us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271818.903194:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 133 00000100:00100000:1.0:1788271818.921486:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271818.921659:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577495680 00000100:00100000:2.0:1788271818.921701:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577495680 00000100:00100000:2.0:1788271818.921772:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 134 00000100:00100000:2.0:1788271818.921784:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e8580bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+68:11393:x1875138577495680:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788271818.921813:0:9899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271818.921853:0:9899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38f04e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd5b0 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.921944:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38f055 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.921962:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38f055 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.921978:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38f055 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271818.922037:0:9899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788271818.922063:0:9899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38f055 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.922093:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38f04e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5b0 expref: 70 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.922116:0:9899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38f055 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5b0 expref: 69 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.922126:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f6d8305a800) 00010000:00010000:2.0:1788271818.922129:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788271818.922134:0:9899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e813a0a00, rc 0) 00000100:00100000:2.0:1788271818.922217:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e8580bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+69:11393:x1875138577495680:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 435us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271818.922235:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 134 00000100:00100000:1.0:1788271818.931282:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271818.931427:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577495808 00000100:00100000:0.0:1788271818.931440:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577495808 00000100:00100000:0.0:1788271818.931511:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 46 00000100:00100000:0.0:1788271818.931523:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+9:2398:x1875138577495808:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788271818.931549:0:8397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271818.931584:0:8397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aca9fd7e/0x99288105fd38f05c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd5b7 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788271818.931662:0:8397:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96dcca, blocks: 0x0 00010000:00010000:0.0:1788271818.931699:0:8397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=380s v=(0 0) 00010000:00010000:0.0:1788271818.931705:0:8397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271818.931736:0:8397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aca9fd7e/0x99288105fd38f05c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5b7 expref: 10 pid: 8397 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.931761:0:8397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aca9fd7e/0x99288105fd38f05c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5b7 expref: 10 pid: 8397 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.931779:0:8397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e8511c000, rc 0) 00000100:00100000:0.0:1788271818.931868:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+10:2398:x1875138577495808:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 346us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271818.931875:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 46 00000100:00100000:1.0:1788271818.935538:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271818.935701:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577496064 00000100:00100000:3.0:1788271818.935714:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577496064 00000100:00100000:3.0:1788271818.935791:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 135 00000100:00100000:3.0:1788271818.935803:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+69:11393:x1875138577496064:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788271818.935958:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+69:11393:x1875138577496064:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 Request processed in 157us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271818.935967:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 135 00000100:00100000:2.0:1788271818.939047:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271818.939794:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577496192 00000100:00100000:3.0:1788271818.939807:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577496192 00000100:00100000:3.0:1788271818.939891:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 47 00000100:00100000:3.0:1788271818.939904:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8316ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+10:11393:x1875138577496192:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788271818.939930:0:8398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271818.939955:0:8398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078591298/0x99288105fd38f063 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd5be expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.940009:0:8398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aca9fd7e/0x99288105fd38f05c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5b7 expref: 11 pid: 8397 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.940021:0:8398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271818.940026:0:8398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271818.940032:0:8398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078591298/0x99288105fd38f063 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5be expref: 11 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.940077:0:8398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aca9fd7e/0x99288105fd38f05c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5b7 expref: 11 pid: 8397 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.940093:0:8398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aca9fd7e/0x99288105fd38f05c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5b7 expref: 11 pid: 8397 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271818.940110:0:8398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83390000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8398:1875138590144384:192.168.201.3@tcp:104: 00000100:00100000:3.0:1788271818.940247:0:8398:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d821f8240 going to sleep for 11 seconds 00000100:00100000:1.0:1788271818.949793:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271818.950074:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577496320 00000100:00100000:0.0:1788271818.950087:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577496320 00010000:00010000:0.0:1788271818.950145:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aca9fd7e/0x99288105fd38f05c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5b7 expref: 12 pid: 8397 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271818.950199:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 74 00000100:00100000:0.0:1788271818.950212:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+12:2398:x1875138577496320:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271818.950272:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271818.950305:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aca9fd7e/0x99288105fd38f05c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5b7 expref: 12 pid: 8397 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.950333:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aca9fd7e/0x99288105fd38f05c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5b7 expref: 12 pid: 8397 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.950370:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271818.950376:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271818.950396:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000078591298/0x99288105fd38f063 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5be expref: 12 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.950408:0:6470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078591298/0x99288105fd38f063 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5be expref: 12 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271818.950460:0:6470:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000078591298/0x99288105fd38f063 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5be expref: 12 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271818.950476:0:6470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d839cd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6470:1875138590144512:192.168.201.3@tcp:105: 00000100:00100000:0.0:1788271818.951183:0:6470:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e8d060840 going to sleep for 11 seconds 00010000:00010000:3.0:1788271818.951323:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aca9fd7e/0x99288105fd38f05c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5b7 expref: 12 pid: 8397 timeout: 480 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271818.951343:0:8398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83390000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8398:1875138590144384:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788271818.951391:0:8398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000078591298/0x99288105fd38f063 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5be expref: 11 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.951404:0:8398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c5a00, rc 0) 00000100:00100000:3.0:1788271818.951445:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8316ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+11:11393:x1875138577496192:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 11543us (12411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271818.951454:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 47 00000100:00100000:0.0:1788271818.970154:0:6470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d839cd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6470:1875138590144512:192.168.201.3@tcp:105: 00010000:00010000:0.0:1788271818.970191:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271818.970270:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+10:2398:x1875138577496320:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 20060us (20490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271818.970283:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 74 00000100:00100000:3.0:1788271818.971429:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271818.971922:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577496448 00000100:00100000:0.0:1788271818.971935:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577496448 00002000:00100000:0.0:1788271818.972001:0:8402:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8f6d83390000 x1875138577496448/t0(0) o4->ef8df183-a1b1-4e56-bce5-924a894c4a71@192.168.201.3@tcp:724/0 lens 504/0 e 0 to 0 dl 1788271829 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788271818.972014:0:8402:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f6d83390000 with x1875138577496448 ext(0->12) 00002000:00010000:0.0:1788271818.972021:0:8402:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f6d83390000 00000100:00100000:0.0:1788271818.972057:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 2 00000100:00100000:0.0:1788271818.972069:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83390000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+10:2398:x1875138577496448:12345-192.168.201.3@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788271818.974104:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83390000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+12:2398:x1875138577496448:12345-192.168.201.3@tcp:4:lhsmtool_posix.0 Request processed in 2022us (2668us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788271818.974136:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 2 00002000:00100000:0.0:1788271818.974150:0:8402:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8f6d83390000 x1875138577496448/t4294967309(0) o4->ef8df183-a1b1-4e56-bce5-924a894c4a71@192.168.201.3@tcp:724/0 lens 504/448 e 0 to 0 dl 1788271829 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788271818.974161:0:8402:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f6d83390000 with x1875138577496448 ext(0->12) 00002000:00010000:0.0:1788271818.974168:0:8402:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f6d83390000 00000100:00100000:3.0:1788271818.980806:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271818.981285:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577496576 00000100:00100000:2.0:1788271818.981300:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577496576 00000100:00100000:2.0:1788271818.981843:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 136 00000100:00100000:2.0:1788271818.981855:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83392d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+69:11393:x1875138577496576:12345-192.168.201.3@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788271818.991253:0:6462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967403 is committed 00000004:00080000:1.0:1788271818.991289:0:6462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:1.0:1788271818.991357:0:6462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1788271818.991392:0:6462:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f6e84cca480 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1788271818.991399:0:6462:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f6e8a3b0000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f6e84ccaa80 00000020:00080000:1.0:1788271818.991403:0:6462:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f6e8a3b0100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f6d82d84800 00000004:00080000:1.0:1788271818.991447:0:6462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788271818.991487:0:6462:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f6eb35cf600 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1788271818.991492:0:6462:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f6eb4e6ff00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f6eb35cff00 00000020:00080000:1.0:1788271818.991496:0:6462:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f6eb4e6f500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f6d82d95000 00000020:00080000:1.0:1788271818.991542:0:6515:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1788271818.991654:0:6515:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788271818.991710:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d839cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590144640:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788271818.991711:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8316e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590144896:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788271818.992051:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ed68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992067:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ed68 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992077:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ed68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992083:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e92d32c00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271818.992088:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ed68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992096:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ed68 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992117:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f6e8d1d8100) 00010000:00010000:3.0:1788271818.992120:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271818.992126:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ed68 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992146:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38ed68 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992181:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38ee10 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992187:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38ee10 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992193:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38ee10 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992198:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c5000 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271818.992202:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38ee10 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992207:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38ee10 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992215:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f6d83058600) 00010000:00010000:3.0:1788271818.992217:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271818.992221:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38ee10 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992226:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38ee10 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992246:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ee8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992252:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ee8e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992263:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ee8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992269:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e20a00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271818.992272:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ee8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992278:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ee8e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992286:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f6e90141100) 00010000:00010000:3.0:1788271818.992288:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271818.992292:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ee8e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992298:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ee8e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992320:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c800/0x99288105fd38eeb1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992327:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c800/0x99288105fd38eeb1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992333:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c800/0x99288105fd38eeb1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992338:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511c800 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271818.992341:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c800/0x99288105fd38eeb1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992357:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c800/0x99288105fd38eeb1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992365:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f6e90141100) 00010000:00010000:3.0:1788271818.992367:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271818.992370:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c800/0x99288105fd38eeb1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992376:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c800/0x99288105fd38eeb1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992393:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ef83 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992399:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ef83 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992404:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ef83 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992410:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4800 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271818.992413:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ef83 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992419:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ef83 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992427:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6e8d1d8e00) 00010000:00010000:3.0:1788271818.992429:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271818.992432:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ef83 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992446:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38ef83 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992459:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f040 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992465:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f040 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992471:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f040 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992476:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4000 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271818.992479:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f040 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992485:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f040 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992494:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f6d8305a800) 00010000:00010000:3.0:1788271818.992496:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788271818.992499:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f040 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271818.992504:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f040 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271818.992875:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d839cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590144768:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788271818.995404:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271818.995583:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590144640 00000100:00100000:1.0:1788271818.995596:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590144640 00000100:00080000:1.0:1788271818.995655:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788271818.996187:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788271818.996203:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8301f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3609:x1875138590144640:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788271818.996249:0:12967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:1.0:1788271818.996283:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005733a7b9/0x99288105fd38f06a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271818.996323:0:12967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000066172fcb/0x99288105fd38ee1e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd516 expref: 11 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271818.996333:0:12967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1788271818.996338:0:12967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788271818.996343:0:12967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005733a7b9/0x99288105fd38f06a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271818.996387:0:12967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000066172fcb/0x99288105fd38ee1e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd516 expref: 11 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271818.996404:0:12967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000066172fcb/0x99288105fd38ee1e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd516 expref: 11 pid: 8452 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271818.996420:0:12967:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8301d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12967:1875138590145024:192.168.201.3@tcp:104: 00000100:00100000:1.0:1788271818.996523:0:12967:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830a6840 going to sleep for 11 seconds 00000100:00100000:2.0:1788271818.997277:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271818.997491:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590144896 00000100:00100000:1.0:1788271818.997501:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590144896 00000100:00100000:3.0:1788271818.997509:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271818.997554:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590144768 00000100:00100000:1.0:1788271818.997559:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590144768 00000100:00100000:1.0:1788271818.997588:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788271818.997599:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8316f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3607:x1875138590144896:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788271818.997653:0:8397:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:1.0:1788271818.997693:0:8397:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a96dcc9, atime: 0x6a96dcc9, ctime: 0x6a96dcc9, blocks: 0x8 00010000:00010000:1.0:1788271818.997701:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9748023/0x99288105fd38f071 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271818.997716:0:8397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=380s v=(0 0) 00010000:00010000:1.0:1788271818.997721:0:8397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271818.997729:0:8397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9748023/0x99288105fd38f071 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271818.997746:0:8397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9748023/0x99288105fd38f071 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271818.997757:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9748023/0x99288105fd38f071 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271818.997766:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9748023/0x99288105fd38f071 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271818.997768:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00010000:00010000:1.0:1788271818.997786:0:8397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788271818.997808:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83390e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3606:x1875138590144768:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788271818.997930:0:8398:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788271818.997934:0:8398:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788271818 00002000:00010000:3.0:1788271818.997937:0:8398:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788271818.997940:0:8398:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788271818 -> 1788271818 00002000:00010000:3.0:1788271818.997942:0:8398:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788271818.997978:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8316f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3607:x1875138590144896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 379us (703us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788271818.997985:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83390e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3606:x1875138590144768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 179us (476us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788271818.997995:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788271818.998005:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:3.0:1788271818.998056:0:3606:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f6d839cc380/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788271818.998065:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d839cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590144768:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788271818.998185:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83392d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+16:11393:x1875138577496576:12345-192.168.201.3@tcp:44:lhsmtool_posix.0 Request processed in 16329us (17392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271818.998196:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 136 00010000:00010000:2.0:1788271818.998217:0:8413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271818.998228:0:8413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9748023/0x99288105fd38f071 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.998239:0:8413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e92d32600 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:2.0:1788271818.998244:0:8413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9748023/0x99288105fd38f071 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.998255:0:8413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9748023/0x99288105fd38f071 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.998276:0:8413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9748023/0x99288105fd38f071 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271818.998284:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9748023/0x99288105fd38f071 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788271818.998850:0:3607:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f6d8316e680/2, rc 0, transno 4294967305 00000100:00100000:3.0:1788271818.998858:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8316e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590144896:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788271818.999250:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271818.999254:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271818.999255:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271819.000646:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271819.000854:0:9485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577496704 00000100:00100000:0.0:1788271819.000867:0:9485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577496704 00010000:00010000:0.0:1788271819.000940:0:9485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000066172fcb/0x99288105fd38ee1e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd516 expref: 12 pid: 8452 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271819.000982:0:9485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 75 00000100:00100000:0.0:1788271819.000994:0:9485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8301dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+12:2398:x1875138577496704:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271819.001011:0:9485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271819.001017:0:9485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000066172fcb/0x99288105fd38ee1e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd516 expref: 12 pid: 8452 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.001032:0:9485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000066172fcb/0x99288105fd38ee1e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd516 expref: 12 pid: 8452 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788271819.001345:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788271819.002077:0:12967:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8301d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12967:1875138590145024:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788271819.002115:0:12967:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005733a7b9/0x99288105fd38f06a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.002370:0:9485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066172fcb/0x99288105fd38ee1e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd516 expref: 12 pid: 8452 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.002423:0:9485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788271819.002429:0:9485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788271819.002436:0:9485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005733a7b9/0x99288105fd38f06a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.002447:0:9485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005733a7b9/0x99288105fd38f06a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.002488:0:9485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271819.002562:0:9485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8301dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+11:2398:x1875138577496704:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 1569us (1942us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271819.002574:0:9485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 75 00010000:00010000:3.0:1788271819.004378:0:12967:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005733a7b9/0x99288105fd38f06a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271819.004404:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005733a7b9/0x99288105fd38f06a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271819.004419:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005733a7b9/0x99288105fd38f06a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271819.004453:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005733a7b9/0x99288105fd38f06a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271819.004488:0:12967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788271819.004816:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8301f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3609:x1875138590144640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8615us (9418us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788271819.004840:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:1.0:1788271819.006782:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271819.006800:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005733a7b9/0x99288105fd38f06a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271819.006816:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e92d33c00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:1.0:1788271819.006822:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005733a7b9/0x99288105fd38f06a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271819.006836:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005733a7b9/0x99288105fd38f06a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271819.006863:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005733a7b9/0x99288105fd38f06a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271819.006872:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005733a7b9/0x99288105fd38f06a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271819.006909:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271819.006911:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271819.006913:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788271819.007141:0:3609:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f6d839cd500/2, rc 0, transno 4294967311 00000100:00100000:0.0:1788271819.007153:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d839cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590144640:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788271819.009373:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271819.010949:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577496832 00000100:00100000:3.0:1788271819.010968:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577496832 00000100:00100000:3.0:1788271819.011061:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 51 00000100:00100000:3.0:1788271819.011074:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8301ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+11:2397:x1875138577496832:12345-192.168.201.3@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788271819.014266:0:9475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1788271819.014359:0:9475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:3.0:1788271819.014696:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8301ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2397:x1875138577496832:12345-192.168.201.3@tcp:16:lhsmtool_posix.0 Request processed in 3619us (5332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271819.014708:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 51 00000100:00100000:1.0:1788271819.021102:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271819.021296:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577497088 00000100:00100000:0.0:1788271819.021318:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577497088 00000100:00100000:0.0:1788271819.021417:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 137 00000100:00100000:0.0:1788271819.021430:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8301e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+16:11393:x1875138577497088:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788271819.021505:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271819.021540:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38f055 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5b0 expref: 16 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.021566:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f6d8305a800) 00010000:00010000:0.0:1788271819.021572:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788271819.021704:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c600/0x99288105fd38f078 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.021723:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c600/0x99288105fd38f078 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.021735:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c600/0x99288105fd38f078 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788271819.021902:0:6483:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000896e0d01 reply state 000000003839ef21 transno 4294967404 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c600/0x99288105fd38f078 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.021917:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c600/0x99288105fd38f078 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.021924:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f6d8305a800) 00010000:00010000:0.0:1788271819.021926:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788271819.021929:0:6483:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788271819.022055:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8301e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+17:11393:x1875138577497088:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 Request processed in 627us (968us total) trans 4294967404 rc 0/0 00000100:00100000:0.0:1788271819.022063:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 137 00000100:00080000:2.0:1788271819.023715:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788271819.029770:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271819.029898:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577497216 00000100:00100000:1.0:1788271819.029908:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577497216 00000100:00100000:1.0:1788271819.029980:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 52 00000100:00100000:1.0:1788271819.030002:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8316df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2398:x1875138577497216:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788271819.030166:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788271819.030170:0:8452:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1788271818 -> 1788271817 00002000:00010000:1.0:1788271819.030173:0:8452:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788271817 00002000:00010000:1.0:1788271819.030175:0:8452:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788271818 -> 1788271817 00002000:00010000:1.0:1788271819.030177:0:8452:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788271819.030246:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8316df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2398:x1875138577497216:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 Request processed in 245us (484us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788271819.030257:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 52 00000100:00100000:1.0:1788271819.036738:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271819.036854:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577497472 00000100:00100000:0.0:1788271819.036872:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577497472 00000100:00100000:0.0:1788271819.037024:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 138 00000100:00100000:0.0:1788271819.037037:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8301f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+17:11393:x1875138577497472:12345-192.168.201.3@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788271819.037155:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f07f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.037180:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38f039 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5a2 expref: 17 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.037216:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f07f lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.037265:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38f039 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5a2 expref: 17 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.037281:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38f039 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5a2 expref: 17 pid: 12164 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271819.037298:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d839cf100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1875138590145152:192.168.201.3@tcp:104: 00000100:00100000:0.0:1788271819.037594:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8161c840 going to sleep for 11 seconds 00000100:00100000:0.0:1788271819.040204:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d839cf100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1875138590145152:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788271819.040243:0:6485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f07f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271819.047414:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271819.047537:0:9486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577497600 00000100:00100000:3.0:1788271819.047547:0:9486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577497600 00010000:00010000:3.0:1788271819.047656:0:9486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38f039 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5a2 expref: 18 pid: 12164 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271819.047698:0:9486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 76 00000100:00100000:3.0:1788271819.047708:0:9486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8301df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+18:2397:x1875138577497600:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788271819.047885:0:9486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271819.047894:0:9486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38f039 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5a2 expref: 18 pid: 12164 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271819.047986:0:9486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38f039 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5a2 expref: 18 pid: 12164 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271819.048010:0:9486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38f039 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5a2 expref: 18 pid: 12164 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271819.048028:0:9486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f6d8305a800) 00010000:00010000:3.0:1788271819.048033:0:9486:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f07f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271819.048042:0:9486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f07f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271819.048048:0:9486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f07f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271819.048077:0:9486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271819.048135:0:9486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8301df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+17:2397:x1875138577497600:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 426us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271819.048144:0:9486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 76 00010000:00010000:0.0:1788271819.048146:0:6485:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f07f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.048165:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f07f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.048218:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f07f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.048225:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f07f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.048233:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f07f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.048260:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511d200 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271819.048266:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f07f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.048274:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f07f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.048290:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f6d8305a800) 00010000:00010000:0.0:1788271819.048293:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788271819.048299:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f07f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.048305:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f07f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271819.048416:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8301f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+16:11393:x1875138577497472:12345-192.168.201.3@tcp:55:lhsmtool_posix.0 Request processed in 11378us (11698us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788271819.048427:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 138 00000100:00100000:1.0:1788271819.054479:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271819.054579:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577497728 00000100:00100000:3.0:1788271819.054587:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577497728 00000100:00100000:3.0:1788271819.054667:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 53 00000100:00100000:3.0:1788271819.054677:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8301fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2397:x1875138577497728:12345-192.168.201.3@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788271819.054719:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000faf53b37/0x99288105fd38f086 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271819.054772:0:12967:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000078591298/0x99288105fd38f063 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5be expref: 7 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271819.054781:0:12967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271819.054786:0:12967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788271819.054791:0:12967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000faf53b37/0x99288105fd38f086 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271819.054827:0:12967:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000078591298/0x99288105fd38f063 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5be expref: 7 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271819.054840:0:12967:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000078591298/0x99288105fd38f063 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5be expref: 7 pid: 8398 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271819.054854:0:12967:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83393800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12967:1875138590145280:192.168.201.3@tcp:104: 00000100:00100000:3.0:1788271819.055591:0:12967:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d821f8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788271819.061037:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271819.061411:0:12967:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83393800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12967:1875138590145280:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788271819.061441:0:12967:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000faf53b37/0x99288105fd38f086 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271819.061589:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577497856 00000100:00100000:0.0:1788271819.061597:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577497856 00010000:00010000:0.0:1788271819.061679:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000078591298/0x99288105fd38f063 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5be expref: 8 pid: 8398 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271819.061715:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 77 00000100:00100000:0.0:1788271819.061736:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8316fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+8:2398:x1875138577497856:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271819.061751:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271819.061772:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000078591298/0x99288105fd38f063 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5be expref: 8 pid: 8398 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.061806:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000078591298/0x99288105fd38f063 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5be expref: 8 pid: 8398 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.062088:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078591298/0x99288105fd38f063 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5be expref: 8 pid: 8398 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.062106:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788271819.062111:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788271819.062116:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000faf53b37/0x99288105fd38f086 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.062125:0:6470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000faf53b37/0x99288105fd38f086 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.062155:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788271819.062270:0:12967:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000faf53b37/0x99288105fd38f086 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271819.062288:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000faf53b37/0x99288105fd38f086 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271819.062320:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000faf53b37/0x99288105fd38f086 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271819.062337:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000faf53b37/0x99288105fd38f086 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271819.062345:0:12967:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000faf53b37/0x99288105fd38f086 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271819.062352:0:12967:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4000 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:3.0:1788271819.062357:0:12967:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000faf53b37/0x99288105fd38f086 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271819.062366:0:12967:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000faf53b37/0x99288105fd38f086 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271819.062381:0:12967:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000faf53b37/0x99288105fd38f086 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271819.062388:0:12967:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000faf53b37/0x99288105fd38f086 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271819.062452:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8316fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2398:x1875138577497856:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 728us (1424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271819.062460:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 77 00000100:00100000:3.0:1788271819.063287:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8301fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2397:x1875138577497728:12345-192.168.201.3@tcp:1:lhsmtool_posix.0 Request processed in 8608us (8816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271819.063298:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 53 00000100:00100000:2.0:1788271819.068065:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271819.068157:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577498112 00000100:00100000:0.0:1788271819.068167:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577498112 00000100:00100000:0.0:1788271819.068257:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 139 00000100:00100000:0.0:1788271819.068267:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8316d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+16:11393:x1875138577498112:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788271819.068423:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f08d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.068440:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ef7c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd56a expref: 16 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.068463:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f08d lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.068500:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ef7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd56a expref: 16 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.068514:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ef7c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd56a expref: 16 pid: 6485 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271819.068529:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d839cf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1875138590145408:192.168.201.3@tcp:104: 00000100:00100000:0.0:1788271819.068695:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8161c840 going to sleep for 11 seconds 00000100:00100000:1.0:1788271819.073392:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271819.074026:0:9485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577498240 00000100:00100000:2.0:1788271819.074037:0:9485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577498240 00010000:00010000:2.0:1788271819.074079:0:9485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ef7c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd56a expref: 17 pid: 6485 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271819.074125:0:9485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 78 00000100:00100000:2.0:1788271819.074135:0:9485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8301d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+17:2398:x1875138577498240:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271819.074151:0:9485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271819.074158:0:9485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ef7c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd56a expref: 17 pid: 6485 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271819.074172:0:9485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ef7c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd56a expref: 17 pid: 6485 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271819.074194:0:9485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6e8d1d8e00) 00010000:00010000:2.0:1788271819.074201:0:9485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4e00/0x99288105fd38efde lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd58d expref: 17 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271819.074226:0:9485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f08d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271819.074234:0:9485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f08d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271819.074345:0:9485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f08d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271819.074368:0:9485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271819.074433:0:9485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8301d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+17:2398:x1875138577498240:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 300us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271819.074441:0:9485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 78 00010000:00010000:0.0:1788271819.076494:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38ef7c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd56a expref: 16 pid: 6485 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271819.076517:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d839cf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1875138590145408:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788271819.076540:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f08d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.076549:0:6484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f08d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.076738:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f08d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.077012:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c400/0x99288105fd38f094 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.077027:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38f047 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5a9 expref: 16 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.077050:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c400/0x99288105fd38f094 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.077091:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38f047 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5a9 expref: 16 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.077107:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38f047 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5a9 expref: 16 pid: 6483 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271819.077121:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d839cf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1875138590145536:192.168.201.3@tcp:104: 00000100:00100000:0.0:1788271819.077212:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84c8f000 going to sleep for 11 seconds 00000100:00100000:0.0:1788271819.081361:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d839cf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1875138590145536:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788271819.081396:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c400/0x99288105fd38f094 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271819.085418:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271819.089691:0:9486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577498368 00000100:00100000:2.0:1788271819.089707:0:9486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577498368 00010000:00010000:2.0:1788271819.089758:0:9486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38f047 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5a9 expref: 17 pid: 6483 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271819.089872:0:9486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 79 00000100:00100000:2.0:1788271819.089883:0:9486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83393800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+17:2398:x1875138577498368:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271819.089899:0:9486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271819.089906:0:9486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38f047 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5a9 expref: 17 pid: 6483 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271819.089921:0:9486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38f047 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5a9 expref: 17 pid: 6483 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271819.089964:0:9486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38f047 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5a9 expref: 17 pid: 6483 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271819.089982:0:9486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f6d8305a800) 00010000:00010000:2.0:1788271819.089987:0:9486:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c400/0x99288105fd38f094 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271819.089997:0:9486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c400/0x99288105fd38f094 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271819.090005:0:9486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c400/0x99288105fd38f094 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271819.090039:0:9486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271819.090115:0:9486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83393800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+16:2398:x1875138577498368:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 233us (4703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271819.090122:0:9486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 79 00010000:00010000:0.0:1788271819.090183:0:6484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c400/0x99288105fd38f094 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.090192:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c400/0x99288105fd38f094 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788271819.090319:0:6484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:0.0:1788271819.090447:0:6484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000001:00080000:0.0:1788271819.090485:0:6484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:0.0:1788271819.091409:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d839cf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6484:1875138590145664:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788271819.091473:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271819.091509:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e8a0d5180 going to sleep for 11 seconds 00000100:00100000:3.0:1788271819.092231:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590145664 00000100:00100000:3.0:1788271819.092241:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590145664 00000100:00100000:3.0:1788271819.092340:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788271819.092352:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6484:x1875138590145664:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788271819.092500:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6484:x1875138590145664:12345-0@lo:1000:mdt00_001.0 Request processed in 150us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271819.092508:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788271819.093909:0:6484:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1788271819.093920:0:6484:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967311 00000004:00080000:0.0:1788271819.093940:0:6484:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f6d839cc380, transno 4294967310 00000004:00080000:0.0:1788271819.093952:0:6484:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f6d839cd500, transno 4294967311 00000100:00100000:0.0:1788271819.093961:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d839cf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6484:1875138590145664:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788271819.094121:0:6484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00000100:00100000:0.0:1788271819.094192:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d839cf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6484:1875138590145792:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788271819.094243:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271819.094278:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9aaf4540 going to sleep for 11 seconds 00000100:00100000:2.0:1788271819.094392:0:14136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590145792 00000100:00100000:2.0:1788271819.094398:0:14136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590145792 00000100:00100000:2.0:1788271819.094451:0:14136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788271819.094461:0:14136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6484:x1875138590145792:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788271819.094606:0:14136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6484:x1875138590145792:12345-0@lo:1000:mdt00_001.0 Request processed in 146us (362us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788271819.094614:0:14136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788271819.094919:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d839cf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6484:1875138590145792:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788271819.094956:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c400/0x99288105fd38f094 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.094966:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c400/0x99288105fd38f094 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.094973:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c400/0x99288105fd38f094 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.094978:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511c400 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271819.094983:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c400/0x99288105fd38f094 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.094990:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c400/0x99288105fd38f094 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.095006:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f6d8305a800) 00010000:00010000:0.0:1788271819.095009:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788271819.095013:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c400/0x99288105fd38f094 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.095036:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c400/0x99288105fd38f094 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.095060:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38efd7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.095066:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38efd7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.095072:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38efd7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.095076:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4200 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271819.095079:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38efd7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.095085:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38efd7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.095093:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6e8d1d8e00) 00010000:00010000:0.0:1788271819.095095:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788271819.095102:0:6484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4e00/0x99288105fd38efde lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd58d expref: 19 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.095113:0:6484:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4e00/0x99288105fd38efde lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd58d expref: 19 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.095121:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4e00/0x99288105fd38efde lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd58d expref: 19 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.095160:0:6484:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4e00/0x99288105fd38efde lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd58d expref: 19 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271819.095172:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d839cc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1875138590145920:192.168.201.3@tcp:105: 00000100:00100000:0.0:1788271819.095287:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9aaf4540 going to sleep for 11 seconds 00000100:00100000:0.0:1788271819.107076:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d839cc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1875138590145920:192.168.201.3@tcp:105: 00010000:00010000:0.0:1788271819.107111:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38efd7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.107122:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38efd7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.107156:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c400/0x99288105fd38f09b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.107170:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c400/0x99288105fd38f09b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.107180:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c400/0x99288105fd38f09b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.107189:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c400/0x99288105fd38f09b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.107194:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c400/0x99288105fd38f09b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.107200:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c400/0x99288105fd38f09b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.107222:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511c400 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271819.107226:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c400/0x99288105fd38f09b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.107233:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c400/0x99288105fd38f09b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.107245:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6e8d1d8e00) 00010000:00010000:0.0:1788271819.107248:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271819.107251:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c400/0x99288105fd38f09b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.107256:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c400/0x99288105fd38f09b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.107266:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f08d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.107271:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f08d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.107277:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f08d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.107282:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511d200 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271819.107285:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f08d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.107290:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f08d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.107323:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6e8d1d8e00) 00010000:00010000:0.0:1788271819.107326:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788271819.107330:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f08d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.107335:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f08d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271819.107503:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8316d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+19:11393:x1875138577498112:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 Request processed in 39236us (39445us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1788271819.107513:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 139 00000020:00080000:0.0:1788271819.107519:0:6484:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788271819.107995:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271819.108117:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577498496 00000100:00100000:0.0:1788271819.108125:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577498496 00000100:00100000:0.0:1788271819.108173:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 31 00000100:00100000:0.0:1788271819.108182:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83391180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+19:11392:x1875138577498496:12345-192.168.201.3@tcp:49:lfs.0 00000100:00100000:0.0:1788271819.108278:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83391180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+19:11392:x1875138577498496:12345-192.168.201.3@tcp:49:lfs.0 Request processed in 97us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271819.108286:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 31 00000040:00080000:1.0:1788271819.108732:0:13762:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788271819.108738:0:13762:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788271819.109226:0:13762:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788271819.109239:0:13762:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788271819.112418:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271819.112505:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271819.112659:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577499008 00000100:00100000:1.0:1788271819.112671:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577499008 00000100:00100000:1.0:1788271819.112732:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 140 00000100:00100000:1.0:1788271819.112744:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83391c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+19:11392:x1875138577499008:12345-192.168.201.3@tcp:58:lfs.0 00000040:00080000:1.0:1788271819.113040:0:12164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1788271819.113123:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83391c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+19:11392:x1875138577499008:12345-192.168.201.3@tcp:58:lfs.0 Request processed in 380us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271819.113131:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 140 00000100:00100000:0.0:1788271819.115996:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577498752 00000100:00100000:0.0:1788271819.116012:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577498752 00000100:00100000:0.0:1788271819.116081:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 32 00000100:00100000:0.0:1788271819.116092:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb36acc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+19:11393:x1875138577498752:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788271819.116356:0:6487:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788271819.116395:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967410 00010000:00010000:0.0:1788271819.116431:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f0a2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.116467:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f0a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.116481:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f0a2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.116491:0:6487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f0a2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.116497:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f0a2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.116504:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f0a2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.116528:0:6487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788271819.116677:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb36acc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+21:11393:x1875138577498752:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 Request processed in 587us (4270us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1788271819.116684:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 32 00000020:00080000:0.0:1788271819.116689:0:6487:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788271819.117716:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271819.117734:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f0a2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271819.117745:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511d200 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:1.0:1788271819.117749:0:6471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f0a2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271819.117757:0:6471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f0a2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271819.117772:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f6d8305a800) 00010000:00010000:1.0:1788271819.117775:0:6471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788271819.117780:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f0a2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271819.117786:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f0a2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271819.117800:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271819.117802:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271819.117804:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271819.161800:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271819.161900:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577499136 00000100:00100000:0.0:1788271819.161909:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577499136 00000100:00100000:0.0:1788271819.161967:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 141 00000100:00100000:0.0:1788271819.161978:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83392a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+21:11395:x1875138577499136:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:0.0:1788271819.162004:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271819.162021:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c400/0x99288105fd38f0a9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd5c5 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.162087:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38f0b0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.162115:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38f0b0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.162125:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38f0b0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.162136:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511ce00/0x99288105fd38f0b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.162140:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511ce00/0x99288105fd38f0b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.162144:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511ce00/0x99288105fd38f0b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.162208:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d600/0x99288105fd38f0be lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.162215:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38efc9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd586 expref: 22 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.162220:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d600/0x99288105fd38f0be lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.162251:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38efc9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd586 expref: 22 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.162262:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38efc9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd586 expref: 22 pid: 6484 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271819.162283:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d839cea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1875138590146048:192.168.201.3@tcp:104: 00000100:00100000:0.0:1788271819.162408:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e89ab8540 going to sleep for 11 seconds 00000100:00100000:0.0:1788271819.164865:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d839cea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1875138590146048:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788271819.164916:0:6485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d600/0x99288105fd38f0be lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271819.165209:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271819.165329:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577499392 00000100:00100000:0.0:1788271819.165338:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577499392 00000100:00100000:0.0:1788271819.165389:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 33 00000100:00100000:0.0:1788271819.165400:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83392680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+23:6168:x1875138577499392:12345-192.168.201.3@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788271819.165681:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83392680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+24:6168:x1875138577499392:12345-192.168.201.3@tcp:35:ldlm_bl.0 Request processed in 282us (473us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1788271819.165689:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 33 00010000:00010000:2.0:1788271819.165936:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271819.168464:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271819.169687:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577499520 00000100:00100000:0.0:1788271819.169702:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577499520 00010000:00010000:0.0:1788271819.169750:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38efc9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd586 expref: 24 pid: 6484 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271819.169849:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 80 00000100:00100000:0.0:1788271819.169859:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8316c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+24:2397:x1875138577499520:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271819.169873:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271819.169880:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38efc9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd586 expref: 24 pid: 6484 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.169923:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38efc9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd586 expref: 24 pid: 6484 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.169946:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38efc9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd586 expref: 24 pid: 6484 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.169963:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6e8d1d8e00) 00010000:00010000:0.0:1788271819.169968:0:6470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d600/0x99288105fd38f0be lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.169977:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d600/0x99288105fd38f0be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.169985:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d600/0x99288105fd38f0be lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271819.170020:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788271819.170204:0:6485:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d600/0x99288105fd38f0be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271819.170213:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d600/0x99288105fd38f0be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271819.170265:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788271819.170270:0:6485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788271819.170290:0:6485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d600/0x99288105fd38f0be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271819.170303:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d600/0x99288105fd38f0be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271819.170333:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38f0b0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271819.170339:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38f0b0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271819.170345:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38f0b0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271819.170350:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511dc00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271819.170355:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38f0b0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271819.170362:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38f0b0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271819.170371:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f6d83058800) 00010000:00010000:1.0:1788271819.170374:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271819.170377:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38f0b0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271819.170383:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38f0b0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271819.170394:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511ce00/0x99288105fd38f0b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271819.170401:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511ce00/0x99288105fd38f0b7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271819.170406:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511ce00/0x99288105fd38f0b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271819.170416:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511ce00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271819.170419:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511ce00/0x99288105fd38f0b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271819.170425:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511ce00/0x99288105fd38f0b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271819.170433:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f6d83055800) 00010000:00010000:1.0:1788271819.170436:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271819.170439:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511ce00/0x99288105fd38f0b7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271819.170445:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511ce00/0x99288105fd38f0b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271819.170482:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c400/0x99288105fd38f0a9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5c5 expref: 24 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271819.170495:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d600/0x99288105fd38f0be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5c5 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271819.170503:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6e8d1d8e00) 00010000:00010000:1.0:1788271819.170505:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788271819.170507:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e8511d600, rc 0) 00000100:00100000:1.0:1788271819.170561:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83392a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+23:11395:x1875138577499136:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 8584us (8771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271819.170568:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 141 00000100:00100000:0.0:1788271819.170669:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8316c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+22:2397:x1875138577499520:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 811us (2217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271819.170677:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 80 00000100:00100000:0.0:1788271819.294089:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788271819.294116:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8301c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590146176:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788271819.294186:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271819.294468:0:14136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590146176 00000100:00100000:2.0:1788271819.294490:0:14136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590146176 00000100:00100000:2.0:1788271819.294548:0:14136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788271819.294558:0:14136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590146176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788271819.294595:0:14136:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788271819.294672:0:14136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590146176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271819.294680:0:14136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788271819.294776:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8301c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590146176:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788271819.808322:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83393480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590146304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788271819.808392:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271819.808473:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590146304 00000100:00100000:3.0:1788271819.808480:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590146304 00000100:00100000:3.0:1788271819.808799:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788271819.808809:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83391f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3609:x1875138590146304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788271819.808831:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1788271819.808871:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83391f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3609:x1875138590146304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271819.808879:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788271819.808905:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8301c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590146432:0@lo:400:kworker.0 00000100:00100000:3.0:1788271819.808936:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271819.808959:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8301ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3606:1875138590146944:0@lo:400:kworker.0 00000100:00100000:2.0:1788271819.809166:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8301f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875138590146560:0@lo:400:kworker.0 00000100:00100000:0.0:1788271819.809666:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590146432 00000100:00100000:0.0:1788271819.809672:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590146432 00000100:00100000:0.0:1788271819.809715:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1788271819.809722:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3606:x1875138590146432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271819.812634:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271819.812689:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8301e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3607:1875138590147072:0@lo:400:kworker.0 00000100:00100000:2.0:1788271819.812798:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271819.812818:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8301d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590147584:0@lo:400:kworker.0 00000100:00100000:2.0:1788271819.812906:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271819.813020:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8301d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875138590146688:0@lo:400:kworker.0 00000100:00100000:2.0:1788271819.813049:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271819.813074:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8301c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590147200:0@lo:400:kworker.0 00000100:00100000:2.0:1788271819.813093:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271819.813110:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d839cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590147712:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788271819.813130:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271819.813151:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788271819.813159:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8301c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590146816:0@lo:400:kworker.0 00000100:00100000:2.0:1788271819.813182:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271819.813199:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8301ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3608:1875138590147328:0@lo:400:kworker.0 00000100:00100000:2.0:1788271819.813220:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271819.813251:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590146560 00000100:00100000:2.0:1788271819.813266:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590146560 00000100:00100000:2.0:1788271819.813332:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590147072 00000100:00100000:2.0:1788271819.813335:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590147072 00000100:00100000:2.0:1788271819.813357:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590146688 00000100:00100000:2.0:1788271819.813360:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590146688 00000100:00100000:2.0:1788271819.813370:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590147328 00000100:00100000:2.0:1788271819.813372:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590147328 00000100:00100000:3.0:1788271819.815101:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271819.815135:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8301ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3606:1875138590147456:0@lo:400:kworker.0 00000100:00100000:3.0:1788271819.815175:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271819.815214:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8301c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590146432:0@lo:400:kworker.0 00000100:00100000:3.0:1788271819.815253:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590146944 00000100:00100000:3.0:1788271819.815258:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590146944 00000100:00100000:1.0:1788271819.816031:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83393480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590146304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788271819.816066:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590147456 00000100:00100000:1.0:1788271819.816071:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590147456 00000100:00100000:0.0:1788271819.816280:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3606:x1875138590146432:12345-0@lo:400:kworker.0 Request processed in 6556us (7340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271819.816291:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1788271819.816459:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788271819.816479:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590147584 00000100:00100000:2.0:1788271819.816484:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590147584 00000100:00100000:2.0:1788271819.816640:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590147200 00000100:00100000:2.0:1788271819.816645:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590147200 00000100:00100000:0.0:1788271819.816716:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788271819.816725:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8316c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590147584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271819.816794:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8316c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590147584:12345-0@lo:400:kworker.0 Request processed in 70us (3886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271819.816800:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788271819.816815:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788271819.816822:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8316e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590147200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271819.816870:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788271819.816870:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8316e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590147200:12345-0@lo:400:kworker.0 Request processed in 48us (3775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271819.816875:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788271819.816879:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8316d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875138590147072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271819.816904:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8301c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590147200:0@lo:400:kworker.0 00000100:00100000:2.0:1788271819.817182:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590147712 00000100:00100000:2.0:1788271819.817188:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590147712 00000100:00100000:2.0:1788271819.817216:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788271819.817224:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8316c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590147712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788271819.817238:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:2.0:1788271819.817277:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8316c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590147712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (4145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271819.817284:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788271819.817367:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8316d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875138590147072:12345-0@lo:400:kworker.0 Request processed in 489us (4567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271819.817374:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788271819.817389:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788271819.817396:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8316ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875138590146688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271819.817426:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8316ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875138590146688:12345-0@lo:400:kworker.0 Request processed in 32us (4378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271819.817432:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788271819.817444:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788271819.817449:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8316ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875138590147328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271819.817475:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8316ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875138590147328:12345-0@lo:400:kworker.0 Request processed in 26us (4254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271819.817480:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788271819.817601:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788271819.817611:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83393b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1875138590146944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271819.817665:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83393b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1875138590146944:12345-0@lo:400:kworker.0 Request processed in 57us (2570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271819.817671:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788271819.817685:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788271819.817691:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83391500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1875138590147456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271819.817717:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83391500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1875138590147456:12345-0@lo:400:kworker.0 Request processed in 28us (2543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271819.817723:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00080000:2.0:1788271819.818155:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788271819.818160:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788271819.818163:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788271819.818187:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8316f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875138590146560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271819.820667:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8301ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3608:1875138590147328:0@lo:400:kworker.0 00000100:00100000:3.0:1788271819.820756:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590146816 00000100:00100000:3.0:1788271819.820763:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590146816 00000100:00100000:3.0:1788271819.820822:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788271819.820832:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8316ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590146816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271819.824663:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8316f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875138590146560:12345-0@lo:400:kworker.0 Request processed in 8183us (12038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271819.824680:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788271819.825122:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8301ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3606:1875138590146944:0@lo:400:kworker.0 00010000:00080000:2.0:1788271819.825141:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d8301ce00 x1875138590147456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271819.825168:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8301ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3606:1875138590147456:0@lo:400:kworker.0 00010000:00080000:0.0:1788271819.825291:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d8301e300 x1875138590147072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271819.825314:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8301e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3607:1875138590147072:0@lo:400:kworker.0 00000100:00100000:1.0:1788271819.825713:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8301d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875138590146688:0@lo:400:kworker.0 00000100:00100000:1.0:1788271819.825737:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d839cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590147712:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788271819.825780:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8301d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590147584:0@lo:400:kworker.0 00000100:00100000:1.0:1788271819.825797:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8301f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875138590146560:0@lo:400:kworker.0 00000100:00100000:3.0:1788271819.826024:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8316ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590146816:12345-0@lo:400:kworker.0 Request processed in 5191us (12837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271819.826034:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788271819.826103:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8301c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590146816:0@lo:400:kworker.0 00000040:00080000:2.0:1788271819.964180:0:14277:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788271819.964191:0:14277:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788271819.964233:0:14277:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788271819.964241:0:14277:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788271820.142607:0:13762:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788271820.142616:0:13762:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788271820.142669:0:13762:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788271820.142677:0:13762:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788271820.142811:0:13762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83393480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13762:1875138590147840:192.168.201.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788271820.142908:0:13762:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d821f86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271820.148243:0:13762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83393480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13762:1875138590147840:192.168.201.3@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788271820.159488:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271820.159656:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577499648 00000100:00100000:1.0:1788271820.159667:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577499648 00000100:00100000:1.0:1788271820.159738:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 142 00000100:00100000:1.0:1788271820.159748:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+22:11407:x1875138577499648:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788271820.159783:0:6484:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788271820.159909:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+22:11407:x1875138577499648:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 Request processed in 162us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271820.159918:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 142 00000100:00100000:1.0:1788271820.174734:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271820.174787:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577499904 00000100:00100000:1.0:1788271820.174801:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577499904 00000100:00100000:1.0:1788271820.174875:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 143 00000100:00100000:1.0:1788271820.174889:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8301c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+22:11407:x1875138577499904:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788271820.174912:0:9899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271820.174938:0:9899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38f0c5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd5cc expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271820.175079:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f0cc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271820.175097:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f0cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271820.175114:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f0cc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271820.175125:0:9899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788271820.175238:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38f0c5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5cc expref: 25 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271820.175257:0:9899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f0cc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5cc expref: 24 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271820.175278:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6e8d1d8e00) 00010000:00010000:1.0:1788271820.175281:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788271820.175285:0:9899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e92d33e00, rc 0) 00000100:00100000:1.0:1788271820.175359:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8301c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+24:11407:x1875138577499904:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 475us (638us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1788271820.175367:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 143 00000100:00100000:3.0:1788271820.186377:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271820.186478:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271820.188721:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577500160 00000100:00100000:2.0:1788271820.188735:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577500160 00000100:00100000:2.0:1788271820.188814:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 144 00000100:00100000:2.0:1788271820.188826:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83391180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+24:11407:x1875138577500160:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788271820.189223:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38f0da lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271820.189243:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38f0da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271820.189255:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38f0da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271820.189579:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38f0da lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271820.189588:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38f0da lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271820.189595:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38f0da lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271820.189601:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e813a1600 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271820.189605:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38f0da lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271820.189646:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38f0da lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271820.189662:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6e8d1d8e00) 00010000:00010000:2.0:1788271820.189666:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788271820.189672:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38f0da lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271820.189679:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38f0da lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271820.189830:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83391180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+25:11407:x1875138577500160:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 Request processed in 1004us (3460us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788271820.189840:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 144 00000100:00100000:2.0:1788271820.189873:0:9485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577500288 00000100:00100000:2.0:1788271820.189878:0:9485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577500288 00000100:00100000:2.0:1788271820.190658:0:9485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 9 00000100:00100000:2.0:1788271820.190672:0:9485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3599050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+25:2396:x1875138577500288:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271820.190688:0:9485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271820.190707:0:9485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f0cc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5cc expref: 25 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271820.190724:0:9485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6e8d1d8e00) 00010000:00010000:2.0:1788271820.190728:0:9485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271820.190769:0:9485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3599050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+24:2396:x1875138577500288:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 100us (4291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271820.190777:0:9485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 9 00010000:00010000:2.0:1788271820.190851:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788271820.192886:0:13762:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788271820.192895:0:13762:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788271820.193785:0:13762:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788271820.194170:0:13762:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788271820.197250:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271820.197341:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577500544 00000100:00100000:0.0:1788271820.197352:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577500544 00000100:00100000:0.0:1788271820.197410:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 34 00000100:00100000:0.0:1788271820.197420:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83393800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+24:11407:x1875138577500544:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788271820.197681:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83393800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+25:11407:x1875138577500544:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 Request processed in 261us (440us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1788271820.197703:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 34 00010000:00010000:2.0:1788271821.215605:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788271821.689066:0:14329:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788271821.689077:0:14329:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788271821.689129:0:14329:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788271821.689137:0:14329:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788271821.888867:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271821.888917:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577500800 00000100:00100000:2.0:1788271821.888927:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577500800 00000100:00100000:2.0:1788271821.889004:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 145 00000100:00100000:2.0:1788271821.889017:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83393480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+25:11427:x1875138577500800:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788271821.889043:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271821.889064:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38f0e1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd5d3 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271821.889176:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38f0e8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271821.889191:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38f0e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271821.889214:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38f0e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271821.889226:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788271821.889340:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0600/0x99288105fd38f0e1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5d3 expref: 28 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271821.889357:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38f0e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5d3 expref: 27 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271821.889385:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6e8d1d8e00) 00010000:00010000:2.0:1788271821.889389:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788271821.889393:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e813a1600, rc 0) 00000100:00100000:2.0:1788271821.889454:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83393480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+27:11427:x1875138577500800:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 440us (597us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1788271821.889461:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 145 00000100:00080000:0.0:1788271821.889615:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271821.891356:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271821.891432:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577500928 00000100:00100000:3.0:1788271821.891441:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577500928 00000100:00100000:3.0:1788271821.891486:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 146 00000100:00100000:3.0:1788271821.891496:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8301f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+27:11427:x1875138577500928:12345-192.168.201.3@tcp:54:lfs.0 00010000:00010000:3.0:1788271821.891578:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38f0f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271821.891593:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38f0f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271821.891604:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38f0f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271821.891666:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38f0f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271821.891690:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38f0f6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271821.891697:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38f0f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271821.891702:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4800 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271821.891707:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38f0f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271821.891715:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38f0f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271821.891729:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6e8d1d8e00) 00010000:00010000:3.0:1788271821.891732:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788271821.891735:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38f0f6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271821.891742:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38f0f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271821.892319:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8301f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+27:11427:x1875138577500928:12345-192.168.201.3@tcp:54:lfs.0 Request processed in 821us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271821.892330:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 146 00000100:00100000:3.0:1788271822.002406:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271822.002516:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577501056 00000100:00100000:2.0:1788271822.002524:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577501056 00000100:00080000:0.0:1788271822.002587:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788271822.002592:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 54 00000100:00100000:2.0:1788271822.002606:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebcb83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2398:x1875138577501056:12345-192.168.201.3@tcp:101:cat.0 00010000:00010000:2.0:1788271822.002654:0:12967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271822.002680:0:12967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000130a941c/0x99288105fd38f0fd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd5da expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788271822.002701:0:12967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a96dcc9, atime: 0x6a96dcc9, ctime: 0x6a96dcc9, blocks: 0x8 00010000:00010000:2.0:1788271822.002717:0:12967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=383s v=(0 0) 00010000:00010000:2.0:1788271822.002726:0:12967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271822.002733:0:12967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000130a941c/0x99288105fd38f0fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5da expref: 7 pid: 12967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271822.002747:0:12967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000130a941c/0x99288105fd38f0fd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5da expref: 7 pid: 12967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271822.002775:0:12967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e813a0600, rc 0) 00000100:00100000:2.0:1788271822.002823:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebcb83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2398:x1875138577501056:12345-192.168.201.3@tcp:101:cat.0 Request processed in 222us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271822.002828:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 54 00000100:00100000:3.0:1788271822.012374:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271822.014129:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577501184 00000100:00100000:2.0:1788271822.014142:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577501184 00002000:00100000:2.0:1788271822.014192:0:8403:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff8f6d83390e00 x1875138577501184/t0(0) o3->ef8df183-a1b1-4e56-bce5-924a894c4a71@192.168.201.3@tcp:728/0 lens 488/0 e 0 to 0 dl 1788271833 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788271822.014201:0:8403:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f6d83390e00 with x1875138577501184 ext(0->4095) 00002000:00010000:2.0:1788271822.014206:0:8403:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f6d83390e00 00000100:00100000:2.0:1788271822.014240:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 3 00000100:00100000:2.0:1788271822.014247:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83390e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2398:x1875138577501184:12345-192.168.201.3@tcp:3:cat.0 00000100:00100000:2.0:1788271822.014453:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83390e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2398:x1875138577501184:12345-192.168.201.3@tcp:3:cat.0 Request processed in 205us (2091us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788271822.014462:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 3 00002000:00100000:2.0:1788271822.014469:0:8403:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff8f6d83390e00 x1875138577501184/t0(0) o3->ef8df183-a1b1-4e56-bce5-924a894c4a71@192.168.201.3@tcp:728/0 lens 488/4536 e 0 to 0 dl 1788271833 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788271822.014478:0:8403:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f6d83390e00 with x1875138577501184 ext(0->4095) 00002000:00010000:2.0:1788271822.014483:0:8403:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f6d83390e00 00010000:00010000:1.0:1788271822.238259:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271822.747609:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271822.747680:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271822.747707:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271822.747741:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577501568 00000100:00100000:1.0:1788271822.747751:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577501568 00000100:00100000:1.0:1788271822.747808:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 107 00000100:00100000:1.0:1788271822.747819:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8301e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577501568:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271822.747886:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8301e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577501568:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 70us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271822.747894:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 107 00000100:00080000:1.0:1788271822.747914:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788271822.748051:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577501312 00000100:00100000:3.0:1788271822.748056:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577501312 00000100:00100000:3.0:1788271822.748083:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 380 00000100:00100000:3.0:1788271822.748091:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2395:x1875138577501312:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271822.748123:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2395:x1875138577501312:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 33us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271822.748140:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 380 00000100:00100000:2.0:1788271822.748346:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577501440 00000100:00100000:2.0:1788271822.748351:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577501440 00000100:00100000:2.0:1788271822.748391:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 276 00000100:00100000:2.0:1788271822.748399:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8301d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577501440:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788271822.748438:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8301d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577501440:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 40us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271822.748445:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 276 00000100:00080000:1.0:1788271822.748593:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788271822.750270:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271822.750308:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271822.750417:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577501696 00000100:00100000:2.0:1788271822.750424:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577501696 00000100:00100000:2.0:1788271822.750475:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577501824 00000100:00100000:2.0:1788271822.750478:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577501824 00000100:00100000:2.0:1788271822.750501:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 277 00000100:00100000:2.0:1788271822.750511:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8301d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:956fb91b-4885-4e88-90fb-3061936b51ca+5:2395:x1875138577501696:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788271822.750570:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8301d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:956fb91b-4885-4e88-90fb-3061936b51ca+5:2395:x1875138577501696:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 59us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271822.750578:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 277 00000100:00100000:2.0:1788271822.750601:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 278 00000100:00100000:2.0:1788271822.750609:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8301ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:956fb91b-4885-4e88-90fb-3061936b51ca+5:2395:x1875138577501824:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788271822.750668:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8301ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:956fb91b-4885-4e88-90fb-3061936b51ca+5:2395:x1875138577501824:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 60us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271822.750674:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 278 00000100:00080000:1.0:1788271822.751414:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788271822.751421:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788271823.264976:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788271823.271303:0:13762:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788271823.271313:0:13762:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788271823.271333:0:13762:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788271823.271339:0:13762:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788271823.391828:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8301f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590147968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788271823.392001:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271823.392076:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590147968 00000100:00100000:1.0:1788271823.392084:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590147968 00000100:00100000:1.0:1788271823.392136:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788271823.392146:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8301ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3609:x1875138590147968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788271823.392175:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788271823.392218:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8301ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3609:x1875138590147968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271823.392225:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:1.0:1788271823.392258:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788271823.392292:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8301f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590147968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788271823.393029:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8316ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590148096:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788271823.393069:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271823.393829:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590148096 00000100:00100000:0.0:1788271823.393837:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590148096 00000100:00100000:1.0:1788271823.394072:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788271823.394084:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8301f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590148224:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788271823.394119:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271823.394149:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590148224 00000100:00100000:1.0:1788271823.394153:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590148224 00000100:00100000:1.0:1788271823.394193:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788271823.394202:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8301fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590148224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788271823.394219:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788271823.394312:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788271823.394320:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8316f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590148096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788271823.394346:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788271823.394386:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8316f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590148096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (1315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271823.394393:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788271823.395616:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8301fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590148224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1411us (1491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271823.395649:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:1.0:1788271823.395755:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788271823.395799:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8301f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590148224:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788271823.395825:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8316ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590148096:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1788271823.646359:0:13766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:0.0:1788271823.903452:0:8391:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00010000:00010000:2.0:1788271824.285975:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271824.415894:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8316df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590148352:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788271824.415970:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271824.416700:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590148352 00000100:00100000:1.0:1788271824.416709:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590148352 00000100:00100000:1.0:1788271824.416834:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788271824.416845:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8301f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590148352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788271824.416884:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788271824.416935:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8301f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590148352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271824.416941:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788271824.416983:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8316df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590148352:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788271824.926120:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8316c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875138590148864:0@lo:400:kworker.0 00000100:00100000:2.0:1788271824.926187:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271824.926358:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8316df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590149376:0@lo:400:kworker.0 00000100:00100000:2.0:1788271824.926387:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271824.926421:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590149888:0@lo:400:kworker.0 00000100:00100000:2.0:1788271824.926458:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271824.926486:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788271824.926491:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8316c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590148480:0@lo:400:kworker.0 00000100:00100000:2.0:1788271824.926520:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271824.926539:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8316f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590148992:0@lo:400:kworker.0 00000100:00100000:2.0:1788271824.926562:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271824.926841:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8316ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590149504:0@lo:400:kworker.0 00000100:00100000:2.0:1788271824.926873:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271824.926891:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590150016:0@lo:400:kworker.0 00000100:00100000:2.0:1788271824.926910:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271824.926940:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8316e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875138590148608:0@lo:400:kworker.0 00000100:00100000:2.0:1788271824.926964:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271824.926982:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8316d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3606:1875138590149120:0@lo:400:kworker.0 00000100:00100000:2.0:1788271824.927001:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271824.927015:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3606:1875138590149632:0@lo:400:kworker.0 00000100:00100000:2.0:1788271824.927035:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271824.927051:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d839cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590150144:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788271824.927071:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271824.927091:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788271824.927107:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8316fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590148736:0@lo:400:kworker.0 00000100:00100000:2.0:1788271824.927130:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271824.927144:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8316dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3606:1875138590149248:0@lo:400:kworker.0 00000100:00100000:2.0:1788271824.927160:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271824.927261:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3606:1875138590149760:0@lo:400:kworker.0 00000100:00100000:2.0:1788271824.927283:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271824.927310:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590149376 00000100:00100000:2.0:1788271824.927317:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590149376 00000100:00100000:2.0:1788271824.927359:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590149888 00000100:00100000:2.0:1788271824.927362:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590149888 00000100:00100000:2.0:1788271824.927381:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590149504 00000100:00100000:2.0:1788271824.927383:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590149504 00000100:00100000:2.0:1788271824.927393:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590150016 00000100:00100000:2.0:1788271824.927395:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590150016 00000100:00100000:2.0:1788271824.927409:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788271824.927417:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590149376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271824.927467:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590149376:12345-0@lo:400:kworker.0 Request processed in 50us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271824.927474:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788271824.927490:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788271824.927495:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590149888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271824.927523:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590149888:12345-0@lo:400:kworker.0 Request processed in 28us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271824.927528:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788271824.927540:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788271824.927546:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83275500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590149504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271824.927573:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83275500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590149504:12345-0@lo:400:kworker.0 Request processed in 28us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271824.927957:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590148864 00000100:00100000:0.0:1788271824.927963:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590148864 00000100:00100000:0.0:1788271824.927989:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590148608 00000100:00100000:0.0:1788271824.927991:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590148608 00000100:00100000:0.0:1788271824.928001:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590149120 00000100:00100000:0.0:1788271824.928003:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590149120 00000100:00100000:0.0:1788271824.928016:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590149632 00000100:00100000:0.0:1788271824.928018:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590149632 00000100:00100000:0.0:1788271824.928030:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590149248 00000100:00100000:0.0:1788271824.928032:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590149248 00000100:00100000:0.0:1788271824.928041:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590149760 00000100:00100000:0.0:1788271824.928043:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590149760 00000100:00100000:0.0:1788271824.928056:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788271824.928063:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875138590148864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271824.928097:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875138590148864:12345-0@lo:400:kworker.0 Request processed in 35us (1910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271824.928103:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788271824.928125:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788271824.928131:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875138590148608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271824.928166:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875138590148608:12345-0@lo:400:kworker.0 Request processed in 35us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271824.928171:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788271824.928181:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788271824.928187:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1875138590149120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271824.928224:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1875138590149120:12345-0@lo:400:kworker.0 Request processed in 37us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271824.928230:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788271824.928241:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788271824.928246:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb4f38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3606:x1875138590149632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271824.928272:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb4f38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3606:x1875138590149632:12345-0@lo:400:kworker.0 Request processed in 26us (1235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271824.928277:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788271824.928286:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788271824.928290:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d833d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1875138590149248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271824.928311:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d833d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1875138590149248:12345-0@lo:400:kworker.0 Request processed in 21us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271824.928316:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788271824.928325:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788271824.928329:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83031c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1875138590149760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271824.928349:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83031c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1875138590149760:12345-0@lo:400:kworker.0 Request processed in 20us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271824.928354:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788271824.928379:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590148480 00000100:00100000:0.0:1788271824.928382:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590148480 00000100:00100000:0.0:1788271824.928402:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1788271824.928408:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3608:x1875138590148480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271824.928434:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3608:x1875138590148480:12345-0@lo:400:kworker.0 Request processed in 26us (1913us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271824.928452:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1788271824.929158:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590148992 00000100:00100000:1.0:1788271824.929165:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590148992 00000100:00100000:1.0:1788271824.929196:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590148736 00000100:00100000:1.0:1788271824.929199:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590148736 00000100:00100000:1.0:1788271824.929225:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788271824.929231:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfb59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590148992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271824.929274:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfb59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590148992:12345-0@lo:400:kworker.0 Request processed in 43us (2710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271824.929280:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788271824.929293:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788271824.929299:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e85809c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590148736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271824.929324:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e85809c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590148736:12345-0@lo:400:kworker.0 Request processed in 26us (2193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271824.929336:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788271824.929356:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788271824.929362:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83277b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3608:x1875138590150016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271824.929393:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83277b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3608:x1875138590150016:12345-0@lo:400:kworker.0 Request processed in 31us (2482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271824.929398:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:1.0:1788271824.929415:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788271824.929420:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788271824.929423:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788271824.929905:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788271824.929955:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590150144 00000100:00100000:2.0:1788271824.929960:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590150144 00000100:00100000:2.0:1788271824.929986:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788271824.929993:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e8580ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590150144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788271824.930016:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788271824.930053:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e8580ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590150144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (2980us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271824.930059:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788271824.930129:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d832bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590150272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788271824.930164:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271824.930249:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590150272 00000100:00100000:1.0:1788271824.930253:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590150272 00000100:00100000:1.0:1788271824.930285:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788271824.930292:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3607:x1875138590150272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788271824.930313:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788271824.930346:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3607:x1875138590150272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271824.930353:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788271824.930393:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d832bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590150272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788271824.930684:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8316fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590148736:0@lo:400:kworker.0 00010000:00080000:3.0:1788271824.930699:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d8316dc00 x1875138590149248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271824.930711:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8316dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3606:1875138590149248:0@lo:400:kworker.0 00010000:00080000:3.0:1788271824.930723:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d8313f100 x1875138590149760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271824.930731:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3606:1875138590149760:0@lo:400:kworker.0 00000100:00100000:3.0:1788271824.930742:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8316e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875138590148608:0@lo:400:kworker.0 00000100:00100000:3.0:1788271824.930753:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8316d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3606:1875138590149120:0@lo:400:kworker.0 00000100:00100000:3.0:1788271824.930764:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3606:1875138590149632:0@lo:400:kworker.0 00000100:00100000:3.0:1788271824.930777:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d839cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590150144:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788271824.930821:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8316c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590148480:0@lo:400:kworker.0 00000100:00100000:3.0:1788271824.930833:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8316f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590148992:0@lo:400:kworker.0 00000100:00100000:3.0:1788271824.930843:0:3608:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1788271824.930848:0:3608:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:3.0:1788271824.930864:0:3608:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f6d8316e680, transno 4294967305 00000100:00100000:3.0:1788271824.930875:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8316ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590149504:0@lo:400:kworker.0 00000100:00100000:3.0:1788271824.930902:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590150016:0@lo:400:kworker.0 00000100:00100000:3.0:1788271824.930912:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8316c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875138590148864:0@lo:400:kworker.0 00000100:00100000:3.0:1788271824.930923:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8316df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590149376:0@lo:400:kworker.0 00000100:00100000:3.0:1788271824.930931:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590149888:0@lo:400:kworker.0 00000001:00080000:0.0:1788271824.931413:0:6462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:0.0:1788271824.931445:0:6462:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f6e8a0d5480 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1788271824.931449:0:6462:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f6eb4074700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f6e8a0d5180 00010000:00010000:1.0:1788271824.931468:0:3592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c600/0x99288105fd38f078 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271824.931480:0:3592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c600/0x99288105fd38f078 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271824.931488:0:3592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c600/0x99288105fd38f078 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271824.931494:0:3592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511c600 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271824.931506:0:3592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c600/0x99288105fd38f078 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271824.931514:0:3592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c600/0x99288105fd38f078 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271824.931531:0:3592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f6d8305a800) 00010000:00010000:1.0:1788271824.931534:0:3592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271824.931539:0:3592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c600/0x99288105fd38f078 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271824.931545:0:3592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c600/0x99288105fd38f078 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788271824.931992:0:6462:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f6eb4074d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f6e84eb1800 00000020:00080000:0.0:1788271824.932011:0:6462:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1788271824.932023:0:6515:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1788271824.932063:0:6515:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:2.0:1788271824.932092:0:9475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:2.0:1788271824.932098:0:9475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:1.0:1788271825.310609:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271826.334839:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271826.533426:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271826.536281:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577501952 00000100:00100000:2.0:1788271826.536298:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577501952 00000100:00100000:2.0:1788271826.536405:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 147 00000100:00100000:2.0:1788271826.536416:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8301dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+13:11072:x1875138577501952:12345-192.168.201.3@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788271826.536543:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8301dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+13:11072:x1875138577501952:12345-192.168.201.3@tcp:60:lhsmtool_posix.0 Request processed in 129us (3134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271826.536551:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 147 00000100:00080000:1.0:1788271826.536819:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788271826.559733:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271826.561460:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577502080 00000100:00100000:2.0:1788271826.561476:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577502080 00000100:00100000:2.0:1788271826.561575:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 148 00000100:00100000:2.0:1788271826.561590:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:11072:x1875138577502080:12345-192.168.201.3@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788271826.561734:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:11072:x1875138577502080:12345-192.168.201.3@tcp:60:lhsmtool_posix.0 Request processed in 149us (2017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271826.561742:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 148 00000100:00080000:1.0:1788271826.561842:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788271826.571120:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271826.571462:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577502336 00000100:00100000:3.0:1788271826.571478:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577502336 00000100:00100000:3.0:1788271826.571577:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 35 00000100:00100000:3.0:1788271826.571590:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+13:11072:x1875138577502336:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788271826.572453:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+14:11072:x1875138577502336:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 Request processed in 860us (1344us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1788271826.572464:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 35 00000100:00100000:0.0:1788271826.884209:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271826.884880:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577502464 00000100:00100000:2.0:1788271826.884899:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577502464 00000100:00100000:2.0:1788271826.885065:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 149 00000100:00100000:2.0:1788271826.885077:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:956fb91b-4885-4e88-90fb-3061936b51ca+5:11885:x1875138577502464:12345-192.168.201.3@tcp:101:lsof.0 00010000:00010000:2.0:1788271826.885109:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271826.885137:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38f104 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd5e1 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271826.885252:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38f10b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271826.885271:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38f10b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271826.885285:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38f10b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271826.885351:0:6483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788271826.885356:0:6483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788271826.885408:0:6483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38f10b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271826.885439:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38f104 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5e1 expref: 7 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271826.885463:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38f10b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5e1 expref: 6 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271826.885473:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6d83058400) 00010000:00010000:2.0:1788271826.885476:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788271826.885500:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e813a0e00, rc 0) 00000100:00100000:2.0:1788271826.885678:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:956fb91b-4885-4e88-90fb-3061936b51ca+6:11885:x1875138577502464:12345-192.168.201.3@tcp:101:lsof.0 Request processed in 545us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271826.885685:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 149 00000100:00080000:1.0:1788271826.887943:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788271827.359957:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271827.866787:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271827.866831:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271827.866863:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271827.866895:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271827.866920:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271827.866944:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271827.866995:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271827.867033:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577503104 00000100:00100000:3.0:1788271827.867046:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577503104 00000100:00100000:3.0:1788271827.867218:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577502976 00000100:00100000:3.0:1788271827.867222:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577502976 00000100:00100000:3.0:1788271827.867251:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 112 00000100:00100000:3.0:1788271827.867263:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2395:x1875138577503104:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271827.867381:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2395:x1875138577503104:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 120us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271827.867391:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 112 00000100:00100000:3.0:1788271827.867414:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 113 00000100:00100000:3.0:1788271827.867420:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577502976:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271827.867447:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577502976:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 27us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271827.867453:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 113 00000100:00100000:3.0:1788271827.867474:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577502848 00000100:00100000:3.0:1788271827.867478:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577502848 00000100:00100000:3.0:1788271827.867502:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577503360 00000100:00100000:3.0:1788271827.867506:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577503360 00000100:00100000:3.0:1788271827.867522:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 285 00000100:00100000:3.0:1788271827.867528:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577502848:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271827.867559:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577502848:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 31us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271827.867566:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 285 00000100:00100000:3.0:1788271827.867577:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577502720 00000100:00100000:3.0:1788271827.867581:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577502720 00000100:00100000:3.0:1788271827.867592:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577503232 00000100:00100000:3.0:1788271827.867594:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577503232 00000100:00100000:3.0:1788271827.867606:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 286 00000100:00100000:3.0:1788271827.867612:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:956fb91b-4885-4e88-90fb-3061936b51ca+5:2395:x1875138577503360:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271827.867691:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:956fb91b-4885-4e88-90fb-3061936b51ca+5:2395:x1875138577503360:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 78us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271827.867707:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 286 00000100:00100000:3.0:1788271827.867719:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 287 00000100:00100000:3.0:1788271827.867725:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+14:2395:x1875138577502720:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271827.867754:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+14:2395:x1875138577502720:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 29us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271827.867760:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 287 00000100:00100000:3.0:1788271827.867769:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 288 00000100:00100000:3.0:1788271827.867774:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:956fb91b-4885-4e88-90fb-3061936b51ca+6:2395:x1875138577503232:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271827.867793:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:956fb91b-4885-4e88-90fb-3061936b51ca+6:2395:x1875138577503232:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 19us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271827.867799:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 288 00000100:00080000:2.0:1788271827.869074:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788271827.869085:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788271827.869089:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788271827.869220:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577502592 00000100:00100000:1.0:1788271827.869235:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577502592 00000100:00100000:1.0:1788271827.869305:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 382 00000100:00100000:1.0:1788271827.869317:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2395:x1875138577502592:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271827.869404:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2395:x1875138577502592:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 90us (2633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271827.869413:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 382 00010000:00010000:2.0:1788271828.382421:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271828.511717:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788271828.511772:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d839cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590150528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788271828.511882:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271828.511927:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590150656:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788271828.511989:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8301df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590150400:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788271828.512009:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271828.512093:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590150656 00000100:00100000:0.0:1788271828.512102:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590150656 00000100:00100000:0.0:1788271828.512162:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788271828.512171:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590150656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788271828.512209:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788271828.512290:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590150528 00000100:00100000:2.0:1788271828.512295:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590150528 00000100:00100000:2.0:1788271828.512339:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788271828.512347:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8301d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590150528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788271828.512367:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788271828.515661:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271828.515718:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590150656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3538us (3703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271828.515743:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:1.0:1788271828.516177:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788271828.516178:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590150656:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788271828.516310:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590150400 00000100:00100000:0.0:1788271828.516318:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590150400 00000100:00100000:0.0:1788271828.516372:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788271828.516380:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8301ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590150400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788271828.516401:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788271828.516466:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8301ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590150400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271828.516473:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788271828.516520:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8301df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590150400:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788271828.516589:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788271828.516668:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8301d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590150528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4322us (4787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271828.516678:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788271828.516817:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d839cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590150528:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788271829.406353:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271829.534234:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590150784:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788271829.534342:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271829.534521:0:14136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590150784 00000100:00100000:2.0:1788271829.534531:0:14136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590150784 00000100:00100000:2.0:1788271829.534604:0:14136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788271829.534616:0:14136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590150784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788271829.534710:0:14136:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788271829.534782:0:14136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590150784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 167us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271829.534801:0:14136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788271829.535360:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590150784:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788271830.046614:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d839cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875138590151040:0@lo:400:kworker.0 00000100:00100000:0.0:1788271830.046720:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d839cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590151168:0@lo:400:kworker.0 00000100:00100000:0.0:1788271830.046783:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271830.046952:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfc7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3606:1875138590151680:0@lo:400:kworker.0 00000100:00100000:0.0:1788271830.046980:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271830.047001:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e84d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3606:1875138590152192:0@lo:400:kworker.0 00000100:00100000:0.0:1788271830.047023:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271830.047047:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788271830.047053:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ecca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875138590151296:0@lo:400:kworker.0 00000100:00100000:0.0:1788271830.047073:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271830.047095:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfc7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590151808:0@lo:400:kworker.0 00000100:00100000:0.0:1788271830.047127:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271830.047143:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e84d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590152320:0@lo:400:kworker.0 00000100:00100000:0.0:1788271830.047163:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271830.047207:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590151168 00000100:00100000:0.0:1788271830.047231:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590151168 00000100:00100000:0.0:1788271830.047274:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788271830.047290:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e84d02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590151168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271830.047345:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e84d02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590151168:12345-0@lo:400:kworker.0 Request processed in 57us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271830.047353:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788271830.047390:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590151680 00000100:00100000:0.0:1788271830.047394:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590151680 00000100:00100000:0.0:1788271830.047428:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590152192 00000100:00100000:0.0:1788271830.047431:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590152192 00000100:00100000:0.0:1788271830.047446:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590151296 00000100:00100000:0.0:1788271830.047449:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590151296 00000100:00100000:0.0:1788271830.047461:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788271830.047467:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e84d02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1875138590151680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271830.047498:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e84d02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1875138590151680:12345-0@lo:400:kworker.0 Request processed in 32us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271830.047505:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788271830.047516:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788271830.047522:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfd1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1875138590152192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271830.047549:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfd1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1875138590152192:12345-0@lo:400:kworker.0 Request processed in 27us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271830.047555:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788271830.047569:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788271830.047575:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfd1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1875138590151296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271830.047599:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfd1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1875138590151296:12345-0@lo:400:kworker.0 Request processed in 25us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271830.047605:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00080000:0.0:1788271830.047709:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788271830.047730:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271830.047750:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfc78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3609:1875138590151552:0@lo:400:kworker.0 00000100:00100000:0.0:1788271830.047769:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271830.047783:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfc7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3609:1875138590152064:0@lo:400:kworker.0 00000100:00100000:0.0:1788271830.047803:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271830.047820:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1788271830.047827:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d839cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590150912:0@lo:400:kworker.0 00000100:00100000:0.0:1788271830.047848:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271830.047863:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590151424:0@lo:400:kworker.0 00000100:00100000:0.0:1788271830.047876:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271830.047885:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfc79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590151936:0@lo:400:kworker.0 00000100:00100000:0.0:1788271830.047908:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271830.047919:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6e84d02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590152448:0@lo:400:kworker.0 00000100:00100000:0.0:1788271830.047931:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271830.047946:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590150912 00000100:00100000:0.0:1788271830.047948:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590150912 00000100:00100000:0.0:1788271830.047967:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1788271830.047971:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3609:x1875138590150912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271830.047991:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3609:x1875138590150912:12345-0@lo:400:kworker.0 Request processed in 20us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271830.047996:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1788271830.048013:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590151424 00000100:00100000:0.0:1788271830.048015:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590151424 00000100:00100000:0.0:1788271830.048025:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788271830.048029:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb0ccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590151424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271830.048045:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb0ccd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590151424:12345-0@lo:400:kworker.0 Request processed in 16us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271830.048054:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788271830.048067:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590151040 00000100:00100000:0.0:1788271830.048069:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590151040 00000100:00100000:0.0:1788271830.048078:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590151552 00000100:00100000:0.0:1788271830.048079:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590151552 00000100:00100000:0.0:1788271830.048089:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590152064 00000100:00100000:0.0:1788271830.048090:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590152064 00000100:00100000:0.0:1788271830.048098:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788271830.048101:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfd1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875138590151040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271830.048138:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfd1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875138590151040:12345-0@lo:400:kworker.0 Request processed in 36us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271830.048144:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788271830.048159:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788271830.048165:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfd1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875138590151552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271830.048190:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfd1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875138590151552:12345-0@lo:400:kworker.0 Request processed in 26us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271830.048196:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788271830.048207:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788271830.048212:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3f64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875138590152064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271830.048236:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3f64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875138590152064:12345-0@lo:400:kworker.0 Request processed in 24us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271830.048242:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00080000:0.0:1788271830.048254:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788271830.048281:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d839cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590150912:0@lo:400:kworker.0 00000100:00100000:0.0:1788271830.048292:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ecea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590151424:0@lo:400:kworker.0 00000100:00100000:0.0:1788271830.048313:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d839cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875138590151040:0@lo:400:kworker.0 00000100:00100000:0.0:1788271830.048322:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfc78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3609:1875138590151552:0@lo:400:kworker.0 00000100:00100000:0.0:1788271830.048330:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfc7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3609:1875138590152064:0@lo:400:kworker.0 00000100:00100000:0.0:1788271830.048355:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8301ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590152576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788271830.048380:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271830.048428:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ecca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875138590151296:0@lo:400:kworker.0 00000100:00100000:0.0:1788271830.048438:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d839cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590151168:0@lo:400:kworker.0 00010000:00080000:0.0:1788271830.048451:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6ebfc7b800 x1875138590151680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271830.048462:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfc7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3606:1875138590151680:0@lo:400:kworker.0 00010000:00080000:0.0:1788271830.048472:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6e84d01180 x1875138590152192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271830.048480:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e84d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3606:1875138590152192:0@lo:400:kworker.0 00000100:00100000:2.0:1788271830.048579:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590151808 00000100:00100000:2.0:1788271830.048584:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590151808 00000100:00100000:2.0:1788271830.048646:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590152320 00000100:00100000:2.0:1788271830.048650:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590152320 00000100:00100000:2.0:1788271830.048671:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590151936 00000100:00100000:2.0:1788271830.048674:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590151936 00000100:00100000:2.0:1788271830.048685:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590152448 00000100:00100000:2.0:1788271830.048687:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590152448 00000100:00100000:2.0:1788271830.048704:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788271830.048712:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfd1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590151808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271830.048759:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfd1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590151808:12345-0@lo:400:kworker.0 Request processed in 48us (1641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271830.048764:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788271830.048776:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788271830.048783:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfd1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590152320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271830.048809:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfd1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590152320:12345-0@lo:400:kworker.0 Request processed in 27us (1645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271830.048814:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788271830.048826:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788271830.048831:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8399ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590151936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271830.048860:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8399ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590151936:12345-0@lo:400:kworker.0 Request processed in 30us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271830.048866:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788271830.048875:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788271830.048881:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8399e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590152448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271830.048904:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8399e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590152448:12345-0@lo:400:kworker.0 Request processed in 24us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271830.048915:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788271830.048961:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfc7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590151808:0@lo:400:kworker.0 00000100:00100000:2.0:1788271830.048971:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e84d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590152320:0@lo:400:kworker.0 00000100:00100000:2.0:1788271830.049007:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfc79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590151936:0@lo:400:kworker.0 00000100:00100000:2.0:1788271830.049015:0:3609:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:2.0:1788271830.049019:0:3609:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:2.0:1788271830.049034:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6e84d02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590152448:0@lo:400:kworker.0 00000100:00100000:1.0:1788271830.050232:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590152576 00000100:00100000:1.0:1788271830.050259:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590152576 00000100:00100000:1.0:1788271830.050307:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788271830.050315:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8399f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590152576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788271830.050343:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788271830.050419:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8399f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590152576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (2038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271830.050426:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788271830.050484:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8301ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590152576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788271830.050733:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788271830.050746:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590152704:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788271830.050783:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271830.050816:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590152704 00000100:00100000:2.0:1788271830.050820:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590152704 00000100:00100000:2.0:1788271830.050844:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788271830.050850:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590152704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788271830.050860:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788271830.050893:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83369180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590152704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271830.050900:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788271830.050928:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590152704:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788271830.051011:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788271830.051016:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1788271830.234463:0:14526:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 10:10:28 (1788271828) 00010000:00010000:1.0:1788271830.433520:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788271831.072547:0:6462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000020:00080000:0.0:1788271831.072564:0:6462:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1788271831.072644:0:6515:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1788271831.072657:0:6515:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1788271831.454146:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271831.799603:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271831.800744:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577503616 00000100:00100000:2.0:1788271831.800757:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577503616 00000100:00100000:2.0:1788271831.800853:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 150 00000100:00100000:2.0:1788271831.800866:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8399df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+13:12153:x1875138577503616:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788271831.800886:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271831.800908:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38f112 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd5e8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271831.801003:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f119 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271831.801017:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f119 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271831.801029:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f119 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788271831.801236:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788271831.801269:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f120 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271831.801278:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f120 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271831.801286:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f120 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271831.801395:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f127 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271831.801404:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f127 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271831.801411:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f127 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271831.801420:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788271831.801580:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f119 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271831.801589:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f119 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271831.801603:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f119 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271831.801609:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e20a00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271831.801614:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f119 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271831.801657:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f119 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271831.801670:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f6e90141400) 00010000:00010000:2.0:1788271831.801674:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271831.801679:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f119 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271831.801686:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f119 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271831.801700:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f120 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271831.801706:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f120 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271831.801712:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f120 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271831.801717:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e20200 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271831.801720:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f120 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271831.801736:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f120 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271831.801745:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8f6eb35a5600) 00010000:00010000:2.0:1788271831.801747:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271831.801751:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f120 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271831.801757:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f120 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271831.802465:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0a00/0x99288105fd38f112 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5e8 expref: 16 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271831.805337:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f127 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5e8 expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271831.805350:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f6e90141900) 00010000:00010000:2.0:1788271831.805353:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271831.805357:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e21000, rc 0) 00000100:00100000:2.0:1788271831.805449:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8399df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+15:12153:x1875138577503616:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 4585us (5854us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1788271831.805459:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 150 00000100:00100000:0.0:1788271831.816224:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271831.816323:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271831.816404:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577503744 00000100:00100000:2.0:1788271831.816416:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577503744 00000100:00100000:2.0:1788271831.816487:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 151 00000100:00100000:2.0:1788271831.816498:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8399fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+15:12153:x1875138577503744:12345-192.168.201.3@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788271831.816667:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8399fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+15:12153:x1875138577503744:12345-192.168.201.3@tcp:59:lhsmtool_posix.0 Request processed in 170us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271831.816675:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 151 00000100:00100000:3.0:1788271831.817252:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577503872 00000100:00100000:3.0:1788271831.817259:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577503872 00000100:00100000:3.0:1788271831.817305:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 10 00000100:00100000:3.0:1788271831.817312:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8399d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+15:2396:x1875138577503872:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788271831.817325:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271831.817350:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f127 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5e8 expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271831.817370:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f6e90141900) 00010000:00010000:3.0:1788271831.817382:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271831.817418:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8399d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+14:2396:x1875138577503872:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 106us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271831.817426:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 10 00000100:00100000:0.0:1788271831.835897:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271831.836080:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577504000 00000100:00100000:2.0:1788271831.836100:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577504000 00000100:00100000:2.0:1788271831.836177:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 152 00000100:00100000:2.0:1788271831.836187:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8399c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:12153:x1875138577504000:12345-192.168.201.3@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788271831.836321:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8399c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:12153:x1875138577504000:12345-192.168.201.3@tcp:59:lhsmtool_posix.0 Request processed in 135us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271831.836330:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 152 00000100:00080000:0.0:1788271831.836457:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:1.0:1788271831.841781:0:13766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788271832.479111:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788271832.479375:0:13762:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788271832.479381:0:13762:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788271832.480099:0:13762:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788271832.480110:0:13762:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788271832.987485:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271832.987581:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271832.987615:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271832.987757:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577504512 00000100:00100000:3.0:1788271832.987767:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577504512 00000100:00100000:3.0:1788271832.987832:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 118 00000100:00100000:3.0:1788271832.987843:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2397:x1875138577504512:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271832.987911:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2397:x1875138577504512:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 70us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271832.987919:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 118 00000100:00100000:3.0:1788271832.988355:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577504256 00000100:00100000:3.0:1788271832.988360:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577504256 00000100:00100000:3.0:1788271832.988396:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577504768 00000100:00100000:3.0:1788271832.988399:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577504768 00000100:00100000:3.0:1788271832.988423:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 295 00000100:00100000:3.0:1788271832.988430:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+14:2397:x1875138577504256:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271832.988465:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+14:2397:x1875138577504256:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 35us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271832.988471:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 295 00000100:00100000:3.0:1788271832.988485:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 296 00000100:00100000:3.0:1788271832.988492:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:956fb91b-4885-4e88-90fb-3061936b51ca+6:2397:x1875138577504768:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271832.988673:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:956fb91b-4885-4e88-90fb-3061936b51ca+6:2397:x1875138577504768:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 181us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271832.988680:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 296 00000100:00100000:3.0:1788271832.988778:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271832.988817:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271832.988908:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271832.988930:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271832.988949:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577504384 00000100:00100000:3.0:1788271832.988953:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577504384 00000100:00100000:3.0:1788271832.988974:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577504896 00000100:00100000:3.0:1788271832.988977:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577504896 00000100:00100000:3.0:1788271832.988999:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 297 00000100:00100000:3.0:1788271832.989007:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2397:x1875138577504384:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271832.989110:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2397:x1875138577504384:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 103us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271832.989117:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 297 00000100:00100000:3.0:1788271832.989131:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 298 00000100:00100000:3.0:1788271832.989137:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:956fb91b-4885-4e88-90fb-3061936b51ca+5:2397:x1875138577504896:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271832.989159:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:956fb91b-4885-4e88-90fb-3061936b51ca+5:2397:x1875138577504896:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 22us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271832.989166:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 298 00000100:00100000:2.0:1788271832.989304:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577504128 00000100:00100000:2.0:1788271832.989308:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577504128 00000100:00100000:2.0:1788271832.989341:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 384 00000100:00100000:2.0:1788271832.989348:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2397:x1875138577504128:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788271832.989381:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2397:x1875138577504128:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 34us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271832.989388:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 384 00000100:00100000:2.0:1788271832.989416:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577504640 00000100:00100000:2.0:1788271832.989419:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577504640 00000100:00100000:2.0:1788271832.989444:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 119 00000100:00100000:2.0:1788271832.989450:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2397:x1875138577504640:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788271832.989486:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2397:x1875138577504640:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 37us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271832.989510:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 119 00000100:00080000:0.0:1788271832.990029:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788271832.990036:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788271832.990039:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788271832.990041:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1788271833.506246:0:13762:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788271833.506255:0:13762:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788271833.506357:0:13762:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1788271833.506364:0:13762:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788271833.508515:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271833.573923:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271833.574095:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577505024 00000100:00100000:2.0:1788271833.574107:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577505024 00000100:00100000:2.0:1788271833.574194:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 153 00000100:00100000:2.0:1788271833.574205:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8301ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+14:12195:x1875138577505024:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788271833.574229:0:12164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271833.574251:0:12164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f135 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd5ef expref: -99 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.574330:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f13c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.574345:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f13c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.574357:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f13c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.574371:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f143 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.574379:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f143 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.574385:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f143 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.574431:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f13c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.574448:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f13c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.574455:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f13c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.574461:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e20a00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271833.574466:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f13c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.574473:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f13c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.574485:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6d83058400) 00010000:00010000:2.0:1788271833.574488:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271833.574494:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f13c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.574499:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f13c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.574511:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f143 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.574517:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f143 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.574522:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f143 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.574527:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e21e00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271833.574535:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f143 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.574541:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f143 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.574549:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8f6eb35a5800) 00010000:00010000:2.0:1788271833.574551:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271833.574553:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f143 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.574571:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f143 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.574602:0:12164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f135 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5ef expref: 15 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.574612:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6d83058400) 00010000:00010000:2.0:1788271833.574614:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271833.574643:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f135 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5ef expref: 15 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.574654:0:12164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e21000, rc 0) 00000100:00100000:2.0:1788271833.574722:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8301ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+14:12195:x1875138577505024:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 519us (808us total) trans 0 rc 301/301 00000100:00100000:2.0:1788271833.574729:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 153 00000100:00080000:0.0:1788271833.574892:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271833.579149:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271833.579869:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577505280 00000100:00100000:2.0:1788271833.579880:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577505280 00000100:00100000:2.0:1788271833.579947:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 154 00000100:00100000:2.0:1788271833.579957:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8301c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+14:12195:x1875138577505280:12345-192.168.201.3@tcp:36:lfs.0 00010000:00010000:2.0:1788271833.580022:0:9899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271833.580052:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079800/0x99288105fd38ea89 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd413 expref: 14 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.580078:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6d83058400) 00010000:00010000:2.0:1788271833.580083:0:9899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788271833.580143:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f14a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.580158:0:9899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38f10b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5e1 expref: 5 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.580167:0:9899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f14a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.580196:0:9899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38f10b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5e1 expref: 5 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.580209:0:9899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38f10b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5e1 expref: 5 pid: 6483 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271833.580224:0:9899:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfc74380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9899:1875138590152832:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788271833.580310:0:9899:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e856bbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788271833.582786:0:9899:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfc74380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9899:1875138590152832:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788271833.582814:0:9899:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f14a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271833.585077:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271833.592147:0:9485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577505408 00000100:00100000:2.0:1788271833.592183:0:9485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577505408 00010000:00010000:2.0:1788271833.592235:0:9485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38f10b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5e1 expref: 6 pid: 6483 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271833.592290:0:9485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 81 00000100:00100000:2.0:1788271833.592302:0:9485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8301c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:956fb91b-4885-4e88-90fb-3061936b51ca+6:2397:x1875138577505408:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271833.592317:0:9485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271833.592324:0:9485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38f10b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5e1 expref: 6 pid: 6483 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.592338:0:9485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38f10b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5e1 expref: 6 pid: 6483 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.592361:0:9485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0e00/0x99288105fd38f10b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5e1 expref: 6 pid: 6483 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.592381:0:9485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6d83058400) 00010000:00010000:2.0:1788271833.592385:0:9485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f14a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.592394:0:9485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f14a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.592401:0:9485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f14a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.592434:0:9485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788271833.592450:0:9899:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f14a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.592464:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f14a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.592484:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f151 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.592491:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f151 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271833.592498:0:9485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8301c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:956fb91b-4885-4e88-90fb-3061936b51ca+5:2397:x1875138577505408:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 198us (7431us total) trans 0 rc 0/0 00010000:00010000:1.0:1788271833.592507:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f151 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271833.592523:0:9485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 81 00010000:00010000:1.0:1788271833.593038:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38f158 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.593047:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38f158 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.593051:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38f158 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788271833.593074:0:9899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d06b399 reply state 00000000f552625c transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38f158 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.593082:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38f158 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.593087:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f6d82060100) 00010000:00010000:1.0:1788271833.593089:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788271833.593092:0:9899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788271833.593097:0:9899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788271833.593107:0:9899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f14a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.593112:0:9899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f14a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.593117:0:9899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f14a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.593121:0:9899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e20200 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271833.593124:0:9899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f14a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.593128:0:9899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f14a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.593134:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6d83058400) 00010000:00010000:1.0:1788271833.593135:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271833.593138:0:9899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f14a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.593143:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f14a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788271833.593156:0:9899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d06b399 reply state 00000000f552625c transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f151 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.593162:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f151 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.593166:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8f6d82060400) 00010000:00010000:1.0:1788271833.593168:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788271833.593173:0:9899:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788271833.593243:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8301c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+15:12195:x1875138577505280:12345-192.168.201.3@tcp:36:lfs.0 Request processed in 13288us (14103us total) trans 4294967419 rc 0/0 00000100:00100000:1.0:1788271833.593249:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 154 00000100:00100000:3.0:1788271833.629811:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d832be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590152960:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788271833.630119:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271833.630238:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8301df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590153088:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788271833.630415:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271833.630468:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590153088 00000100:00100000:3.0:1788271833.630476:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590153088 00000100:00100000:3.0:1788271833.630543:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788271833.630554:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590153088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788271833.630592:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271833.630664:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590153088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271833.630672:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788271833.630749:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8301df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590153088:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788271833.631173:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8399f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590153216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788271833.631209:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271833.631276:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590152960 00000100:00100000:0.0:1788271833.631281:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590152960 00000100:00100000:0.0:1788271833.631313:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788271833.631320:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590152960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788271833.631344:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788271833.631385:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590152960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (1496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271833.631392:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:0.0:1788271833.631410:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788271833.631526:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590153216 00000100:00100000:1.0:1788271833.631530:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590153216 00000100:00100000:0.0:1788271833.631573:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d832be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590152960:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1788271833.633844:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788271833.634268:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788271833.634285:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590153216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788271833.634311:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788271833.634387:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590153216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (3176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271833.634395:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788271833.636118:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8399f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590153216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788271833.672391:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271833.672514:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577505536 00000100:00100000:0.0:1788271833.672524:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577505536 00000100:00100000:0.0:1788271833.672757:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 155 00000100:00100000:0.0:1788271833.672771:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+15:12203:x1875138577505536:12345-192.168.201.3@tcp:101:lctl.0 00010000:00010000:0.0:1788271833.672799:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271833.672825:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c000/0x99288105fd38f15f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd5f6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.675904:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38f166 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.675928:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38f166 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.675939:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38f166 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271833.675991:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788271833.675994:0:6485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788271833.676021:0:6485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38f166 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.676090:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c000/0x99288105fd38f15f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5f6 expref: 17 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.676113:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38f166 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5f6 expref: 16 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.676122:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6d83055900) 00010000:00010000:1.0:1788271833.676124:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788271833.676128:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e92d33000, rc 0) 00000100:00100000:1.0:1788271833.676210:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+16:12203:x1875138577505536:12345-192.168.201.3@tcp:101:lctl.0 Request processed in 3442us (3829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271833.676220:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 155 00000100:00100000:2.0:1788271833.748547:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271833.748727:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577505664 00000100:00100000:3.0:1788271833.748736:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577505664 00000100:00100000:2.0:1788271833.749735:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 156 00000100:00100000:2.0:1788271833.749747:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+16:12209:x1875138577505664:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:2.0:1788271833.749767:0:12164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271833.749786:0:12164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21de000/0x99288105fd38f16d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd5fd expref: -99 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.749849:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21de800/0x99288105fd38f174 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.749864:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21de800/0x99288105fd38f174 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.749875:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21de800/0x99288105fd38f174 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.749886:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21df800/0x99288105fd38f17b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.749893:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21df800/0x99288105fd38f17b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.749900:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21df800/0x99288105fd38f17b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.750066:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6c00/0x99288105fd38f182 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.750076:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6c00/0x99288105fd38f182 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.750091:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6c00/0x99288105fd38f182 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271833.750126:0:12164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788271833.750130:0:12164:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788271833.750150:0:12164:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6c00/0x99288105fd38f182 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.750162:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21de800/0x99288105fd38f174 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.750169:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21de800/0x99288105fd38f174 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.750176:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21de800/0x99288105fd38f174 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.750182:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6ec21de800 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271833.750187:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21de800/0x99288105fd38f174 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.750194:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21de800/0x99288105fd38f174 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.750207:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6d83055900) 00010000:00010000:2.0:1788271833.750210:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271833.750214:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21de800/0x99288105fd38f174 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.750221:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21de800/0x99288105fd38f174 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.750307:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21df800/0x99288105fd38f17b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.750315:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21df800/0x99288105fd38f17b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.750321:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21df800/0x99288105fd38f17b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.750327:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6ec21df800 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271833.750330:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21df800/0x99288105fd38f17b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.750337:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21df800/0x99288105fd38f17b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.750346:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8f6d82060400) 00010000:00010000:2.0:1788271833.750348:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271833.750352:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21df800/0x99288105fd38f17b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.750358:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21df800/0x99288105fd38f17b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.750439:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6ec21de000/0x99288105fd38f16d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5fd expref: 18 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.750457:0:12164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6c00/0x99288105fd38f182 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5fd expref: 17 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.750475:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f6d82060100) 00010000:00010000:2.0:1788271833.750478:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788271833.750481:0:12164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d833f6c00, rc 0) 00000100:00100000:2.0:1788271833.750548:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+17:12209:x1875138577505664:12345-192.168.201.3@tcp:101:bash.0 Request processed in 802us (2009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271833.750555:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 156 00000100:00100000:2.0:1788271833.755301:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271833.755562:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577505920 00000100:00100000:1.0:1788271833.755572:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577505920 00000100:00100000:1.0:1788271833.755789:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 157 00000100:00100000:1.0:1788271833.755800:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+17:12209:x1875138577505920:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:1.0:1788271833.755821:0:9899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271833.755842:0:9899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f189 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd604 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.756661:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f190 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.756679:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f190 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.756691:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f190 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.759012:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38f197 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.759029:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38f197 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.759037:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38f197 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788271833.759418:0:9899:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:1.0:1788271833.759555:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f19e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.759564:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f19e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.759572:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f19e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.759962:0:9899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f190 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.759971:0:9899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f190 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.760034:0:9899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f190 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.760041:0:9899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e92d32600 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271833.760046:0:9899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f190 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.760087:0:9899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f190 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.760103:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f6d82060100) 00010000:00010000:1.0:1788271833.760106:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271833.760111:0:9899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f190 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.760117:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f190 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788271833.760131:0:9899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ee2a09a4 reply state 0000000065273e78 transno 4294967420 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38f197 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.760142:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38f197 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.760149:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f6d82060600) 00010000:00010000:1.0:1788271833.760151:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788271833.760155:0:9899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788271833.760195:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f189 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd604 expref: 20 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.760212:0:9899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f19e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd604 expref: 19 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.760221:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6d82060f00) 00010000:00010000:1.0:1788271833.760223:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788271833.760226:0:9899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e21000, rc 0) 00000100:00100000:1.0:1788271833.760306:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+20:12209:x1875138577505920:12345-192.168.201.3@tcp:101:bash.0 Request processed in 4507us (5013us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1788271833.760321:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 157 00000100:00100000:1.0:1788271833.765211:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271833.765355:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577506048 00000100:00100000:3.0:1788271833.765366:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577506048 00000100:00100000:3.0:1788271833.765533:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 55 00000100:00100000:3.0:1788271833.765544:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577506048:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:3.0:1788271833.765565:0:8397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271833.765778:0:8397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000faf53b37/0x99288105fd38f1ac lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd60b expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788271833.765808:0:8397:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788271833.765826:0:8397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=394s v=(0 0) 00010000:00010000:3.0:1788271833.765832:0:8397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271833.765842:0:8397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000faf53b37/0x99288105fd38f1ac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd60b expref: 6 pid: 8397 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271833.765880:0:8397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000faf53b37/0x99288105fd38f1ac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd60b expref: 6 pid: 8397 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271833.765894:0:8397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c4000, rc 0) 00000100:00100000:3.0:1788271833.766014:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2395:x1875138577506048:12345-192.168.201.3@tcp:101:bash.0 Request processed in 471us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271833.766021:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 55 00000100:00100000:2.0:1788271833.769415:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271833.769473:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577506176 00000100:00100000:3.0:1788271833.769484:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577506176 00000100:00100000:3.0:1788271833.769540:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 56 00000100:00100000:3.0:1788271833.769550:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:12209:x1875138577506176:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:3.0:1788271833.769659:0:8398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271833.769677:0:8398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061f372ab/0x99288105fd38f1b3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd612 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271833.769709:0:8398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000faf53b37/0x99288105fd38f1ac lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd60b expref: 7 pid: 8397 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271833.769718:0:8398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271833.769723:0:8398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271833.769728:0:8398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061f372ab/0x99288105fd38f1b3 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd612 expref: 7 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271833.769762:0:8398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000faf53b37/0x99288105fd38f1ac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd60b expref: 7 pid: 8397 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271833.769788:0:8398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000faf53b37/0x99288105fd38f1ac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd60b expref: 7 pid: 8397 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271833.769799:0:8398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d832bfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8398:1875138590153344:192.168.201.3@tcp:104: 00000100:00100000:3.0:1788271833.769885:0:8398:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e854a0840 going to sleep for 11 seconds 00000100:00100000:2.0:1788271833.775338:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271833.775406:0:8398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d832bfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8398:1875138590153344:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788271833.775441:0:8398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000061f372ab/0x99288105fd38f1b3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd612 expref: 7 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271833.775464:0:8398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c4800, rc 0) 00000100:00100000:0.0:1788271833.775545:0:9486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577506304 00000100:00100000:0.0:1788271833.775552:0:9486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577506304 00000100:00100000:3.0:1788271833.775672:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+8:12209:x1875138577506176:12345-192.168.201.3@tcp:101:bash.0 Request processed in 6122us (6265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271833.775681:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 56 00010000:00010000:0.0:1788271833.775774:0:9486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000faf53b37/0x99288105fd38f1ac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd60b expref: 7 pid: 8397 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271833.775832:0:9486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 82 00000100:00100000:0.0:1788271833.775842:0:9486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f42d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2398:x1875138577506304:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271833.775855:0:9486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271833.775876:0:9486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000faf53b37/0x99288105fd38f1ac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd60b expref: 7 pid: 8397 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271833.775890:0:9486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000faf53b37/0x99288105fd38f1ac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd60b expref: 7 pid: 8397 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271833.775912:0:9486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000faf53b37/0x99288105fd38f1ac lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd60b expref: 7 pid: 8397 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271833.775926:0:9486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271833.775931:0:9486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271833.775939:0:9486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000061f372ab/0x99288105fd38f1b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd612 expref: 6 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271833.775950:0:9486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061f372ab/0x99288105fd38f1b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd612 expref: 6 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271833.776058:0:9486:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000061f372ab/0x99288105fd38f1b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd612 expref: 6 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271833.776075:0:9486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8399d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9486:1875138590153472:192.168.201.3@tcp:105: 00000100:00100000:0.0:1788271833.776132:0:9486:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d9bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788271833.783285:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271833.783507:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577506560 00000100:00100000:2.0:1788271833.783517:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577506560 00000100:00100000:2.0:1788271833.783579:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 36 00000100:00100000:2.0:1788271833.783761:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+20:12209:x1875138577506560:12345-192.168.201.3@tcp:35:bash.0 00000100:00100000:2.0:1788271833.784077:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+21:12209:x1875138577506560:12345-192.168.201.3@tcp:35:bash.0 Request processed in 319us (801us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1788271833.784085:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 36 00000100:00100000:0.0:1788271833.785533:0:9486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8399d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9486:1875138590153472:192.168.201.3@tcp:105: 00010000:00010000:0.0:1788271833.785557:0:9486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271833.785648:0:9486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f42d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2398:x1875138577506304:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 9806us (10319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271833.785658:0:9486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 82 00000100:00100000:1.0:1788271833.851195:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271833.851444:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577506816 00000100:00100000:2.0:1788271833.851454:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577506816 00000100:00100000:2.0:1788271833.851553:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 158 00000100:00100000:2.0:1788271833.851564:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+21:12219:x1875138577506816:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788271833.851587:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271833.851608:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7800/0x99288105fd38f1ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd619 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271833.851738:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788271833.851847:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7800/0x99288105fd38f1ba lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd619 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.851862:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6d83055900) 00010000:00010000:2.0:1788271833.851865:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788271833.851870:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7800/0x99288105fd38f1ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd619 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.851885:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d833f7800, rc 0) 00000100:00100000:2.0:1788271833.851948:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+22:12219:x1875138577506816:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 385us (762us total) trans 4294967422 rc 301/301 00000100:00100000:2.0:1788271833.851955:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 158 00000100:00100000:3.0:1788271833.858290:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271833.861205:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577507072 00000100:00100000:0.0:1788271833.861221:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577507072 00000100:00100000:0.0:1788271833.861285:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 37 00000100:00100000:0.0:1788271833.861295:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+22:12219:x1875138577507072:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:0.0:1788271833.861722:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+23:12219:x1875138577507072:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 427us (3439us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1788271833.864134:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 37 00000040:00080000:1.0:1788271833.886247:0:13766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788271833.944820:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271833.944935:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577507200 00000100:00100000:2.0:1788271833.944945:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577507200 00000100:00100000:2.0:1788271833.945014:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 159 00000100:00100000:2.0:1788271833.945025:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+23:12225:x1875138577507200:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788271833.945059:0:12164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271833.945082:0:12164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7800/0x99288105fd38f1c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd620 expref: -99 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.945154:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f1cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.945168:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f1cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.945180:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f1cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271833.945256:0:12164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788271833.945260:0:12164:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788271833.945285:0:12164:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f1cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.945318:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7800/0x99288105fd38f1c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd620 expref: 25 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.945339:0:12164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f1cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd620 expref: 24 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.945348:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f6d82060100) 00010000:00010000:2.0:1788271833.945352:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788271833.945355:0:12164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d833f6800, rc 0) 00000100:00100000:2.0:1788271833.945420:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+24:12225:x1875138577507200:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 396us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271833.945428:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 159 00000100:00100000:1.0:1788271833.951608:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271833.951797:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577507456 00000100:00100000:2.0:1788271833.951809:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577507456 00000100:00100000:2.0:1788271833.951868:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 160 00000100:00100000:2.0:1788271833.951885:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+24:12225:x1875138577507456:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788271833.951904:0:9899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271833.951924:0:9899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7800/0x99288105fd38f1d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd627 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.952019:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f1dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.952060:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f1dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.952072:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f1dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271833.952085:0:9899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788271833.952183:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7800/0x99288105fd38f1d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd627 expref: 27 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.952202:0:9899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f1dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd627 expref: 26 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.952211:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6d82060f00) 00010000:00010000:2.0:1788271833.952214:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788271833.952217:0:9899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d833f6000, rc 0) 00000100:00100000:2.0:1788271833.952279:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+26:12225:x1875138577507456:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 395us (681us total) trans 4294967424 rc 0/0 00000100:00100000:2.0:1788271833.952286:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 160 00000100:00100000:3.0:1788271833.956820:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271833.956991:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577507712 00000100:00100000:2.0:1788271833.957000:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577507712 00000100:00100000:2.0:1788271833.957070:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 161 00000100:00100000:2.0:1788271833.957081:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+26:12225:x1875138577507712:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788271833.957107:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271833.957131:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7c00/0x99288105fd38f1eb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd62e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.957258:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7200/0x99288105fd38f1f2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.957273:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7200/0x99288105fd38f1f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.957285:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7200/0x99288105fd38f1f2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271833.957307:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788271833.957408:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7c00/0x99288105fd38f1eb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd62e expref: 29 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.957428:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7200/0x99288105fd38f1f2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd62e expref: 28 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.957437:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6d82060f00) 00010000:00010000:2.0:1788271833.957441:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788271833.957444:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d833f7200, rc 0) 00000100:00100000:2.0:1788271833.957505:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+28:12225:x1875138577507712:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 426us (694us total) trans 4294967425 rc 0/0 00000100:00100000:2.0:1788271833.957513:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 161 00000100:00100000:3.0:1788271833.964464:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271833.964558:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577507840 00000100:00100000:1.0:1788271833.964576:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577507840 00000100:00100000:1.0:1788271833.964688:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 11 00000100:00100000:1.0:1788271833.964699:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+28:2396:x1875138577507840:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271833.964713:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271833.964736:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f1dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd627 expref: 28 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271833.964756:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6d82060f00) 00010000:00010000:1.0:1788271833.964760:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271833.964816:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+27:2396:x1875138577507840:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 119us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271833.964823:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 11 00000100:00100000:1.0:1788271833.967164:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271833.967259:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577507968 00000100:00100000:2.0:1788271833.967269:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577507968 00000100:00100000:2.0:1788271833.967337:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 57 00000100:00100000:2.0:1788271833.967348:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2397:x1875138577507968:12345-192.168.201.3@tcp:1:lfs.0 00010000:00010000:2.0:1788271833.967396:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfe705e0/0x99288105fd38f200 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.967432:0:8396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000061f372ab/0x99288105fd38f1b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd612 expref: 6 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.967442:0:8396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788271833.967446:0:8396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788271833.967451:0:8396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfe705e0/0x99288105fd38f200 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.967504:0:8396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000061f372ab/0x99288105fd38f1b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd612 expref: 6 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.967519:0:8396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000061f372ab/0x99288105fd38f1b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd612 expref: 6 pid: 8398 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271833.967534:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83a3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8396:1875138590153600:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788271833.967680:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e856bbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788271833.971421:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83a3f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8396:1875138590153600:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788271833.971455:0:8396:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bfe705e0/0x99288105fd38f200 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271833.972432:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271833.972713:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577508096 00000100:00100000:2.0:1788271833.972723:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577508096 00002000:00100000:2.0:1788271833.972773:0:8403:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8f6d83b09880 x1875138577508096/t0(0) o4->ef8df183-a1b1-4e56-bce5-924a894c4a71@192.168.201.3@tcp:739/0 lens 504/0 e 0 to 0 dl 1788271844 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788271833.972804:0:8403:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f6d83b09880 with x1875138577508096 ext(0->12) 00010000:00010000:2.0:1788271833.972812:0:8403:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000061f372ab/0x99288105fd38f1b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd612 expref: 7 pid: 8398 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.972826:0:8403:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000061f372ab/0x99288105fd38f1b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd612 expref: 7 pid: 8398 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788271833.972834:0:8403:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8f6d83b09880 00000100:00100000:2.0:1788271833.972869:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 2 00000100:00100000:2.0:1788271833.972990:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2398:x1875138577508096:12345-192.168.201.3@tcp:4:lfs.0 00000100:00100000:2.0:1788271833.974257:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+9:2398:x1875138577508096:12345-192.168.201.3@tcp:4:lfs.0 Request processed in 1265us (1824us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788271833.977754:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271833.977868:0:9485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577508224 00000100:00100000:0.0:1788271833.977889:0:9485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577508224 00010000:00010000:0.0:1788271833.977931:0:9485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000061f372ab/0x99288105fd38f1b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd612 expref: 10 pid: 8398 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271833.977976:0:9485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 83 00000100:00100000:0.0:1788271833.977986:0:9485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+10:2395:x1875138577508224:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271833.978002:0:9485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788271833.978023:0:9485:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788271833.978026:0:9485:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788271833 00002000:00010000:0.0:1788271833.978029:0:9485:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788271833 00002000:00010000:0.0:1788271833.978031:0:9485:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788271833 00002000:00010000:0.0:1788271833.978033:0:9485:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788271833.978068:0:9485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000061f372ab/0x99288105fd38f1b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd612 expref: 10 pid: 8398 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271833.978082:0:9485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000061f372ab/0x99288105fd38f1b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd612 expref: 10 pid: 8398 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271833.978112:0:9485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061f372ab/0x99288105fd38f1b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd612 expref: 10 pid: 8398 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271833.978130:0:9485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788271833.978135:0:9485:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788271833.978141:0:9485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfe705e0/0x99288105fd38f200 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271833.978151:0:9485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfe705e0/0x99288105fd38f200 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271833.978179:0:9485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271833.978228:0:9485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+9:2395:x1875138577508224:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 243us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271833.978236:0:9485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 83 00010000:00010000:0.0:1788271833.978261:0:8396:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bfe705e0/0x99288105fd38f200 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271833.978270:0:8396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfe705e0/0x99288105fd38f200 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271833.978314:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfe705e0/0x99288105fd38f200 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271833.978323:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfe705e0/0x99288105fd38f200 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271833.978331:0:8396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfe705e0/0x99288105fd38f200 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271833.978338:0:8396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f7c00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:0.0:1788271833.978343:0:8396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfe705e0/0x99288105fd38f200 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271833.978352:0:8396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfe705e0/0x99288105fd38f200 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271833.978365:0:8396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfe705e0/0x99288105fd38f200 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271833.978373:0:8396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfe705e0/0x99288105fd38f200 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271833.978420:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+8:2397:x1875138577507968:12345-192.168.201.3@tcp:1:lfs.0 Request processed in 11074us (11267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271833.978429:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 57 00000100:00100000:2.0:1788271833.980477:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 2 00002000:00100000:2.0:1788271833.980497:0:8403:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8f6d83b09880 x1875138577508096/t4294967306(0) o4->ef8df183-a1b1-4e56-bce5-924a894c4a71@192.168.201.3@tcp:739/0 lens 504/448 e 0 to 0 dl 1788271844 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788271833.980510:0:8403:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f6d83b09880 with x1875138577508096 ext(0->12) 00010000:00010000:2.0:1788271833.980519:0:8403:0:(ldlm_extent.c:823:ldlm_resource_prolong()) Failed to get resource for resid 10737419265/4 00002000:00010000:2.0:1788271833.980522:0:8403:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f6d83b09880 00000100:00100000:1.0:1788271833.993669:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271833.994040:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577508480 00000100:00100000:2.0:1788271833.994060:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577508480 00000100:00100000:2.0:1788271833.994125:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 38 00000100:00100000:2.0:1788271833.994137:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb36ac050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+27:12225:x1875138577508480:12345-192.168.201.3@tcp:35:lfs.0 00000004:00010000:2.0:1788271833.994204:0:6486:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7200/0x99288105fd38f1f2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd62e expref: 27 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788271833.994443:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1788271833.994476:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:2.0:1788271833.994834:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00010000:00010000:2.0:1788271833.994883:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7800/0x99288105fd38f207 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.994900:0:6486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f19e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd604 expref: 31 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.994909:0:6486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7800/0x99288105fd38f207 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.994957:0:6486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f19e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd604 expref: 31 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271833.994971:0:6486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f19e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd604 expref: 31 pid: 9899 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271833.994985:0:6486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83a3f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6486:1875138590153728:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788271833.995081:0:6486:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e856bb480 going to sleep for 11 seconds 00000100:00100000:2.0:1788271834.004376:0:6486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83a3f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6486:1875138590153728:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788271834.004411:0:6486:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7800/0x99288105fd38f207 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271834.005189:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271834.005271:0:9486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577508608 00000100:00100000:0.0:1788271834.005278:0:9486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577508608 00010000:00010000:0.0:1788271834.005321:0:9486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f19e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd604 expref: 32 pid: 9899 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271834.005355:0:9486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 84 00000100:00100000:0.0:1788271834.005364:0:9486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+32:2397:x1875138577508608:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271834.005380:0:9486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271834.005387:0:9486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f19e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd604 expref: 32 pid: 9899 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.005400:0:9486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f19e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd604 expref: 32 pid: 9899 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.005421:0:9486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f19e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd604 expref: 32 pid: 9899 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.005438:0:9486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6d82060f00) 00010000:00010000:0.0:1788271834.005443:0:9486:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7800/0x99288105fd38f207 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.005452:0:9486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7800/0x99288105fd38f207 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.005460:0:9486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7800/0x99288105fd38f207 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.005489:0:9486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271834.005550:0:9486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+31:2397:x1875138577508608:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 187us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271834.005590:0:9486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 84 00010000:00010000:2.0:1788271834.005859:0:6486:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7800/0x99288105fd38f207 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.005867:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7800/0x99288105fd38f207 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788271834.006116:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000001:00080000:2.0:1788271834.006243:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:2.0:1788271834.008395:0:6486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83a3f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6486:1875138590153856:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788271834.008470:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271834.008505:0:6486:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e856bb900 going to sleep for 11 seconds 00000100:00100000:0.0:1788271834.008795:0:14136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590153856 00000100:00100000:0.0:1788271834.008803:0:14136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590153856 00000100:00100000:0.0:1788271834.008860:0:14136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788271834.008871:0:14136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6486:x1875138590153856:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788271834.008977:0:14136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6486:x1875138590153856:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 108us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271834.008995:0:14136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788271834.009014:0:6486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83a3f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6486:1875138590153856:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788271834.009164:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00000100:00100000:3.0:1788271834.009223:0:6486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6486:1875138590153984:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788271834.009667:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271834.009691:0:6486:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb3e87600 going to sleep for 11 seconds 00000100:00100000:0.0:1788271834.009761:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590153984 00000100:00100000:0.0:1788271834.009766:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590153984 00000100:00100000:0.0:1788271834.009796:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788271834.009803:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6486:x1875138590153984:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788271834.009925:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6486:x1875138590153984:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 122us (258us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788271834.009932:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788271834.009998:0:6486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6486:1875138590153984:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788271834.010065:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1788271834.010101:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7800/0x99288105fd38f207 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271834.010111:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7800/0x99288105fd38f207 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271834.010117:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7800/0x99288105fd38f207 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271834.010124:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f7800 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271834.010128:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7800/0x99288105fd38f207 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271834.010135:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7800/0x99288105fd38f207 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271834.010150:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6d82060f00) 00010000:00010000:3.0:1788271834.010154:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788271834.010158:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7800/0x99288105fd38f207 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271834.010164:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7800/0x99288105fd38f207 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788271834.010678:0:6486:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788271834.010746:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1788271834.010760:0:6486:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 395100139926ns, next at 396100137368ns, rc = 0 00000001:00080000:3.0:1788271834.010767:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967433 00010000:00010000:3.0:1788271834.010792:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6d82060f00) 00010000:00010000:3.0:1788271834.010794:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788271834.010807:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7200/0x99288105fd38f1f2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd62e expref: 35 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271834.011394:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb36ac050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+34:12225:x1875138577508480:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 17258us (17785us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1788271834.011405:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 38 00000020:00080000:3.0:1788271834.011410:0:6486:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788271834.015900:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271834.016239:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577508736 00000100:00100000:2.0:1788271834.016257:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577508736 00000100:00100000:2.0:1788271834.016550:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 162 00000100:00100000:2.0:1788271834.016562:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+34:12225:x1875138577508736:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788271834.016586:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271834.016609:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7000/0x99288105fd38f20e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd635 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.016689:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7000/0x99288105fd38f20e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd635 expref: 35 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.016705:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7000/0x99288105fd38f20e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd635 expref: 35 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.016725:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6eb35a5800) 00010000:00010000:2.0:1788271834.016728:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788271834.016732:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d833f7000, rc 0) 00000100:00100000:2.0:1788271834.016791:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+35:12225:x1875138577508736:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 231us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271834.016797:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 162 00000100:00100000:0.0:1788271834.027895:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271834.028163:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577508992 00000100:00100000:3.0:1788271834.028172:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577508992 00000100:00100000:3.0:1788271834.028332:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 39 00000100:00100000:3.0:1788271834.028343:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8399d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+35:12225:x1875138577508992:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:3.0:1788271834.028985:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8399d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+36:12225:x1875138577508992:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 641us (1097us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1788271834.028993:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 39 00000100:00100000:3.0:1788271834.119473:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271834.119562:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577509248 00000100:00100000:1.0:1788271834.119595:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577509248 00000100:00100000:1.0:1788271834.119706:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 163 00000100:00100000:1.0:1788271834.119717:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+36:12235:x1875138577509248:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:1.0:1788271834.119753:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271834.119775:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f215 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd63c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271834.120101:0:6483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788271834.120338:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f215 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd63c expref: 38 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271834.120354:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6d83055900) 00010000:00010000:1.0:1788271834.120357:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788271834.120362:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f215 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd63c expref: 38 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271834.120376:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e20200, rc 0) 00000100:00100000:1.0:1788271834.121717:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+37:12235:x1875138577509248:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 1993us (2246us total) trans 4294967436 rc 301/301 00000100:00100000:1.0:1788271834.121729:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 163 00000100:00100000:1.0:1788271834.123875:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271834.132941:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577509376 00000100:00100000:0.0:1788271834.132953:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577509376 00000100:00100000:0.0:1788271834.133608:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 164 00000100:00100000:0.0:1788271834.133638:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+37:12235:x1875138577509376:12345-192.168.201.3@tcp:34:lfs.0 00010000:00010000:0.0:1788271834.133859:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38f223 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.133877:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38f223 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.133888:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38f223 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.133913:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f22a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.133920:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f22a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.133927:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f22a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.134005:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38f231 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.134014:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38f231 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.134020:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38f231 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788271834.134077:0:12164:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38f231 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.134091:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38f223 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.134098:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38f223 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.134104:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38f223 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.134110:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511c200 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271834.135541:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38f223 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.135568:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38f223 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.135584:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f6d82060100) 00010000:00010000:0.0:1788271834.135586:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271834.135591:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38f223 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.135597:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38f223 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.135610:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f22a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.135615:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f22a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.135649:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f22a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.135654:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511d200 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271834.135657:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f22a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.135662:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f22a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.135668:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f6d82060600) 00010000:00010000:0.0:1788271834.135670:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271834.135673:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f22a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.136019:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f22a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.136029:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38f231 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.136033:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38f231 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.136037:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38f231 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.136040:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511dc00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271834.136051:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38f231 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.136058:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38f231 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.136067:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6eb35a5800) 00010000:00010000:0.0:1788271834.136070:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271834.136073:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38f231 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.136079:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38f231 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271834.136193:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+37:12235:x1875138577509376:12345-192.168.201.3@tcp:34:lfs.0 Request processed in 2572us (12322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271834.136202:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 164 00000100:00100000:0.0:1788271834.142444:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271834.142532:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577509632 00000100:00100000:2.0:1788271834.142551:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577509632 00000100:00100000:2.0:1788271834.142605:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 40 00000100:00100000:2.0:1788271834.142613:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8399c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+37:12235:x1875138577509632:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:2.0:1788271834.142846:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8399c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+38:12235:x1875138577509632:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 233us (408us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1788271834.142855:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 40 00000100:00100000:3.0:1788271834.197785:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271834.198963:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577509888 00000100:00100000:2.0:1788271834.198977:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577509888 00000100:00100000:2.0:1788271834.199056:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 165 00000100:00100000:2.0:1788271834.199068:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+38:12238:x1875138577509888:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788271834.199096:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271834.199120:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f238 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd643 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.199196:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6e00/0x99288105fd38f23f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.199211:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6e00/0x99288105fd38f23f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.199223:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6e00/0x99288105fd38f23f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.199235:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7600/0x99288105fd38f246 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.199243:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7600/0x99288105fd38f246 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.199250:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7600/0x99288105fd38f246 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.199369:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f24d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.199378:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f24d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.199385:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f24d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271834.199394:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788271834.200535:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6e00/0x99288105fd38f23f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.200549:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6e00/0x99288105fd38f23f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.200557:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6e00/0x99288105fd38f23f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.200564:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f6e00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271834.200568:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6e00/0x99288105fd38f23f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.200577:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6e00/0x99288105fd38f23f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.200592:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f6d82060100) 00010000:00010000:2.0:1788271834.200595:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271834.200600:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6e00/0x99288105fd38f23f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.200640:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6e00/0x99288105fd38f23f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.200660:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7600/0x99288105fd38f246 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.200667:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7600/0x99288105fd38f246 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.200672:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7600/0x99288105fd38f246 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.200848:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f7600 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271834.200854:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7600/0x99288105fd38f246 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.200861:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7600/0x99288105fd38f246 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.200871:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f6d82060600) 00010000:00010000:2.0:1788271834.200874:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271834.200877:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7600/0x99288105fd38f246 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.200883:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7600/0x99288105fd38f246 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.200932:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f238 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd643 expref: 41 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.200947:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f24d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd643 expref: 40 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.200961:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6eb35a5800) 00010000:00010000:2.0:1788271834.200964:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788271834.200968:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d833f6a00, rc 0) 00000100:00100000:2.0:1788271834.201039:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+40:12238:x1875138577509888:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 1972us (3265us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1788271834.201058:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 165 00000100:00100000:1.0:1788271834.203718:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271834.203850:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577510016 00000100:00100000:2.0:1788271834.203861:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577510016 00000100:00100000:2.0:1788271834.203918:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 166 00000100:00100000:2.0:1788271834.203928:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+40:12238:x1875138577510016:12345-192.168.201.3@tcp:54:lfs.0 00010000:00010000:2.0:1788271834.203997:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7400/0x99288105fd38f25b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.204015:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7400/0x99288105fd38f25b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.204026:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7400/0x99288105fd38f25b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.204073:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7400/0x99288105fd38f25b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.204081:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7400/0x99288105fd38f25b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.204088:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7400/0x99288105fd38f25b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.204093:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f7400 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271834.204113:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7400/0x99288105fd38f25b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.204121:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7400/0x99288105fd38f25b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.204133:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6eb35a5800) 00010000:00010000:2.0:1788271834.204136:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788271834.204141:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7400/0x99288105fd38f25b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.204147:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7400/0x99288105fd38f25b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271834.204222:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+40:12238:x1875138577510016:12345-192.168.201.3@tcp:54:lfs.0 Request processed in 295us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271834.204229:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 166 00000100:00100000:0.0:1788271834.208065:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271834.208141:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577510272 00000100:00100000:2.0:1788271834.208151:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577510272 00000100:00100000:2.0:1788271834.208210:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 41 00000100:00100000:2.0:1788271834.208220:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8399ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+40:12238:x1875138577510272:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:2.0:1788271834.209569:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8399ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+41:12238:x1875138577510272:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 1344us (1518us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788271834.209580:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 41 00000100:00100000:3.0:1788271834.490481:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271834.495311:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577510528 00000100:00100000:0.0:1788271834.495325:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577510528 00000100:00100000:0.0:1788271834.495394:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 167 00000100:00100000:0.0:1788271834.495402:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83392680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+41:12269:x1875138577510528:12345-192.168.201.3@tcp:101:cat.0 00010000:00010000:0.0:1788271834.495423:0:12164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271834.495440:0:12164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f262 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd64a expref: -99 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.495529:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38f269 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.495540:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38f269 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.495548:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38f269 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271834.495556:0:12164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788271834.495674:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f262 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd64a expref: 44 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.495704:0:12164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38f269 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd64a expref: 43 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.495713:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6eb35a5800) 00010000:00010000:0.0:1788271834.495716:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788271834.495720:0:12164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e8511c200, rc 0) 00000100:00100000:0.0:1788271834.495781:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83392680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+43:12269:x1875138577510528:12345-192.168.201.3@tcp:101:cat.0 Request processed in 378us (5309us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1788271834.495804:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 167 00000100:00100000:1.0:1788271834.504384:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271834.504435:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271834.504581:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577510784 00000100:00100000:3.0:1788271834.504591:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577510784 00000100:00100000:3.0:1788271834.504698:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 42 00000100:00100000:3.0:1788271834.504708:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+43:12269:x1875138577510784:12345-192.168.201.3@tcp:35:cat.0 00000100:00100000:3.0:1788271834.504983:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+44:12269:x1875138577510784:12345-192.168.201.3@tcp:35:cat.0 Request processed in 276us (609us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1788271834.504991:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 42 00000100:00100000:2.0:1788271834.505541:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577510912 00000100:00100000:2.0:1788271834.505548:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577510912 00000100:00100000:2.0:1788271834.505721:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 12 00000100:00100000:2.0:1788271834.505742:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3598450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+44:2396:x1875138577510912:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271834.505755:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271834.505803:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c200/0x99288105fd38f269 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd64a expref: 44 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.505823:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6eb35a5800) 00010000:00010000:2.0:1788271834.505828:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271834.505962:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3598450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+43:2396:x1875138577510912:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 232us (1525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271834.505970:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 12 00010000:00010000:1.0:1788271834.526420:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271834.588178:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271834.588331:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577511168 00000100:00100000:2.0:1788271834.588340:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577511168 00000100:00100000:2.0:1788271834.588408:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 168 00000100:00100000:2.0:1788271834.588416:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+43:12275:x1875138577511168:12345-192.168.201.3@tcp:101:dd.0 00010000:00010000:2.0:1788271834.588436:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271834.588439:0:6484:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788271834.588459:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f1cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd620 expref: 43 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.588475:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f6d82060100) 00010000:00010000:2.0:1788271834.588477:0:6484:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788271834.588487:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7400/0x99288105fd38f277 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd651 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.588594:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f27e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.588608:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f24d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd643 expref: 43 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.588664:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f27e lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.588690:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f24d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd643 expref: 43 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.588700:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f24d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd643 expref: 43 pid: 6484 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271834.588711:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83a3c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1875138590154112:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788271834.588793:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e856bb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271834.592735:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271834.592823:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83a3c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1875138590154112:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788271834.592860:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f27e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271834.592961:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577511296 00000100:00100000:1.0:1788271834.592969:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577511296 00010000:00010000:1.0:1788271834.593021:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f24d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd643 expref: 44 pid: 6484 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271834.593068:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 85 00000100:00100000:1.0:1788271834.593077:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83393800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+44:2398:x1875138577511296:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271834.593102:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271834.593109:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f24d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd643 expref: 44 pid: 6484 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271834.593121:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f24d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd643 expref: 44 pid: 6484 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271834.593142:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f24d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd643 expref: 44 pid: 6484 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271834.593158:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6eb35a5800) 00010000:00010000:1.0:1788271834.593163:0:6468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f27e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271834.593171:0:6468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f27e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271834.593178:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f27e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271834.593193:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271834.593247:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83393800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+43:2398:x1875138577511296:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 171us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271834.593255:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 85 00010000:00010000:2.0:1788271834.593530:0:6484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f27e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.593539:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f27e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271834.593557:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788271834.593721:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7400/0x99288105fd38f277 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd651 expref: 44 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.593737:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f27e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd651 expref: 43 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.593756:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6eb35a5800) 00010000:00010000:2.0:1788271834.593759:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788271834.593762:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d833f6400, rc 0) 00000100:00100000:2.0:1788271834.593802:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+43:12275:x1875138577511168:12345-192.168.201.3@tcp:101:dd.0 Request processed in 5385us (5633us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1788271834.593809:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 168 00000100:00100000:1.0:1788271834.596690:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271834.596895:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577511424 00000100:00100000:2.0:1788271834.596905:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577511424 00000100:00100000:2.0:1788271834.596964:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 169 00000100:00100000:2.0:1788271834.596975:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+43:12275:x1875138577511424:12345-192.168.201.3@tcp:101:dd.0 00010000:00010000:2.0:1788271834.597000:0:9899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271834.597020:0:9899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f28c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd658 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.597067:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7600/0x99288105fd38f293 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.597082:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7600/0x99288105fd38f293 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.597104:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7600/0x99288105fd38f293 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.597228:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f28c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd658 expref: 45 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.597245:0:9899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7600/0x99288105fd38f293 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd658 expref: 44 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.597261:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6eb35a5800) 00010000:00010000:2.0:1788271834.597264:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788271834.597268:0:9899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d833f7600, rc 0) 00000100:00100000:2.0:1788271834.597327:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+44:12275:x1875138577511424:12345-192.168.201.3@tcp:101:dd.0 Request processed in 354us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271834.597334:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 169 00000100:00100000:3.0:1788271834.601889:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271834.601981:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577511680 00000100:00100000:0.0:1788271834.601992:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577511680 00000100:00100000:0.0:1788271834.602067:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 170 00000100:00100000:0.0:1788271834.602078:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+44:12275:x1875138577511680:12345-192.168.201.3@tcp:36:dd.0 00010000:00010000:0.0:1788271834.602317:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f29a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.602336:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f29a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.602347:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f29a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788271834.602402:0:12164:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1788271834.602423:0:12164:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae718401 reply state 00000000cfaa7181 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f29a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.602436:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f29a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271834.602443:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6eb35a5800) 00010000:00010000:0.0:1788271834.602446:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788271834.602449:0:12164:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788271834.602542:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+47:12275:x1875138577511680:12345-192.168.201.3@tcp:36:dd.0 Request processed in 465us (663us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1788271834.602549:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 170 00000020:00080000:0.0:1788271834.602554:0:12164:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788271834.656821:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788271834.656849:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590154240:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788271834.657013:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271834.661443:0:14136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590154240 00000100:00100000:2.0:1788271834.661458:0:14136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590154240 00000100:00100000:2.0:1788271834.661590:0:14136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788271834.661602:0:14136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8399e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590154240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788271834.661667:0:14136:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788271834.661764:0:14136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8399e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590154240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 165us (4751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271834.661771:0:14136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788271834.662024:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83a3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590154240:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788271834.868255:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271834.868468:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577511808 00000100:00100000:2.0:1788271834.868478:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577511808 00000100:00100000:2.0:1788271834.868534:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 171 00000100:00100000:2.0:1788271834.868544:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+47:12289:x1875138577511808:12345-192.168.201.3@tcp:101:stat.0 00010000:00010000:2.0:1788271834.868566:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271834.868587:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f2a1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd65f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.868677:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7400/0x99288105fd38f2a8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.868690:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7400/0x99288105fd38f2a8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.868713:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7400/0x99288105fd38f2a8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.868726:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6e00/0x99288105fd38f2af lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.868732:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6e00/0x99288105fd38f2af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.868738:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6e00/0x99288105fd38f2af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.868803:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f2b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.868812:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f27e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd651 expref: 48 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.868820:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f2b6 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.868851:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f27e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd651 expref: 48 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.868864:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f27e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd651 expref: 48 pid: 6484 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271834.868878:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83a3ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1875138590154368:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788271834.869021:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e856bb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271834.874782:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83a3ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1875138590154368:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788271834.874810:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f2b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271834.875887:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271834.875963:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577512064 00000100:00100000:0.0:1788271834.875971:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577512064 00000100:00100000:0.0:1788271834.876039:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 43 00000100:00100000:0.0:1788271834.876049:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8316e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+49:6637:x1875138577512064:12345-192.168.201.3@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788271834.876521:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8316e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+50:6637:x1875138577512064:12345-192.168.201.3@tcp:35:ldlm_bl.0 Request processed in 472us (637us total) trans 4294967445 rc 0/0 00000100:00100000:0.0:1788271834.876529:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 43 00000100:00100000:0.0:1788271834.878727:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271834.878823:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577512192 00000100:00100000:2.0:1788271834.878832:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577512192 00010000:00010000:2.0:1788271834.878872:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f27e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd651 expref: 50 pid: 6484 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271834.878911:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 86 00000100:00100000:2.0:1788271834.878921:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8399c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+50:2397:x1875138577512192:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271834.878935:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271834.878942:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f27e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd651 expref: 50 pid: 6484 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.878955:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f27e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd651 expref: 50 pid: 6484 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.878976:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f27e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd651 expref: 50 pid: 6484 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.878992:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6eb35a5800) 00010000:00010000:2.0:1788271834.878997:0:6470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f2b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.879007:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.879014:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f2b6 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271834.879042:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271834.879169:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8399c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+49:2397:x1875138577512192:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 249us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271834.879191:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 86 00010000:00010000:1.0:1788271834.880979:0:6484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271834.880994:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271834.881066:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788271834.881071:0:6484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788271834.881162:0:6484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271834.881179:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271834.881189:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7400/0x99288105fd38f2a8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271834.881196:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7400/0x99288105fd38f2a8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271834.881203:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7400/0x99288105fd38f2a8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271834.881210:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f7400 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271834.881215:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7400/0x99288105fd38f2a8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271834.881222:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7400/0x99288105fd38f2a8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271834.881238:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f6d82060100) 00010000:00010000:1.0:1788271834.881369:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271834.881389:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7400/0x99288105fd38f2a8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271834.881396:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7400/0x99288105fd38f2a8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271834.881412:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6e00/0x99288105fd38f2af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271834.881418:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6e00/0x99288105fd38f2af lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271834.881424:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6e00/0x99288105fd38f2af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271834.881430:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f6e00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271834.881433:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6e00/0x99288105fd38f2af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271834.881439:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6e00/0x99288105fd38f2af lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271834.881448:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f6d82060600) 00010000:00010000:1.0:1788271834.881450:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271834.881454:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6e00/0x99288105fd38f2af lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271834.881459:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6e00/0x99288105fd38f2af lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271834.881497:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f2a1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd65f expref: 49 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271834.881526:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f2b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd65f expref: 48 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271834.881533:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6eb35a5800) 00010000:00010000:1.0:1788271834.881536:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788271834.881538:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d833f6a00, rc 0) 00000100:00100000:1.0:1788271834.881793:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+48:12289:x1875138577511808:12345-192.168.201.3@tcp:101:stat.0 Request processed in 13247us (13555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271834.881802:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 171 00000100:00100000:0.0:1788271834.958708:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271834.958865:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577512448 00000100:00100000:1.0:1788271834.958874:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577512448 00000100:00100000:1.0:1788271834.958932:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 172 00000100:00100000:1.0:1788271834.958941:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8399ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+48:12295:x1875138577512448:12345-192.168.201.3@tcp:36:truncate.0 00010000:00010000:1.0:1788271834.958994:0:6485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271834.959019:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f2b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd65f expref: 48 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271834.959049:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6eb35a5800) 00010000:00010000:1.0:1788271834.959054:0:6485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788271834.959209:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f2bd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271834.959222:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f2bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271834.959231:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f2bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788271834.959302:0:6485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967446 00000004:00010000:1.0:1788271834.959319:0:6485:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007cc6775f reply state 000000002d4bcf22 transno 4294967447 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f2bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271834.959331:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f2bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271834.959337:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6eb35a5800) 00010000:00010000:1.0:1788271834.959340:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788271834.959342:0:6485:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788271834.959422:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8399ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+50:12295:x1875138577512448:12345-192.168.201.3@tcp:36:truncate.0 Request processed in 482us (722us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1788271834.959429:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 172 00000020:00080000:1.0:1788271834.959433:0:6485:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788271835.118742:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271835.118855:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577512576 00000100:00100000:1.0:1788271835.118866:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577512576 00000100:00100000:1.0:1788271835.118949:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 173 00000100:00100000:1.0:1788271835.118961:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8316df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+50:12309:x1875138577512576:12345-192.168.201.3@tcp:101:stat.0 00010000:00010000:1.0:1788271835.118983:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271835.119003:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f2c4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd666 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271835.119083:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f2cb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271835.119097:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f2cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271835.119108:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f2cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271835.119138:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f2d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271835.119146:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f2d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271835.119153:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f2d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271835.119223:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f2d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271835.119233:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271835.119240:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788271835.119427:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:1.0:1788271835.119464:0:6483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1788271835.119469:0:6483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788271835.119489:0:6483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271835.119501:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271835.119511:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f2cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271835.119518:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f2cb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271835.119535:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f2cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271835.119541:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e20200 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271835.119545:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f2cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271835.119553:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f2cb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271835.119566:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f6d82060100) 00010000:00010000:1.0:1788271835.119570:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271835.119574:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f2cb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271835.119581:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f2cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271835.119594:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f2d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271835.119600:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f2d2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271835.119606:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f2d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271835.119610:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e21e00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271835.119613:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f2d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271835.119677:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f2d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271835.119686:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f6d82060600) 00010000:00010000:1.0:1788271835.119688:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271835.119691:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f2d2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271835.119697:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f2d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271835.119726:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f2c4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd666 expref: 52 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271835.119739:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f2d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd666 expref: 51 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271835.119746:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6eb35a5800) 00010000:00010000:1.0:1788271835.119748:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788271835.119751:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e92d33a00, rc 0) 00000100:00100000:1.0:1788271835.119811:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8316df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+51:12309:x1875138577512576:12345-192.168.201.3@tcp:101:stat.0 Request processed in 852us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271835.119818:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 173 00000100:00100000:3.0:1788271835.165921:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83b09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590154496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788271835.165994:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271835.166261:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590154496 00000100:00100000:1.0:1788271835.166270:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590154496 00000100:00100000:1.0:1788271835.166345:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788271835.166357:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8316c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590154496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788271835.166385:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788271835.166447:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8316c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590154496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271835.166455:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:3.0:1788271835.166644:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788271835.166681:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83b09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590154496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788271835.166977:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788271835.166989:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8316ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590154624:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788271835.167021:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271835.167168:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590154624 00000100:00100000:3.0:1788271835.167173:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590154624 00000100:00100000:3.0:1788271835.167218:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788271835.167226:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83a3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590154624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788271835.167237:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788271835.167268:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83a3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590154624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271835.167285:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:2.0:1788271835.167425:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788271835.167447:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8316ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590154624:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788271835.168341:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875138590155136:0@lo:400:kworker.0 00000100:00100000:1.0:1788271835.168384:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271835.168405:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83a3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590155648:0@lo:400:kworker.0 00000100:00100000:1.0:1788271835.168430:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271835.168449:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788271835.168454:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83a3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590154752:0@lo:400:kworker.0 00000100:00100000:1.0:1788271835.168480:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271835.168504:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590155264:0@lo:400:kworker.0 00000100:00100000:1.0:1788271835.168529:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271835.168560:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83a3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590155776:0@lo:400:kworker.0 00000100:00100000:1.0:1788271835.168581:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271835.168608:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590154752 00000100:00100000:1.0:1788271835.168613:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590154752 00000100:00100000:1.0:1788271835.168665:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1788271835.168671:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3608:x1875138590154752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271835.168706:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3608:x1875138590154752:12345-0@lo:400:kworker.0 Request processed in 35us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271835.168712:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1788271835.168737:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590155264 00000100:00100000:1.0:1788271835.168740:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590155264 00000100:00100000:1.0:1788271835.168761:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788271835.168766:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590155264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271835.168793:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590155264:12345-0@lo:400:kworker.0 Request processed in 27us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271835.168807:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788271835.168834:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83a3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590154752:0@lo:400:kworker.0 00000100:00100000:1.0:1788271835.168844:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590155264:0@lo:400:kworker.0 00000100:00100000:1.0:1788271835.168864:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590155136 00000100:00100000:1.0:1788271835.168867:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590155136 00000100:00100000:1.0:1788271835.169005:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788271835.169013:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875138590155136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271835.169059:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875138590155136:12345-0@lo:400:kworker.0 Request processed in 47us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271835.169064:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788271835.169154:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875138590155136:0@lo:400:kworker.0 00000100:00100000:1.0:1788271835.169191:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875138590154880:0@lo:400:kworker.0 00000100:00100000:1.0:1788271835.169216:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271835.169233:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83a3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3606:1875138590155392:0@lo:400:kworker.0 00000100:00100000:1.0:1788271835.169251:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271835.169264:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83a3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3606:1875138590155904:0@lo:400:kworker.0 00000100:00100000:1.0:1788271835.169279:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271835.169294:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788271835.169299:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83a3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590155008:0@lo:400:kworker.0 00000100:00100000:1.0:1788271835.169332:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271835.169351:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83a3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3606:1875138590155520:0@lo:400:kworker.0 00000100:00100000:1.0:1788271835.169372:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271835.169387:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3606:1875138590156032:0@lo:400:kworker.0 00000100:00100000:1.0:1788271835.169416:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271835.169443:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590154880 00000100:00100000:1.0:1788271835.169447:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590154880 00000100:00100000:1.0:1788271835.169463:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590155392 00000100:00100000:1.0:1788271835.169466:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590155392 00000100:00100000:1.0:1788271835.169482:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590155904 00000100:00100000:1.0:1788271835.169485:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590155904 00000100:00100000:1.0:1788271835.169496:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590155520 00000100:00100000:1.0:1788271835.169497:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590155520 00000100:00100000:1.0:1788271835.169507:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590156032 00000100:00100000:1.0:1788271835.169509:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590156032 00000100:00100000:1.0:1788271835.169523:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788271835.169529:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875138590154880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271835.169678:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590155648 00000100:00100000:2.0:1788271835.169682:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590155648 00000100:00100000:2.0:1788271835.169712:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590155776 00000100:00100000:2.0:1788271835.169714:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590155776 00000100:00100000:2.0:1788271835.169737:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788271835.169745:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590155648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271835.169786:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590155648:12345-0@lo:400:kworker.0 Request processed in 42us (1355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271835.169793:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788271835.169805:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788271835.169811:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3608:x1875138590155776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271835.169838:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3608:x1875138590155776:12345-0@lo:400:kworker.0 Request processed in 27us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271835.169845:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:2.0:1788271835.169861:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788271835.169865:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788271835.169867:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788271835.169875:0:14136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590155008 00000100:00100000:2.0:1788271835.169878:0:14136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590155008 00000100:00100000:2.0:1788271835.169982:0:14136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788271835.169989:0:14136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590155008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271835.170047:0:14136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590155008:12345-0@lo:400:kworker.0 Request processed in 58us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271835.170054:0:14136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788271835.170350:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1788271835.170359:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8301c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1875138590155392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271835.170511:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788271835.170520:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8301df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3606:x1875138590155904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271835.170612:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83a3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590155008:0@lo:400:kworker.0 00000100:00100000:3.0:1788271835.180233:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8301c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1875138590155392:12345-0@lo:400:kworker.0 Request processed in 9866us (10971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271835.180262:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1788271835.180301:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788271835.180314:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1875138590155520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271835.180368:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1875138590155520:12345-0@lo:400:kworker.0 Request processed in 59us (10994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271835.180374:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788271835.180405:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788271835.180411:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1875138590156032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271835.180442:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1875138590156032:12345-0@lo:400:kworker.0 Request processed in 32us (11026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271835.180448:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00010000:00080000:3.0:1788271835.180725:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83a3ea00 x1875138590155520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271835.180740:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83a3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3606:1875138590155520:0@lo:400:kworker.0 00010000:00080000:3.0:1788271835.180752:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83a3fb80 x1875138590156032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271835.180760:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3606:1875138590156032:0@lo:400:kworker.0 00000100:00100000:3.0:1788271835.180772:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83a3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3606:1875138590155392:0@lo:400:kworker.0 00000100:00100000:0.0:1788271835.181239:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8301df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3606:x1875138590155904:12345-0@lo:400:kworker.0 Request processed in 10719us (11957us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271835.181249:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1788271835.181429:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83a3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3606:1875138590155904:0@lo:400:kworker.0 00000100:00100000:1.0:1788271835.184209:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875138590154880:12345-0@lo:400:kworker.0 Request processed in 14669us (14980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271835.184227:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1788271835.184351:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875138590154880:0@lo:400:kworker.0 00000100:00100000:2.0:1788271835.184455:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83a3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590155776:0@lo:400:kworker.0 00000100:00100000:2.0:1788271835.184469:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83a3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590155648:0@lo:400:kworker.0 00000100:00100000:3.0:1788271835.220611:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271835.220810:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577512832 00000100:00100000:2.0:1788271835.220819:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577512832 00000100:00100000:2.0:1788271835.220910:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 174 00000100:00100000:2.0:1788271835.220921:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8316f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+51:12319:x1875138577512832:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788271835.220942:0:12164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271835.220963:0:12164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7200/0x99288105fd38f2e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd66d expref: -99 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271835.221071:0:12164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788271835.221170:0:12164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7200/0x99288105fd38f2e0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd66d expref: 53 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271835.221184:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6d83055900) 00010000:00010000:2.0:1788271835.221187:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788271835.221192:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7200/0x99288105fd38f2e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd66d expref: 53 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271835.221205:0:12164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d833f7200, rc 0) 00000100:00100000:2.0:1788271835.221287:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8316f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+52:12319:x1875138577512832:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 366us (685us total) trans 4294967448 rc 301/301 00000100:00100000:2.0:1788271835.221308:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 174 00000100:00100000:0.0:1788271835.225858:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271835.225935:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577513088 00000100:00100000:3.0:1788271835.225944:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577513088 00000100:00100000:3.0:1788271835.226003:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 44 00000100:00100000:3.0:1788271835.226014:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb36ae850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+52:12319:x1875138577513088:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:3.0:1788271835.226238:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb36ae850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+53:12319:x1875138577513088:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 225us (389us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1788271835.226258:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 44 00000100:00100000:0.0:1788271835.287195:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271835.287410:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577513344 00000100:00100000:3.0:1788271835.287435:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577513344 00000100:00100000:3.0:1788271835.287524:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 175 00000100:00100000:3.0:1788271835.287534:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8399ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+53:12325:x1875138577513344:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:3.0:1788271835.287558:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271835.287578:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4600/0x99288105fd38f2ee lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd674 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.287720:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f2f5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.287737:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f2d9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd666 expref: 54 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.287747:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f2f5 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.287782:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f2d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd666 expref: 54 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.287795:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f2d9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd666 expref: 54 pid: 6483 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271835.287809:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8316e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1875138590156160:192.168.201.3@tcp:104: 00000100:00100000:3.0:1788271835.287901:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8161ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271835.291679:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8316e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1875138590156160:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788271835.291712:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f2f5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271835.293063:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271835.293158:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577513472 00000100:00100000:2.0:1788271835.293167:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577513472 00010000:00010000:2.0:1788271835.293203:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f2d9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd666 expref: 55 pid: 6483 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271835.293254:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 87 00000100:00100000:2.0:1788271835.293262:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8399f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+55:2398:x1875138577513472:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271835.293280:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271835.293288:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f2d9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd666 expref: 55 pid: 6483 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271835.293300:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f2d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd666 expref: 55 pid: 6483 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271835.293321:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f2d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd666 expref: 55 pid: 6483 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271835.293339:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6eb35a5800) 00010000:00010000:2.0:1788271835.293344:0:6469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f2f5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271835.293355:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f2f5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271835.293362:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f2f5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271835.293410:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271835.293471:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8399f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+54:2398:x1875138577513472:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 209us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271835.293478:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 87 00010000:00010000:3.0:1788271835.293648:0:6484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f2f5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.293661:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f2f5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271835.293680:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1788271835.293803:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4600/0x99288105fd38f2ee lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd674 expref: 55 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.293819:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f2f5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd674 expref: 54 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.293827:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6eb35a5800) 00010000:00010000:3.0:1788271835.293829:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788271835.293832:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c5000, rc 0) 00000100:00100000:3.0:1788271835.293858:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8399ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+54:12325:x1875138577513344:12345-192.168.201.3@tcp:101:bash.0 Request processed in 6326us (6673us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1788271835.293865:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 175 00000100:00100000:1.0:1788271835.298453:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271835.298532:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577513728 00000100:00100000:2.0:1788271835.298552:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577513728 00000100:00100000:2.0:1788271835.298611:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 176 00000100:00100000:2.0:1788271835.298656:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+54:12325:x1875138577513728:12345-192.168.201.3@tcp:36:bash.0 00010000:00010000:2.0:1788271835.298888:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7200/0x99288105fd38f303 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271835.298905:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7200/0x99288105fd38f303 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271835.298915:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7200/0x99288105fd38f303 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788271835.298953:0:6483:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967451 00000004:00010000:2.0:1788271835.298973:0:6483:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008433914b reply state 00000000376ae1c6 transno 4294967452 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7200/0x99288105fd38f303 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271835.298985:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7200/0x99288105fd38f303 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271835.298993:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6eb35a5800) 00010000:00010000:2.0:1788271835.298996:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788271835.299000:0:6483:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788271835.299101:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+57:12325:x1875138577513728:12345-192.168.201.3@tcp:36:bash.0 Request processed in 481us (656us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1788271835.299125:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 176 00000020:00080000:2.0:1788271835.299131:0:6483:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788271835.308171:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271835.308269:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577513856 00000100:00100000:2.0:1788271835.308283:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577513856 00000100:00100000:2.0:1788271835.308333:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 177 00000100:00100000:2.0:1788271835.308340:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8399d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+57:12325:x1875138577513856:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:2.0:1788271835.308360:0:12164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271835.308377:0:12164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7800/0x99288105fd38f30a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd67b expref: -99 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271835.308449:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7c00/0x99288105fd38f311 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271835.308460:0:12164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f2f5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd674 expref: 58 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271835.308466:0:12164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7c00/0x99288105fd38f311 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271835.308493:0:12164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f2f5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd674 expref: 58 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271835.308501:0:12164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f2f5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd674 expref: 58 pid: 6484 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271835.308511:0:12164:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83a3e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12164:1875138590156288:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788271835.308655:0:12164:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e856bb000 going to sleep for 11 seconds 00000100:00100000:2.0:1788271835.311501:0:12164:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83a3e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12164:1875138590156288:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788271835.311546:0:12164:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7c00/0x99288105fd38f311 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271835.312522:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271835.312667:0:9486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577513984 00000100:00100000:2.0:1788271835.312677:0:9486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577513984 00010000:00010000:2.0:1788271835.312715:0:9486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f2f5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd674 expref: 59 pid: 6484 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271835.312756:0:9486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 88 00000100:00100000:2.0:1788271835.312766:0:9486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8399dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+59:2398:x1875138577513984:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271835.312780:0:9486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271835.312786:0:9486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f2f5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd674 expref: 59 pid: 6484 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271835.312798:0:9486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f2f5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd674 expref: 59 pid: 6484 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271835.312820:0:9486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f2f5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd674 expref: 59 pid: 6484 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271835.312835:0:9486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6eb35a5800) 00010000:00010000:2.0:1788271835.312840:0:9486:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7c00/0x99288105fd38f311 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271835.312850:0:9486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7c00/0x99288105fd38f311 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271835.312857:0:9486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7c00/0x99288105fd38f311 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271835.312895:0:9486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271835.312954:0:9486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8399dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+58:2398:x1875138577513984:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 188us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271835.312962:0:9486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 88 00010000:00010000:3.0:1788271835.313222:0:12164:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7c00/0x99288105fd38f311 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.313231:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7c00/0x99288105fd38f311 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271835.313435:0:12164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788271835.313439:0:12164:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788271835.313458:0:12164:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7c00/0x99288105fd38f311 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.313486:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7800/0x99288105fd38f30a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd67b expref: 58 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.313515:0:12164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7c00/0x99288105fd38f311 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd67b expref: 57 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.313522:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6eb35a5800) 00010000:00010000:3.0:1788271835.313525:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788271835.313527:0:12164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d833f7c00, rc 0) 00000100:00100000:3.0:1788271835.313614:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8399d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+57:12325:x1875138577513856:12345-192.168.201.3@tcp:101:bash.0 Request processed in 5273us (5452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271835.313714:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 177 00000100:00100000:0.0:1788271835.318933:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271835.319040:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577514240 00000100:00100000:2.0:1788271835.319051:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577514240 00000100:00100000:2.0:1788271835.319116:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 45 00000100:00100000:2.0:1788271835.319126:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8399d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+57:12325:x1875138577514240:12345-192.168.201.3@tcp:35:bash.0 00000100:00100000:2.0:1788271835.319355:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8399d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+58:12325:x1875138577514240:12345-192.168.201.3@tcp:35:bash.0 Request processed in 229us (430us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1788271835.319363:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 45 00000100:00100000:0.0:1788271835.408163:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271835.408262:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577514496 00000100:00100000:3.0:1788271835.408272:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577514496 00000100:00100000:3.0:1788271835.408395:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 178 00000100:00100000:3.0:1788271835.408406:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8399c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+58:12335:x1875138577514496:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:3.0:1788271835.408430:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271835.408451:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4600/0x99288105fd38f318 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd682 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271835.408545:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788271835.408678:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4600/0x99288105fd38f318 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd682 expref: 60 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.408692:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6d83055900) 00010000:00010000:3.0:1788271835.408695:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788271835.408700:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4600/0x99288105fd38f318 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd682 expref: 60 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.408731:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c4600, rc 0) 00000100:00100000:3.0:1788271835.408779:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8399c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+59:12335:x1875138577514496:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 374us (625us total) trans 4294967454 rc 301/301 00000100:00100000:3.0:1788271835.408787:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 178 00000100:00100000:0.0:1788271835.413462:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271835.413533:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577514624 00000100:00100000:3.0:1788271835.413542:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577514624 00000100:00100000:3.0:1788271835.413597:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 179 00000100:00100000:3.0:1788271835.413608:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8399ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+59:12335:x1875138577514624:12345-192.168.201.3@tcp:34:lfs.0 00010000:00010000:3.0:1788271835.413699:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38f326 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.413716:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38f326 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.413726:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38f326 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.413736:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38f32d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.413741:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38f32d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.413747:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38f32d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.413821:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f334 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.413848:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f334 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.413855:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f334 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788271835.413901:0:9899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f334 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.413914:0:9899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38f326 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.413920:0:9899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38f326 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.413926:0:9899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38f326 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.413932:0:9899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c5600 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271835.413936:0:9899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38f326 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.413943:0:9899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38f326 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.413954:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f6d82060100) 00010000:00010000:3.0:1788271835.413957:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271835.413962:0:9899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38f326 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.413968:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38f326 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.413987:0:9899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38f32d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.413992:0:9899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38f32d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.413997:0:9899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38f32d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.414001:0:9899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c5400 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271835.414004:0:9899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38f32d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.414009:0:9899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38f32d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.414016:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f6d82060600) 00010000:00010000:3.0:1788271835.414018:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271835.414048:0:9899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38f32d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.414388:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38f32d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.414401:0:9899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f334 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.414407:0:9899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f334 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.414412:0:9899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f334 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.414423:0:9899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4c00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271835.414427:0:9899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f334 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.414433:0:9899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f334 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.414441:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6eb35a5800) 00010000:00010000:3.0:1788271835.414444:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271835.414446:0:9899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f334 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.414452:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f334 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271835.414526:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8399ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+59:12335:x1875138577514624:12345-192.168.201.3@tcp:34:lfs.0 Request processed in 920us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271835.414534:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 179 00000100:00100000:0.0:1788271835.417284:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271835.417358:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577514880 00000100:00100000:2.0:1788271835.417367:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577514880 00000100:00100000:2.0:1788271835.417424:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 46 00000100:00100000:2.0:1788271835.417434:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8399d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+59:12335:x1875138577514880:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:2.0:1788271835.417676:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8399d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+60:12335:x1875138577514880:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 243us (408us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1788271835.417684:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 46 00000100:00100000:0.0:1788271835.452793:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271835.452887:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577515136 00000100:00100000:3.0:1788271835.452897:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577515136 00000100:00100000:3.0:1788271835.452962:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 180 00000100:00100000:3.0:1788271835.452972:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8399f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+60:12338:x1875138577515136:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:3.0:1788271835.452995:0:12164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271835.453017:0:12164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f33b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd689 expref: -99 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.453102:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38f342 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.453137:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38f342 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.453148:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38f342 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.453159:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38f349 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.453166:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38f349 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.453171:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38f349 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.453443:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4600/0x99288105fd38f350 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.453452:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4600/0x99288105fd38f350 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.453460:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4600/0x99288105fd38f350 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271835.453470:0:12164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788271835.453555:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38f342 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.453563:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38f342 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.453570:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38f342 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.453583:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c5400 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271835.453588:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38f342 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.453596:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38f342 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.453611:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f6d82060100) 00010000:00010000:3.0:1788271835.453614:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271835.453665:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38f342 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.453673:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38f342 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.453686:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38f349 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.453693:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38f349 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.453699:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38f349 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.453705:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c5600 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271835.453708:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38f349 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.453715:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38f349 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.453736:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f6d82060600) 00010000:00010000:3.0:1788271835.453738:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271835.453741:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38f349 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.453748:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38f349 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.453786:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f33b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd689 expref: 63 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.453800:0:12164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4600/0x99288105fd38f350 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd689 expref: 62 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.453808:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6eb35a5800) 00010000:00010000:3.0:1788271835.453810:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788271835.453812:0:12164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c4600, rc 0) 00000100:00100000:3.0:1788271835.453866:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8399f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+62:12338:x1875138577515136:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 895us (1084us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1788271835.453874:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 180 00000100:00100000:0.0:1788271835.457761:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271835.457840:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577515264 00000100:00100000:3.0:1788271835.457849:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577515264 00000100:00100000:3.0:1788271835.457903:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 181 00000100:00100000:3.0:1788271835.457913:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e84d02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+62:12338:x1875138577515264:12345-192.168.201.3@tcp:54:lfs.0 00010000:00010000:3.0:1788271835.457977:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f35e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.457993:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f35e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.458016:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f35e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.458058:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f35e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.458065:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f35e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.458073:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f35e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.458079:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c5000 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271835.458083:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f35e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.458091:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f35e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.458103:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6eb35a5800) 00010000:00010000:3.0:1788271835.458106:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788271835.458110:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f35e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.458115:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f35e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271835.458194:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e84d02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+62:12338:x1875138577515264:12345-192.168.201.3@tcp:54:lfs.0 Request processed in 282us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271835.458202:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 181 00000100:00100000:0.0:1788271835.460581:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271835.460778:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577515520 00000100:00100000:2.0:1788271835.460787:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577515520 00000100:00100000:2.0:1788271835.460841:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 47 00000100:00100000:2.0:1788271835.460851:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e84d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+62:12338:x1875138577515520:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:2.0:1788271835.461058:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e84d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+63:12338:x1875138577515520:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 207us (492us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1788271835.461082:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 47 00000100:00100000:1.0:1788271835.463214:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271835.463303:0:9485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577515648 00000100:00100000:0.0:1788271835.463310:0:9485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577515648 00000100:00100000:0.0:1788271835.463395:0:9485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 13 00000100:00100000:0.0:1788271835.463405:0:9485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+63:2396:x1875138577515648:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271835.463418:0:9485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271835.463439:0:9485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4600/0x99288105fd38f350 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd689 expref: 63 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271835.463456:0:9485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6eb35a5800) 00010000:00010000:0.0:1788271835.463460:0:9485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271835.463503:0:9485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+62:2396:x1875138577515648:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 100us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271835.463510:0:9485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 13 00010000:00010000:2.0:1788271835.554109:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271835.613966:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271835.614057:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577515904 00000100:00100000:3.0:1788271835.614081:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577515904 00000100:00100000:3.0:1788271835.614143:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 182 00000100:00100000:3.0:1788271835.614154:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e84d01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+62:12356:x1875138577515904:12345-192.168.201.3@tcp:101:cat.0 00010000:00010000:3.0:1788271835.614174:0:9899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271835.614192:0:9899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38f365 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd690 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.614290:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f36c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.614305:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f36c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.614316:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f36c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271835.614328:0:9899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788271835.614430:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38f365 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd690 expref: 65 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.614443:0:9899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f36c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd690 expref: 64 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.614449:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6eb35a5800) 00010000:00010000:3.0:1788271835.614450:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788271835.614453:0:9899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c5000, rc 0) 00000100:00100000:3.0:1788271835.614715:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e84d01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+64:12356:x1875138577515904:12345-192.168.201.3@tcp:101:cat.0 Request processed in 563us (757us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788271835.614720:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 182 00000100:00100000:3.0:1788271835.644239:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271835.644386:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577516032 00000100:00100000:2.0:1788271835.644397:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577516032 00000100:00100000:2.0:1788271835.644547:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 183 00000100:00100000:2.0:1788271835.644556:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8316e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+64:12357:x1875138577516032:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788271835.644578:0:12164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271835.644601:0:12164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f37a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd697 expref: -99 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271835.644701:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7e00/0x99288105fd38f381 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271835.644716:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7e00/0x99288105fd38f381 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271835.644728:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7e00/0x99288105fd38f381 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271835.644766:0:12164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788271835.644769:0:12164:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788271835.644783:0:12164:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7e00/0x99288105fd38f381 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271835.644803:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f37a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd697 expref: 66 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271835.644816:0:12164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7e00/0x99288105fd38f381 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd697 expref: 65 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271835.644837:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f6d82060100) 00010000:00010000:2.0:1788271835.644839:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788271835.644843:0:12164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d833f7e00, rc 0) 00000100:00100000:2.0:1788271835.644904:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8316e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+65:12357:x1875138577516032:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 349us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271835.644910:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 183 00000100:00100000:1.0:1788271835.652655:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271835.652798:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577516416 00000100:00100000:2.0:1788271835.652809:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577516416 00000100:00100000:2.0:1788271835.652900:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 48 00000100:00100000:2.0:1788271835.652910:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+65:12357:x1875138577516416:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:2.0:1788271835.653228:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+66:12357:x1875138577516416:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 319us (621us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1788271835.653236:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 48 00000100:00100000:1.0:1788271835.655067:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271835.655138:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577516544 00000100:00100000:3.0:1788271835.655147:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577516544 00000100:00100000:3.0:1788271835.655205:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 14 00000100:00100000:3.0:1788271835.655214:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+66:12357:x1875138577516544:12345-192.168.201.3@tcp:103:lfs.0 00010000:00010000:3.0:1788271835.655228:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788271835.655260:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7c00/0x99288105fd38f311 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd67b expref: 66 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.655290:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f36c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd690 expref: 65 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.655304:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7000/0x99288105fd38f20e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd635 expref: 64 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.655315:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6eb35a5800) 00010000:00010000:3.0:1788271835.655320:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271835.655370:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+63:12357:x1875138577516544:12345-192.168.201.3@tcp:103:lfs.0 Request processed in 157us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271835.655379:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 14 00000100:00100000:0.0:1788271835.660205:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271835.660305:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577516672 00000100:00100000:1.0:1788271835.660316:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577516672 00000100:00100000:1.0:1788271835.660380:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 184 00000100:00100000:1.0:1788271835.660391:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+63:12357:x1875138577516672:12345-192.168.201.3@tcp:58:lfs.0 00010000:00010000:1.0:1788271835.660516:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f388 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271835.660535:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f388 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271835.660559:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f388 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788271835.660692:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1788271835.660766:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+63:12357:x1875138577516672:12345-192.168.201.3@tcp:58:lfs.0 Request processed in 376us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271835.660773:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 184 00000100:00100000:1.0:1788271835.678155:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271835.678217:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577516800 00000100:00100000:3.0:1788271835.678227:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577516800 00000100:00100000:3.0:1788271835.678352:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 185 00000100:00100000:3.0:1788271835.678362:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+63:12359:x1875138577516800:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:3.0:1788271835.678384:0:9899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271835.678404:0:9899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f38f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd69e expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.678491:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38f396 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.678506:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38f396 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.678516:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38f396 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.678526:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f39d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.678545:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f39d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.678551:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f39d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.678659:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38f3a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.678669:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38f3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.678676:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38f3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271835.678712:0:9899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788271835.678716:0:9899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788271835.678731:0:9899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38f3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.678751:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38f3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.678758:0:9899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38f396 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.678764:0:9899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38f396 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.678770:0:9899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38f396 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.678776:0:9899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4800 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271835.678780:0:9899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38f396 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.678788:0:9899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38f396 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.678798:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f6d82060100) 00010000:00010000:3.0:1788271835.678802:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271835.678807:0:9899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38f396 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.678813:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4800/0x99288105fd38f396 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.678825:0:9899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f39d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.678831:0:9899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f39d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.678843:0:9899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f39d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.678848:0:9899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4c00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271835.678851:0:9899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f39d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.678857:0:9899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f39d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.678864:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f6d82060600) 00010000:00010000:3.0:1788271835.678866:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271835.678869:0:9899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f39d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.678874:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f39d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.678899:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f38f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd69e expref: 65 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.678912:0:9899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38f3a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd69e expref: 64 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271835.678918:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6eb35a5800) 00010000:00010000:3.0:1788271835.678920:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788271835.678923:0:9899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c5600, rc 0) 00000100:00100000:3.0:1788271835.678972:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+64:12359:x1875138577516800:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 612us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271835.679004:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 185 00000040:00080000:0.0:1788271836.446882:0:14674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788271836.446893:0:14674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788271836.447092:0:14674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788271836.447098:0:14674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788271836.573784:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788271836.586244:0:13762:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788271836.586319:0:13762:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788271836.586364:0:13762:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788271836.586372:0:13762:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788271836.586497:0:13762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfc7bb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13762:1875138590156416:192.168.201.3@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788271836.586759:0:13762:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d9ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788271836.604124:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271836.604157:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577516928 00000100:00100000:1.0:1788271836.604166:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577516928 00000100:00100000:1.0:1788271836.604220:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 186 00000100:00100000:1.0:1788271836.604230:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+65:12372:x1875138577516928:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788271836.604340:0:12164:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788271836.604452:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+65:12372:x1875138577516928:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 Request processed in 222us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271836.604460:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 186 00000100:00100000:3.0:1788271836.604653:0:13762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfc7bb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13762:1875138590156416:192.168.201.3@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788271836.617579:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271836.617923:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577517056 00000100:00100000:1.0:1788271836.617934:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577517056 00000100:00100000:1.0:1788271836.617985:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 187 00000100:00100000:1.0:1788271836.617996:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+64:12372:x1875138577517056:12345-192.168.201.3@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788271836.618079:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f3ab lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.618096:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f3ab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.618121:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f3ab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.618172:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f3b2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.618180:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f3b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.618188:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f3b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.618214:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f3b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.618223:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f3b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.618229:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f3b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271836.618284:0:6483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788271836.618288:0:6483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788271836.618301:0:6483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f3b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.618312:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f3ab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.618318:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f3ab lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.618334:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f3ab lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.618341:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e92d33a00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271836.618345:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f3ab lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.618353:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f3ab lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.618364:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f6e90141900) 00010000:00010000:1.0:1788271836.618367:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271836.618371:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f3ab lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.618378:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f3ab lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.618390:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f3b2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.618396:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f3b2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.618402:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f3b2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.618407:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e20a00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271836.618410:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f3b2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.618425:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f3b2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.618433:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff8f6d82060300) 00010000:00010000:1.0:1788271836.618435:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271836.618438:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f3b2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.618444:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f3b2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.618459:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f3b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.618466:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f3b9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.618471:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f3b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.618476:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e21e00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271836.618479:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f3b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.618484:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f3b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.618492:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6eb35a5800) 00010000:00010000:1.0:1788271836.618494:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271836.618497:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f3b9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.618648:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f3b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271836.618715:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+64:12372:x1875138577517056:12345-192.168.201.3@tcp:34:lhsmtool_posix.0 Request processed in 720us (1144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271836.618722:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 187 00000100:00100000:1.0:1788271836.630219:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271836.630345:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577517312 00000100:00100000:3.0:1788271836.630354:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577517312 00000100:00100000:3.0:1788271836.630412:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 188 00000100:00100000:3.0:1788271836.630422:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+64:12372:x1875138577517312:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788271836.630444:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271836.630466:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f3c0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd6a5 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.630593:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f3c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.630609:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f3c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.630640:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f3c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271836.630653:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788271836.630728:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f3c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.630737:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f3c7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.630743:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f3c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.630768:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c5000 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271836.630773:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f3c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.630781:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f3c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.630794:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6eb35a5800) 00010000:00010000:3.0:1788271836.630797:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788271836.630801:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f3c7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.630808:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f3c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.630849:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f3c0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6a5 expref: 66 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.630860:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f6e90141900) 00010000:00010000:3.0:1788271836.630862:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788271836.630866:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f3c0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6a5 expref: 66 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.630875:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c4c00, rc 0) 00000100:00100000:3.0:1788271836.630933:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+65:12372:x1875138577517312:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 512us (723us total) trans 4294967460 rc 301/301 00000100:00100000:3.0:1788271836.630940:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 188 00000100:00100000:3.0:1788271836.635225:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271836.635292:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577517440 00000100:00100000:0.0:1788271836.635301:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577517440 00000100:00100000:0.0:1788271836.635355:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 189 00000100:00100000:0.0:1788271836.635364:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8316c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+65:12372:x1875138577517440:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788271836.635397:0:6485:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788271836.635932:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8316c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+65:12372:x1875138577517440:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 Request processed in 566us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271836.635940:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 189 00000100:00100000:2.0:1788271836.640187:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271836.640282:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577517696 00000100:00100000:1.0:1788271836.640292:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577517696 00000100:00100000:1.0:1788271836.640382:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 190 00000100:00100000:1.0:1788271836.640393:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+65:12372:x1875138577517696:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788271836.640413:0:9899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271836.640417:0:9899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788271836.640443:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7e00/0x99288105fd38f381 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd697 expref: 65 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.640461:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f6d82060100) 00010000:00010000:1.0:1788271836.640466:0:9899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788271836.640478:0:9899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f3d5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd6ac expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788271836.641011:0:9899:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:1.0:1788271836.641156:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f3dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.641170:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f3dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.641200:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f3dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.641359:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f3d5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6ac expref: 67 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.641375:0:9899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f3dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6ac expref: 66 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.641383:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f6d82060300) 00010000:00010000:1.0:1788271836.641387:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788271836.641389:0:9899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e20a00, rc 0) 00000100:00100000:1.0:1788271836.641449:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+66:12372:x1875138577517696:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 1058us (1271us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1788271836.641456:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 190 00000100:00100000:0.0:1788271836.647381:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271836.647438:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577517952 00000100:00100000:1.0:1788271836.647446:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577517952 00000100:00100000:1.0:1788271836.647502:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 191 00000100:00100000:1.0:1788271836.647513:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+66:12372:x1875138577517952:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788271836.647569:0:12164:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271836.647592:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f3dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6ac expref: 66 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.647606:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f6d82060300) 00010000:00010000:1.0:1788271836.647614:0:12164:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788271836.647659:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f3ea lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.647685:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f3ea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.647696:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f3ea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.647745:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f3f1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xd7abcdc1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.647751:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f3f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd7abcdc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.647755:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f3f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd7abcdc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.647791:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f3ea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.647795:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f3ea lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.647799:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f3ea lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.647803:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e20200 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271836.647806:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f3ea lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.647811:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f3ea lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.647816:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f6d82060100) 00010000:00010000:1.0:1788271836.647822:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271836.647825:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f3ea lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.647829:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f3ea lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.647835:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f3f1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd7abcdc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.647839:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f3f1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd7abcdc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.647842:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f3f1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd7abcdc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.647845:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e92d33a00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271836.647847:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f3f1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd7abcdc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.647852:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f3f1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd7abcdc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.647858:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xd7abcdc1 (ffff8f6d82060e00) 00010000:00010000:1.0:1788271836.647860:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271836.647863:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f3f1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xd7abcdc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.647868:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f3f1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xd7abcdc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271836.647947:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+65:12372:x1875138577517952:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 Request processed in 435us (572us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788271836.647960:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 191 00000100:00100000:0.0:1788271836.653746:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271836.653882:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577518080 00000100:00100000:1.0:1788271836.653892:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577518080 00000100:00100000:1.0:1788271836.653952:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 192 00000100:00100000:1.0:1788271836.653964:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+65:12372:x1875138577518080:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788271836.653984:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271836.654017:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f3f8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd6b3 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.654054:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5400/0x99288105fd38f3ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.654068:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5400/0x99288105fd38f3ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.654080:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5400/0x99288105fd38f3ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.654193:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f3f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6b3 expref: 67 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.654211:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5400/0x99288105fd38f3ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6b3 expref: 66 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.654221:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:1.0:1788271836.654224:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788271836.654227:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4ed5400, rc 0) 00000100:00100000:1.0:1788271836.654304:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+66:12372:x1875138577518080:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 342us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271836.654319:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 192 00000100:00100000:3.0:1788271836.657023:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271836.658417:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577518336 00000100:00100000:1.0:1788271836.658430:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577518336 00000100:00100000:0.0:1788271836.660545:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 193 00000100:00100000:0.0:1788271836.660559:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8316d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+66:12372:x1875138577518336:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788271836.661713:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38f406 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271836.661731:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38f406 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271836.661741:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38f406 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788271836.661887:0:9899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1788271836.661897:0:9899:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 397751276935ns, next at 398751274696ns, rc = 0 00000004:00010000:0.0:1788271836.661964:0:9899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f7de3f1 reply state 00000000798cc6a4 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38f406 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271836.661977:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38f406 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271836.661984:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:0.0:1788271836.661986:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788271836.661990:0:9899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788271836.662142:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8316d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+68:12372:x1875138577518336:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 Request processed in 1583us (5124us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1788271836.662150:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 193 00000100:00100000:0.0:1788271836.668038:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271836.668583:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577518464 00000100:00100000:1.0:1788271836.668594:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577518464 00000100:00100000:1.0:1788271836.668679:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 194 00000100:00100000:1.0:1788271836.668690:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+68:12372:x1875138577518464:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788271836.668713:0:12164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271836.668734:0:12164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f40d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd6ba expref: -99 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.668792:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f40d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6ba expref: 69 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.668806:0:12164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f40d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6ba expref: 69 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.668825:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:1.0:1788271836.668829:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788271836.668833:0:12164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4ed4c00, rc 0) 00000100:00100000:1.0:1788271836.668951:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+69:12372:x1875138577518464:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 262us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271836.668959:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 194 00000100:00100000:0.0:1788271836.673086:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271836.673306:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577518592 00000100:00100000:2.0:1788271836.673315:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577518592 00000100:00080000:0.0:1788271836.673373:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788271836.673392:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 58 00000100:00100000:2.0:1788271836.673404:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2398:x1875138577518592:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788271836.673589:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2398:x1875138577518592:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 Request processed in 187us (512us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788271836.673597:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 58 00000100:00100000:2.0:1788271836.678732:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271836.678806:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577518848 00000100:00100000:3.0:1788271836.678815:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577518848 00000100:00100000:3.0:1788271836.678874:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 49 00000100:00100000:3.0:1788271836.678884:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+69:12372:x1875138577518848:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788271836.679093:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+70:12372:x1875138577518848:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 Request processed in 211us (370us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1788271836.679101:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 49 00000100:00100000:0.0:1788271836.685991:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271836.686060:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577519104 00000100:00100000:2.0:1788271836.686070:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577519104 00000100:00100000:2.0:1788271836.686178:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 195 00000100:00100000:2.0:1788271836.686188:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+70:12372:x1875138577519104:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788271836.686308:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+70:12372:x1875138577519104:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 Request processed in 121us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271836.686316:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 195 00000100:00100000:0.0:1788271836.688983:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271836.689044:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577519232 00000100:00100000:3.0:1788271836.689053:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577519232 00000100:00100000:2.0:1788271836.689203:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 196 00000100:00100000:2.0:1788271836.689216:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+70:12372:x1875138577519232:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788271836.689236:0:9899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271836.689451:0:9899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7a00/0x99288105fd38f414 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd6c1 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271836.689530:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6600/0x99288105fd38f41b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271836.689544:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6600/0x99288105fd38f41b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271836.689556:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6600/0x99288105fd38f41b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271836.689599:0:9899:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788271836.689638:0:9899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6600/0x99288105fd38f41b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271836.689664:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7a00/0x99288105fd38f414 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6c1 expref: 72 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271836.689683:0:9899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6600/0x99288105fd38f41b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6c1 expref: 71 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271836.689713:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:2.0:1788271836.689716:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788271836.689720:0:9899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d833f6600, rc 0) 00000100:00100000:2.0:1788271836.689778:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+71:12372:x1875138577519232:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 564us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271836.689786:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 196 00000100:00100000:0.0:1788271836.692692:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271836.692729:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577519360 00000100:00100000:2.0:1788271836.692738:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577519360 00000100:00100000:2.0:1788271836.692792:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 59 00000100:00100000:2.0:1788271836.692802:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2397:x1875138577519360:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788271836.692819:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271836.692836:0:8452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d06581b/0x99288105fd38f422 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd6c8 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788271836.692861:0:8452:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96dcdc, blocks: 0x0 00010000:00010000:2.0:1788271836.692880:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=397s v=(0 0) 00010000:00010000:2.0:1788271836.692885:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271836.692894:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d06581b/0x99288105fd38f422 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6c8 expref: 8 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271836.692911:0:8452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002d06581b/0x99288105fd38f422 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6c8 expref: 8 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271836.692925:0:8452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d833f6000, rc 0) 00000100:00100000:2.0:1788271836.692982:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+8:2397:x1875138577519360:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 181us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271836.693012:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 59 00000100:00100000:0.0:1788271836.696907:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271836.696968:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577519616 00000100:00100000:1.0:1788271836.696978:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577519616 00000100:00100000:1.0:1788271836.697089:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 197 00000100:00100000:1.0:1788271836.697100:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+71:12372:x1875138577519616:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788271836.697220:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+71:12372:x1875138577519616:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 Request processed in 121us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271836.697228:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 197 00000100:00100000:0.0:1788271836.699549:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271836.699666:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577519744 00000100:00100000:3.0:1788271836.699674:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577519744 00000100:00100000:3.0:1788271836.699724:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 60 00000100:00100000:3.0:1788271836.699734:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+8:12372:x1875138577519744:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788271836.699750:0:8397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271836.699767:0:8397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061f372ab/0x99288105fd38f429 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd6cf expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.699807:0:8397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002d06581b/0x99288105fd38f422 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6c8 expref: 9 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.699816:0:8397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271836.699821:0:8397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271836.699826:0:8397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061f372ab/0x99288105fd38f429 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6cf expref: 9 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.699861:0:8397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002d06581b/0x99288105fd38f422 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6c8 expref: 9 pid: 8452 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.699889:0:8397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002d06581b/0x99288105fd38f422 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6c8 expref: 9 pid: 8452 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271836.699905:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8316e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8397:1875138590156544:192.168.201.3@tcp:104: 00000100:00100000:3.0:1788271836.699994:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4f0a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788271836.703293:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271836.703436:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8316e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8397:1875138590156544:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788271836.703469:0:8397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000061f372ab/0x99288105fd38f429 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6cf expref: 9 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.703489:0:8397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c4800, rc 0) 00000100:00100000:3.0:1788271836.703558:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+9:12372:x1875138577519744:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 3824us (4014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271836.703567:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 60 00000100:00100000:1.0:1788271836.703662:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577519872 00000100:00100000:1.0:1788271836.703669:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577519872 00010000:00010000:1.0:1788271836.703702:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002d06581b/0x99288105fd38f422 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6c8 expref: 9 pid: 8452 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271836.703739:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 89 00000100:00100000:1.0:1788271836.703747:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+9:2397:x1875138577519872:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271836.703760:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271836.703782:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002d06581b/0x99288105fd38f422 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6c8 expref: 9 pid: 8452 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.703795:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002d06581b/0x99288105fd38f422 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6c8 expref: 9 pid: 8452 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.703818:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d06581b/0x99288105fd38f422 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6c8 expref: 9 pid: 8452 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.703831:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271836.703836:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271836.703844:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000061f372ab/0x99288105fd38f429 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6cf expref: 8 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.703872:0:6470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061f372ab/0x99288105fd38f429 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6cf expref: 8 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.703903:0:6470:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000061f372ab/0x99288105fd38f429 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6cf expref: 8 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271836.703915:0:6470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83aa8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6470:1875138590156672:192.168.201.3@tcp:105: 00000100:00100000:1.0:1788271836.703963:0:6470:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d821f89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271836.707094:0:6470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83aa8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6470:1875138590156672:192.168.201.3@tcp:105: 00010000:00010000:1.0:1788271836.707119:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271836.707173:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+8:2397:x1875138577519872:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 3425us (3888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271836.707184:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 89 00000100:00100000:0.0:1788271836.711188:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271836.711289:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577520000 00000100:00100000:1.0:1788271836.711299:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577520000 00002000:00100000:1.0:1788271836.711349:0:8402:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8f6d839cce00 x1875138577520000/t0(0) o4->ef8df183-a1b1-4e56-bce5-924a894c4a71@192.168.201.3@tcp:742/0 lens 504/0 e 0 to 0 dl 1788271847 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788271836.711359:0:8402:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f6d839cce00 with x1875138577520000 ext(0->8) 00002000:00010000:1.0:1788271836.711365:0:8402:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f6d839cce00 00000100:00100000:1.0:1788271836.711398:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 4 00000100:00100000:1.0:1788271836.711409:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+8:2397:x1875138577520000:12345-192.168.201.3@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788271836.712693:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+10:2397:x1875138577520000:12345-192.168.201.3@tcp:4:lhsmtool_posix.0 Request processed in 1282us (1509us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788271836.712715:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 4 00002000:00100000:1.0:1788271836.712724:0:8402:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8f6d839cce00 x1875138577520000/t4294967315(0) o4->ef8df183-a1b1-4e56-bce5-924a894c4a71@192.168.201.3@tcp:742/0 lens 504/448 e 0 to 0 dl 1788271847 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788271836.712732:0:8402:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f6d839cce00 with x1875138577520000 ext(0->8) 00002000:00010000:1.0:1788271836.712736:0:8402:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f6d839cce00 00000100:00100000:0.0:1788271836.715929:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271836.716143:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577520128 00000100:00100000:2.0:1788271836.716152:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577520128 00000100:00100000:2.0:1788271836.716206:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 198 00000100:00100000:2.0:1788271836.716216:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+71:12372:x1875138577520128:12345-192.168.201.3@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788271836.718059:0:6462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967463 is committed 00000004:00080000:0.0:1788271836.718073:0:6462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:0.0:1788271836.718132:0:6462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788271836.718151:0:6462:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f6e81370f00 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1788271836.718155:0:6462:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f6eb4f1d400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f6e854a0840 00000020:00080000:0.0:1788271836.718158:0:6462:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f6eb4f1db00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f6d83a2f000 00000020:00080000:1.0:1788271836.718336:0:6515:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1788271836.718380:0:6515:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1788271836.718389:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788271836.718404:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83aaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590156800:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788271836.718460:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271836.718500:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590156800 00000100:00100000:1.0:1788271836.718505:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590156800 00000100:00100000:1.0:1788271836.718787:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788271836.718796:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590156800:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788271836.718892:0:12967:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788271836.718896:0:12967:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788271836 00002000:00010000:1.0:1788271836.718899:0:12967:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788271836.718901:0:12967:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788271836 -> 1788271836 00002000:00010000:1.0:1788271836.718904:0:12967:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788271836.718945:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3609:x1875138590156800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 149us (483us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788271836.718952:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000004:00080000:1.0:1788271836.718992:0:3609:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f6d83aaaa00/2, rc 0, transno 4294967316 00000100:00100000:1.0:1788271836.719007:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83aaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590156800:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788271836.719241:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+25:12372:x1875138577520128:12345-192.168.201.3@tcp:44:lhsmtool_posix.0 Request processed in 3024us (3318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271836.719251:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 198 00000100:00100000:0.0:1788271836.719402:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788271836.719412:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83a3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590156928:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788271836.719444:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271836.719653:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590156928 00000100:00100000:2.0:1788271836.719659:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590156928 00000100:00100000:2.0:1788271836.719684:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788271836.719690:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3608:x1875138590156928:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788271836.719705:0:8398:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:2.0:1788271836.719729:0:8398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a96dcd9, atime: 0x6a96dcd9, ctime: 0x6a96dcd9, blocks: 0x8 00010000:00010000:2.0:1788271836.719736:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfe705e0/0x99288105fd38f430 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271836.719753:0:8398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=397s v=(0 0) 00010000:00010000:2.0:1788271836.719757:0:8398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271836.719762:0:8398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfe705e0/0x99288105fd38f430 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271836.719778:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfe705e0/0x99288105fd38f430 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271836.719788:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfe705e0/0x99288105fd38f430 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271836.719804:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfe705e0/0x99288105fd38f430 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271836.719818:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788271836.719923:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3608:x1875138590156928:12345-0@lo:6:osp-syn-0-0.0 Request processed in 232us (478us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788271836.719930:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:2.0:1788271836.719957:0:3608:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f6d83a3ce00/2, rc 0, transno 4294967308 00000100:00100000:2.0:1788271836.719963:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83a3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590156928:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788271836.721157:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271836.721176:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfe705e0/0x99288105fd38f430 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.721188:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f7c00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:1.0:1788271836.721193:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfe705e0/0x99288105fd38f430 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.721202:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfe705e0/0x99288105fd38f430 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.721221:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfe705e0/0x99288105fd38f430 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.721229:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfe705e0/0x99288105fd38f430 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.721252:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271836.721254:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271836.721256:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271836.721979:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f151 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.721989:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f151 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.721994:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f151 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722011:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e92d33e00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271836.722015:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f151 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722031:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f151 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722044:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8f6d82060400) 00010000:00010000:3.0:1788271836.722047:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271836.722050:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f151 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722055:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f151 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722070:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38f158 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722076:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38f158 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722081:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38f158 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722086:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e92d32c00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271836.722089:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38f158 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722095:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38f158 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722102:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f6d82060100) 00010000:00010000:3.0:1788271836.722104:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271836.722107:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38f158 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722120:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38f158 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722134:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38f197 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722139:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38f197 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722146:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38f197 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722151:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e92d33c00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271836.722153:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38f197 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722158:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38f197 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722166:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f6d82060600) 00010000:00010000:3.0:1788271836.722168:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271836.722171:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38f197 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722177:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38f197 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722190:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f29a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722196:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f29a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722207:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f29a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722212:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511d200 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271836.722215:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f29a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722221:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f29a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722229:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6eb35a5800) 00010000:00010000:3.0:1788271836.722232:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271836.722235:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f29a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722240:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d200/0x99288105fd38f29a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722252:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f2bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722257:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f2bd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722263:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f2bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722268:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e21000 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271836.722271:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f2bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722285:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f2bd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722294:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6eb35a5800) 00010000:00010000:3.0:1788271836.722296:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271836.722299:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f2bd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722305:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f2bd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722318:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7200/0x99288105fd38f303 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722323:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7200/0x99288105fd38f303 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722330:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7200/0x99288105fd38f303 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722335:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f7200 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271836.722338:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7200/0x99288105fd38f303 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722344:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7200/0x99288105fd38f303 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722351:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6eb35a5800) 00010000:00010000:3.0:1788271836.722353:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271836.722356:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7200/0x99288105fd38f303 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722371:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7200/0x99288105fd38f303 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722385:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38f406 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722391:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38f406 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722397:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38f406 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722402:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511da00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271836.722406:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38f406 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722412:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38f406 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722421:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:3.0:1788271836.722423:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788271836.722426:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38f406 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.722432:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38f406 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271836.722557:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271836.722768:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577520256 00000100:00100000:3.0:1788271836.722776:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577520256 00000100:00100000:3.0:1788271836.722826:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 63 00000100:00100000:3.0:1788271836.722836:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83a3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+10:2398:x1875138577520256:12345-192.168.201.3@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788271836.724118:0:9475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:2.0:1788271836.724126:0:9475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1788271836.724251:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83a3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2398:x1875138577520256:12345-192.168.201.3@tcp:16:lhsmtool_posix.0 Request processed in 1408us (1687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271836.724260:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 63 00000100:00100000:2.0:1788271836.726968:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271836.727059:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577520512 00000100:00100000:0.0:1788271836.727068:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577520512 00000100:00100000:0.0:1788271836.727118:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 199 00000100:00100000:0.0:1788271836.727128:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+19:12372:x1875138577520512:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788271836.727177:0:9899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271836.727206:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6600/0x99288105fd38f41b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6c1 expref: 19 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271836.727222:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:0.0:1788271836.727226:0:9899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788271836.727272:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511cc00/0x99288105fd38f437 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271836.727286:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511cc00/0x99288105fd38f437 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271836.727296:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511cc00/0x99288105fd38f437 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788271836.727401:0:9899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000018ee1c67 reply state 000000001d6e5c23 transno 4294967464 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511cc00/0x99288105fd38f437 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271836.727413:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511cc00/0x99288105fd38f437 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271836.727419:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:0.0:1788271836.727433:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788271836.727436:0:9899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788271836.727520:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83a3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+20:12372:x1875138577520512:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 Request processed in 393us (559us total) trans 4294967464 rc 0/0 00000100:00100000:0.0:1788271836.727527:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 199 00000100:00100000:0.0:1788271836.730461:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271836.730640:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577520640 00000100:00100000:2.0:1788271836.730650:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577520640 00000100:00100000:2.0:1788271836.730707:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 64 00000100:00100000:2.0:1788271836.730717:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2397:x1875138577520640:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788271836.730857:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788271836.730861:0:8452:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788271836 -> 1788271834 00002000:00010000:2.0:1788271836.730864:0:8452:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788271833 00002000:00010000:2.0:1788271836.730866:0:8452:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788271836 -> 1788271834 00002000:00010000:2.0:1788271836.730868:0:8452:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788271836.730924:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+8:2397:x1875138577520640:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 Request processed in 207us (470us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788271836.730932:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 64 00000100:00100000:2.0:1788271836.737687:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271836.737825:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577520896 00000100:00100000:1.0:1788271836.737835:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577520896 00000100:00100000:1.0:1788271836.737896:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 200 00000100:00100000:1.0:1788271836.737907:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+20:12372:x1875138577520896:12345-192.168.201.3@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788271836.737974:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f43e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.737990:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5400/0x99288105fd38f3ff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6b3 expref: 20 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.738045:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f43e lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.738077:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5400/0x99288105fd38f3ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6b3 expref: 20 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.738091:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5400/0x99288105fd38f3ff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6b3 expref: 20 pid: 6485 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271836.738106:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83aa8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1875138590157056:192.168.201.3@tcp:104: 00000100:00100000:1.0:1788271836.738181:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d821f8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788271836.739969:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83aa8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1875138590157056:192.168.201.3@tcp:104: 00010000:00010000:1.0:1788271836.739994:0:6485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f43e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271836.741459:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271836.741561:0:9485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577521024 00000100:00100000:0.0:1788271836.741569:0:9485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577521024 00010000:00010000:0.0:1788271836.741608:0:9485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5400/0x99288105fd38f3ff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6b3 expref: 21 pid: 6485 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271836.741684:0:9485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 90 00000100:00100000:0.0:1788271836.741694:0:9485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83a3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+21:2398:x1875138577521024:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271836.741708:0:9485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271836.741715:0:9485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5400/0x99288105fd38f3ff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6b3 expref: 21 pid: 6485 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271836.741727:0:9485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5400/0x99288105fd38f3ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6b3 expref: 21 pid: 6485 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271836.741747:0:9485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5400/0x99288105fd38f3ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6b3 expref: 21 pid: 6485 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271836.741763:0:9485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:0.0:1788271836.741768:0:9485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f43e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271836.741778:0:9485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f43e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271836.741800:0:9485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f43e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271836.741819:0:9485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271836.741874:0:9485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83a3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+20:2398:x1875138577521024:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 181us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271836.741881:0:9485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 90 00010000:00010000:1.0:1788271836.742107:0:6485:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f43e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.742116:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f43e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.742153:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f43e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.742160:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f43e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.742168:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f43e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.742181:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4ed4a00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271836.742186:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f43e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.742194:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f43e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.742204:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:1.0:1788271836.742207:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788271836.742211:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f43e lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.742217:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f43e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271836.742271:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+19:12372:x1875138577520896:12345-192.168.201.3@tcp:55:lhsmtool_posix.0 Request processed in 4366us (4594us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788271836.742279:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 200 00000100:00100000:2.0:1788271836.745601:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271836.745746:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577521152 00000100:00100000:0.0:1788271836.745755:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577521152 00000100:00100000:0.0:1788271836.745801:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 65 00000100:00100000:0.0:1788271836.745812:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+8:2397:x1875138577521152:12345-192.168.201.3@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788271836.745853:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080b51eda/0x99288105fd38f445 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271836.745873:0:8396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000061f372ab/0x99288105fd38f429 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6cf expref: 8 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271836.745882:0:8396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271836.745886:0:8396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788271836.745890:0:8396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080b51eda/0x99288105fd38f445 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271836.745927:0:8396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000061f372ab/0x99288105fd38f429 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6cf expref: 8 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271836.745941:0:8396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000061f372ab/0x99288105fd38f429 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6cf expref: 8 pid: 8397 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271836.745969:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83ad0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8396:1875138590157184:192.168.201.3@tcp:104: 00000100:00100000:0.0:1788271836.746061:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d9b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788271836.748739:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271836.748810:0:9486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577521280 00000100:00100000:1.0:1788271836.748818:0:9486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577521280 00010000:00010000:1.0:1788271836.748853:0:9486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000061f372ab/0x99288105fd38f429 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6cf expref: 9 pid: 8397 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271836.748895:0:9486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 91 00000100:00100000:1.0:1788271836.748905:0:9486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+9:2397:x1875138577521280:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271836.748920:0:9486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271836.748940:0:9486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000061f372ab/0x99288105fd38f429 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6cf expref: 9 pid: 8397 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.748969:0:9486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000061f372ab/0x99288105fd38f429 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6cf expref: 9 pid: 8397 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.748993:0:9486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788271836.748997:0:9486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788271836.749011:0:9486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000080b51eda/0x99288105fd38f445 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.749021:0:9486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080b51eda/0x99288105fd38f445 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.749041:0:9486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271836.749097:0:9486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+9:2397:x1875138577521280:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 194us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271836.749105:0:9486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 91 00010000:00010000:2.0:1788271836.749206:0:8396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061f372ab/0x99288105fd38f429 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6cf expref: 8 pid: 8397 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271836.749221:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83ad0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8396:1875138590157184:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788271836.749242:0:8396:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000080b51eda/0x99288105fd38f445 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271836.749266:0:8396:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000080b51eda/0x99288105fd38f445 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271836.749273:0:8396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080b51eda/0x99288105fd38f445 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271836.749293:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000080b51eda/0x99288105fd38f445 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271836.749302:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080b51eda/0x99288105fd38f445 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271836.749311:0:8396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080b51eda/0x99288105fd38f445 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271836.749318:0:8396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511ce00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:2.0:1788271836.749331:0:8396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080b51eda/0x99288105fd38f445 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271836.749341:0:8396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080b51eda/0x99288105fd38f445 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271836.749353:0:8396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080b51eda/0x99288105fd38f445 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271836.749360:0:8396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080b51eda/0x99288105fd38f445 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271836.749405:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2397:x1875138577521152:12345-192.168.201.3@tcp:1:lhsmtool_posix.0 Request processed in 3595us (3812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271836.749414:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 65 00000100:00100000:2.0:1788271836.751595:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271836.751810:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577521536 00000100:00100000:0.0:1788271836.751818:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577521536 00000100:00100000:0.0:1788271836.751868:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 201 00000100:00100000:0.0:1788271836.751879:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+19:12372:x1875138577521536:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788271836.751949:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38f44c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271836.751965:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7600/0x99288105fd38f293 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd658 expref: 19 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271836.751975:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38f44c lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271836.752018:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7600/0x99288105fd38f293 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd658 expref: 19 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271836.752030:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7600/0x99288105fd38f293 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd658 expref: 19 pid: 9899 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271836.752043:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83ad1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1875138590157312:192.168.201.3@tcp:104: 00000100:00100000:0.0:1788271836.752111:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d9bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788271836.755549:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271836.755658:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83ad1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1875138590157312:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788271836.755683:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38f44c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271836.755774:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577521664 00000100:00100000:1.0:1788271836.755780:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577521664 00010000:00010000:1.0:1788271836.755813:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7600/0x99288105fd38f293 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd658 expref: 20 pid: 9899 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271836.755848:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 92 00000100:00100000:1.0:1788271836.755857:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+20:2398:x1875138577521664:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271836.755870:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271836.755876:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7600/0x99288105fd38f293 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd658 expref: 20 pid: 9899 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.755905:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7600/0x99288105fd38f293 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd658 expref: 20 pid: 9899 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.755925:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7600/0x99288105fd38f293 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd658 expref: 20 pid: 9899 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.755939:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6eb35a5800) 00010000:00010000:1.0:1788271836.755944:0:6470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38f44c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.755953:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38f44c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.755960:0:6470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38f44c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271836.755984:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271836.756038:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+19:2398:x1875138577521664:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 182us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271836.756044:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 92 00010000:00010000:2.0:1788271836.756114:0:6484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38f44c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271836.756121:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38f44c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271836.756291:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f453 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271836.756311:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f40d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6ba expref: 19 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271836.756319:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f453 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271836.756345:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f40d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6ba expref: 19 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271836.756357:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f40d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6ba expref: 19 pid: 12164 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271836.756369:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83a3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1875138590157440:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788271836.756418:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e856bba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788271836.759520:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271836.759713:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83a3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1875138590157440:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788271836.759739:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f453 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271836.760205:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577521792 00000100:00100000:3.0:1788271836.760213:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577521792 00010000:00010000:3.0:1788271836.760247:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f40d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6ba expref: 20 pid: 12164 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271836.760285:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 93 00000100:00100000:3.0:1788271836.760295:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+20:2397:x1875138577521792:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788271836.760308:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271836.760314:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f40d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6ba expref: 20 pid: 12164 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.760326:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f40d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6ba expref: 20 pid: 12164 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.760349:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f40d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6ba expref: 20 pid: 12164 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.760365:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:3.0:1788271836.760370:0:6468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f453 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.760379:0:6468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f453 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.760385:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f453 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.760425:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788271836.760456:0:6484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f453 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271836.760464:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f453 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271836.760478:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+19:2397:x1875138577521792:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 185us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271836.760485:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 93 00000001:00080000:2.0:1788271836.760564:0:6484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:2.0:1788271836.760723:0:6484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000001:00080000:2.0:1788271836.760758:0:6484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:2.0:1788271836.760833:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83a3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6484:1875138590157568:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788271836.760885:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271836.760909:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e856bb000 going to sleep for 11 seconds 00000100:00100000:1.0:1788271836.761103:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590157568 00000100:00100000:1.0:1788271836.761109:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590157568 00000100:00100000:1.0:1788271836.761148:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788271836.761155:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6484:x1875138590157568:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788271836.761234:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83a3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6484:x1875138590157568:12345-0@lo:1000:mdt00_001.0 Request processed in 78us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271836.761263:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788271836.761376:0:6484:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:0.0:1788271836.761388:0:6484:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f6d83aaaa00, transno 4294967316 00000100:00100000:0.0:1788271836.761407:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83a3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6484:1875138590157568:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788271836.761510:0:6484:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00000100:00100000:0.0:1788271836.761549:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83ad2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6484:1875138590157696:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788271836.761577:0:6484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271836.761603:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d9be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788271836.761674:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590157696 00000100:00100000:3.0:1788271836.761679:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590157696 00000100:00100000:3.0:1788271836.761702:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788271836.761710:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6484:x1875138590157696:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788271836.761948:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6484:x1875138590157696:12345-0@lo:1000:mdt00_001.0 Request processed in 238us (369us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788271836.761955:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788271836.761987:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83ad2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6484:1875138590157696:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1788271836.762025:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f453 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.762034:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f453 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.762040:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f453 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.762046:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f6800 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271836.762050:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f453 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.762057:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f453 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.762079:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:3.0:1788271836.762082:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788271836.762086:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f453 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.762093:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f453 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.762115:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f388 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.762122:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f388 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.762128:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f388 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.762133:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e92d32600 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271836.762136:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f388 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.762142:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f388 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.762150:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6eb35a5800) 00010000:00010000:3.0:1788271836.762152:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788271836.762155:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f388 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.762161:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f388 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.762192:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f45a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.762203:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38f3a4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd69e expref: 22 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.762212:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f45a lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.762232:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38f3a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd69e expref: 22 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.762243:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38f3a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd69e expref: 22 pid: 9899 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271836.762253:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8316e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1875138590157824:192.168.201.3@tcp:104: 00000100:00100000:3.0:1788271836.762309:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4f0a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788271836.766095:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271836.766106:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8316e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1875138590157824:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788271836.766133:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f45a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271836.766194:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577521920 00000100:00100000:2.0:1788271836.766201:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577521920 00010000:00010000:2.0:1788271836.766235:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38f3a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd69e expref: 23 pid: 9899 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271836.766475:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 94 00000100:00100000:2.0:1788271836.766486:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+23:2395:x1875138577521920:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271836.766500:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271836.766507:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38f3a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd69e expref: 23 pid: 9899 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271836.766518:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38f3a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd69e expref: 23 pid: 9899 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271836.766538:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38f3a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd69e expref: 23 pid: 9899 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271836.766552:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6eb35a5800) 00010000:00010000:2.0:1788271836.766557:0:6469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f45a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271836.766567:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f45a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271836.766575:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f45a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271836.766647:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788271836.766652:0:6484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f45a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.766658:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f45a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.766670:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f45a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.766681:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f45a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.766687:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f45a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271836.766689:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+22:2395:x1875138577521920:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 206us (603us total) trans 0 rc 0/0 00010000:00010000:3.0:1788271836.766694:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4c00 already unused, calling callback (ffffffffc174a4f0) 00000100:00100000:2.0:1788271836.766697:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 94 00010000:00010000:3.0:1788271836.766698:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f45a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.766705:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f45a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.766713:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6eb35a5800) 00010000:00010000:3.0:1788271836.766716:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271836.766720:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f45a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.766726:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f45a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.766737:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38f44c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.766743:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38f44c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.766749:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38f44c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.766753:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511dc00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271836.766760:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38f44c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.766766:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38f44c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.766774:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6eb35a5800) 00010000:00010000:3.0:1788271836.766776:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788271836.766779:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38f44c lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.766784:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38f44c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271836.767172:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+21:12372:x1875138577521536:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 Request processed in 15294us (15581us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1788271836.767180:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 201 00000020:00080000:3.0:1788271836.767184:0:6484:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1788271836.769654:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271836.770990:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577522176 00000100:00100000:3.0:1788271836.771010:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577522176 00000100:00100000:3.0:1788271836.771067:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 50 00000100:00100000:3.0:1788271836.771077:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb36af050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+21:12372:x1875138577522176:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788271836.771308:0:6487:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788271836.771335:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967470 00010000:00010000:3.0:1788271836.771365:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f461 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.771380:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f461 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.771390:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f461 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.771410:0:6487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f461 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.771416:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f461 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.771422:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f461 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.771438:0:6487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788271836.771514:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb36af050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+23:12372:x1875138577522176:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 Request processed in 439us (1867us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788271836.771522:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 50 00000020:00080000:3.0:1788271836.771526:0:6487:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788271836.771570:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788271836.771577:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f461 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.771584:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c5000 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:3.0:1788271836.771589:0:6471:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f461 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.771597:0:6471:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f461 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.771608:0:6471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:3.0:1788271836.771611:0:6471:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788271836.771615:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f461 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.771647:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f461 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271836.771658:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271836.771660:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271836.771661:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788271836.772792:0:13762:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788271836.772798:0:13762:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788271836.773596:0:13762:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1788271836.773608:0:13762:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788271837.598806:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271838.115917:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271838.115965:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271838.115999:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271838.116020:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271838.116043:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271838.116062:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271838.116083:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271838.116115:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577522304 00000100:00100000:1.0:1788271838.116125:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577522304 00000100:00100000:1.0:1788271838.116504:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 386 00000100:00100000:1.0:1788271838.116517:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2397:x1875138577522304:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271838.116589:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2397:x1875138577522304:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 75us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271838.116597:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 386 00000100:00100000:1.0:1788271838.116659:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577522432 00000100:00100000:1.0:1788271838.116663:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577522432 00000100:00100000:1.0:1788271838.116713:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577522560 00000100:00100000:1.0:1788271838.116717:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577522560 00000100:00100000:1.0:1788271838.116733:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577523072 00000100:00100000:1.0:1788271838.116736:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577523072 00000100:00100000:1.0:1788271838.116748:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577522944 00000100:00100000:1.0:1788271838.116751:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577522944 00000100:00100000:1.0:1788271838.116764:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 305 00000100:00100000:1.0:1788271838.116770:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+23:2397:x1875138577522432:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271838.116829:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+23:2397:x1875138577522432:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 59us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271838.116836:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 305 00000100:00100000:1.0:1788271838.116850:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 306 00000100:00100000:1.0:1788271838.116856:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2397:x1875138577522560:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271838.116882:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2397:x1875138577522560:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 26us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271838.116888:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 306 00000100:00100000:1.0:1788271838.117018:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 307 00000100:00100000:1.0:1788271838.117029:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:956fb91b-4885-4e88-90fb-3061936b51ca+5:2397:x1875138577523072:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271838.117056:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:956fb91b-4885-4e88-90fb-3061936b51ca+5:2397:x1875138577523072:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 31us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271838.117062:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 307 00000100:00100000:1.0:1788271838.117075:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 308 00000100:00100000:1.0:1788271838.117081:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:956fb91b-4885-4e88-90fb-3061936b51ca+5:2397:x1875138577522944:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271838.117102:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:956fb91b-4885-4e88-90fb-3061936b51ca+5:2397:x1875138577522944:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 22us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271838.117108:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 308 00000100:00100000:1.0:1788271838.117131:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577522816 00000100:00100000:1.0:1788271838.117134:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577522816 00000100:00100000:1.0:1788271838.117162:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577522688 00000100:00100000:1.0:1788271838.117164:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577522688 00000100:00100000:1.0:1788271838.117199:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 122 00000100:00100000:1.0:1788271838.117205:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2397:x1875138577522816:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271838.117250:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2397:x1875138577522816:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 45us (1229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271838.117256:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 122 00000100:00100000:1.0:1788271838.117267:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 123 00000100:00100000:1.0:1788271838.117273:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2397:x1875138577522688:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271838.117295:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2397:x1875138577522688:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 23us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271838.117301:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 123 00000100:00080000:1.0:1788271838.117453:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788271838.117458:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788271838.117460:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788271838.117463:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1788271838.227033:0:14725:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788271838.227044:0:14725:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788271838.227070:0:14725:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788271838.227076:0:14725:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788271838.364005:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271838.364162:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577523328 00000100:00100000:1.0:1788271838.364172:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577523328 00000100:00100000:1.0:1788271838.364233:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 202 00000100:00100000:1.0:1788271838.364243:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8316e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+23:12389:x1875138577523328:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:1.0:1788271838.364263:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271838.364283:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f468 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd6d6 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.364386:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5400/0x99288105fd38f46f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.364410:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5400/0x99288105fd38f46f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.364423:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5400/0x99288105fd38f46f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271838.364445:0:6483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788271838.364546:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f468 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6d6 expref: 26 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.364580:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5400/0x99288105fd38f46f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6d6 expref: 25 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.364589:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f6d82060100) 00010000:00010000:1.0:1788271838.364591:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788271838.364595:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4ed5400, rc 0) 00000100:00100000:1.0:1788271838.364680:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8316e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+25:12389:x1875138577523328:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 437us (685us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1788271838.364687:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 202 00000100:00100000:2.0:1788271838.374456:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271838.374545:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577523456 00000100:00100000:3.0:1788271838.374566:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577523456 00000100:00100000:3.0:1788271838.374638:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 203 00000100:00100000:3.0:1788271838.374649:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+25:12389:x1875138577523456:12345-192.168.201.3@tcp:34:lfs.0 00010000:00010000:3.0:1788271838.374734:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38f47d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.374751:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38f47d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.374762:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38f47d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.374778:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f484 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.374785:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f484 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.374792:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f484 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.374880:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f48b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.374896:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f48b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.374904:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f48b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788271838.374952:0:6485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f48b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.374965:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38f47d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.374982:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38f47d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.374990:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38f47d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.374996:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c5400 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271838.375001:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38f47d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.375009:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38f47d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.375020:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f6d82060100) 00010000:00010000:3.0:1788271838.375023:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271838.375028:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38f47d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.375034:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38f47d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.375052:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f484 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.375058:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f484 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.375063:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f484 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.375068:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c5000 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271838.375070:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f484 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.375075:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f484 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.375083:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f6e920a2000) 00010000:00010000:3.0:1788271838.375086:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271838.375089:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f484 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.375094:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f484 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.375108:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f48b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.375114:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f48b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.375120:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f48b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.375131:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4c00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271838.375135:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f48b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.375141:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f48b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.375149:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6e920a2700) 00010000:00010000:3.0:1788271838.375151:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271838.375153:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f48b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.375159:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f48b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271838.375234:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+25:12389:x1875138577523456:12345-192.168.201.3@tcp:34:lfs.0 Request processed in 586us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271838.375243:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 203 00000100:00100000:3.0:1788271838.428078:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271838.431203:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577523712 00000100:00100000:1.0:1788271838.431219:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577523712 00000100:00100000:1.0:1788271838.431329:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 204 00000100:00100000:1.0:1788271838.431341:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8316dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+25:12392:x1875138577523712:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:1.0:1788271838.431360:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271838.431380:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f492 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd6dd expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.431465:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f499 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.431490:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f499 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.431519:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f499 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.431535:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38f4a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.431542:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38f4a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.431548:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38f4a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.431687:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f4a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.431696:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f4a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.431702:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f4a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271838.431711:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788271838.431784:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f499 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.431791:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f499 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.431798:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f499 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.431803:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4ed4c00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271838.431813:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f499 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.431821:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f499 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.431833:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f6d82060100) 00010000:00010000:1.0:1788271838.431836:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271838.431840:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f499 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.431847:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f499 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.431859:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38f4a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.431866:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38f4a0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.431871:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38f4a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.431877:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4ed5e00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271838.431880:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38f4a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.431886:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38f4a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.431893:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f6d82060e00) 00010000:00010000:1.0:1788271838.431896:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271838.431904:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38f4a0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.431910:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38f4a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.431949:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f492 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6dd expref: 28 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.431962:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f4a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6dd expref: 27 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.431984:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6d82060300) 00010000:00010000:1.0:1788271838.431986:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788271838.431988:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e92d32600, rc 0) 00000100:00100000:1.0:1788271838.432064:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8316dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+27:12392:x1875138577523712:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 726us (3995us total) trans 4294967473 rc 0/0 00000100:00100000:1.0:1788271838.432072:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 204 00000100:00100000:3.0:1788271838.442554:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271838.442697:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577523840 00000100:00100000:2.0:1788271838.442719:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577523840 00000100:00100000:2.0:1788271838.442782:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 205 00000100:00100000:2.0:1788271838.442794:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8316fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+27:12392:x1875138577523840:12345-192.168.201.3@tcp:54:lfs.0 00010000:00010000:2.0:1788271838.443047:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f4b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.443065:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.443076:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.443112:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.443118:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f4b5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.443125:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f4b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.443146:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f6400 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271838.443151:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f4b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.443158:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f4b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.443172:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6d82060300) 00010000:00010000:2.0:1788271838.443175:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788271838.443180:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f4b5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.443186:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f4b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271838.443262:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8316fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+27:12392:x1875138577523840:12345-192.168.201.3@tcp:54:lfs.0 Request processed in 469us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271838.443270:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 205 00000100:00100000:2.0:1788271838.447049:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271838.447105:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577524096 00000100:00100000:3.0:1788271838.447116:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577524096 00000100:00100000:3.0:1788271838.447168:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 51 00000100:00100000:3.0:1788271838.447178:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+27:12392:x1875138577524096:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:3.0:1788271838.447400:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+28:12392:x1875138577524096:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 223us (361us total) trans 4294967474 rc 0/0 00000100:00100000:3.0:1788271838.447408:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 51 00000100:00100000:3.0:1788271838.507721:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271838.508758:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577524352 00000100:00100000:2.0:1788271838.508767:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577524352 00000100:00100000:2.0:1788271838.508820:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 206 00000100:00100000:2.0:1788271838.508829:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8316ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+28:11916:x1875138577524352:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:2.0:1788271838.508852:0:9899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271838.508872:0:9899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f4bc lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd6e4 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.508963:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6600/0x99288105fd38f4c3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.509009:0:9899:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f4a7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6dd expref: 29 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.509017:0:9899:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6600/0x99288105fd38f4c3 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.509047:0:9899:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f4a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6dd expref: 29 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.509060:0:9899:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f4a7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6dd expref: 29 pid: 6484 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271838.509073:0:9899:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83a3ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9899:1875138590157952:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788271838.509172:0:9899:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830a6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788271838.511368:0:9899:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83a3ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9899:1875138590157952:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788271838.511393:0:9899:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6600/0x99288105fd38f4c3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271838.517989:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271838.518349:0:9485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577524480 00000100:00100000:0.0:1788271838.518358:0:9485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577524480 00010000:00010000:0.0:1788271838.518399:0:9485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f4a7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6dd expref: 30 pid: 6484 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271838.518440:0:9485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 95 00000100:00100000:0.0:1788271838.518449:0:9485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e84d00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+30:2397:x1875138577524480:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271838.518463:0:9485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271838.518469:0:9485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f4a7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6dd expref: 30 pid: 6484 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271838.518491:0:9485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f4a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6dd expref: 30 pid: 6484 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271838.518513:0:9485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f4a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6dd expref: 30 pid: 6484 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271838.518530:0:9485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6d82060300) 00010000:00010000:0.0:1788271838.518547:0:9485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6600/0x99288105fd38f4c3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271838.518558:0:9485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6600/0x99288105fd38f4c3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271838.518565:0:9485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6600/0x99288105fd38f4c3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271838.518596:0:9485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271838.518683:0:9485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e84d00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+29:2397:x1875138577524480:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 233us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271838.518689:0:9485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 95 00010000:00010000:2.0:1788271838.518818:0:9899:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6600/0x99288105fd38f4c3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.518827:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6600/0x99288105fd38f4c3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271838.518845:0:9899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788271838.518962:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f4bc lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6e4 expref: 30 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.519004:0:9899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6600/0x99288105fd38f4c3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6e4 expref: 29 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.519012:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6d82060300) 00010000:00010000:2.0:1788271838.519015:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788271838.519017:0:9899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d833f6600, rc 0) 00000100:00100000:2.0:1788271838.519042:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8316ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+29:11916:x1875138577524352:12345-192.168.201.3@tcp:101:bash.0 Request processed in 10215us (11330us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1788271838.519049:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 206 00000100:00100000:0.0:1788271838.523719:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271838.523880:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577524608 00000100:00100000:1.0:1788271838.523891:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577524608 00000100:00100000:1.0:1788271838.523948:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 207 00000100:00100000:1.0:1788271838.523958:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+29:11916:x1875138577524608:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:1.0:1788271838.523989:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271838.524010:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f4d1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd6eb expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.524042:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f4d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.524075:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.524086:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.524189:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f4d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6eb expref: 31 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.524208:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f4d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6eb expref: 30 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.524228:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6d82060300) 00010000:00010000:1.0:1788271838.524231:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788271838.524235:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e92d33a00, rc 0) 00000100:00100000:1.0:1788271838.524335:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+30:11916:x1875138577524608:12345-192.168.201.3@tcp:101:bash.0 Request processed in 378us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271838.524343:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 207 00000100:00100000:1.0:1788271838.531896:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271838.531989:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577524864 00000100:00100000:2.0:1788271838.531999:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577524864 00000100:00100000:2.0:1788271838.532057:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 208 00000100:00100000:2.0:1788271838.532067:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+30:11916:x1875138577524864:12345-192.168.201.3@tcp:36:bash.0 00010000:00010000:2.0:1788271838.532280:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f4df lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.532297:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f4df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.532308:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f4df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788271838.532348:0:12164:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000004:00010000:2.0:1788271838.532372:0:12164:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e74c5310 reply state 000000006e919ff1 transno 4294967477 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f4df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.532385:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f4df lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.532406:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6d82060300) 00010000:00010000:2.0:1788271838.532409:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788271838.532414:0:12164:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788271838.532451:0:12164:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967477 00000100:00100000:2.0:1788271838.532545:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+34:11916:x1875138577524864:12345-192.168.201.3@tcp:36:bash.0 Request processed in 478us (657us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1788271838.532552:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 208 00000020:00080000:2.0:1788271838.532556:0:12164:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788271838.537444:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271838.537578:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577524992 00000100:00100000:2.0:1788271838.537590:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577524992 00000100:00100000:2.0:1788271838.537693:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 209 00000100:00100000:2.0:1788271838.537703:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+34:11916:x1875138577524992:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:2.0:1788271838.537725:0:9899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271838.537743:0:9899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7800/0x99288105fd38f4e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd6f2 expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.537791:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7800/0x99288105fd38f4e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6f2 expref: 35 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.537802:0:9899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7800/0x99288105fd38f4e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6f2 expref: 35 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.537821:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6d82060300) 00010000:00010000:2.0:1788271838.537824:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788271838.537828:0:9899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d833f7800, rc 0) 00000100:00100000:2.0:1788271838.537887:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+35:11916:x1875138577524992:12345-192.168.201.3@tcp:101:bash.0 Request processed in 186us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271838.537908:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 209 00000100:00100000:0.0:1788271838.544543:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271838.544747:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577525120 00000100:00100000:2.0:1788271838.544757:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577525120 00000100:00100000:2.0:1788271838.544820:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 66 00000100:00100000:2.0:1788271838.544830:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:11916:x1875138577525120:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:2.0:1788271838.544849:0:8396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271838.544871:0:8396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065045b01/0x99288105fd38f4ed lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd6f9 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788271838.544900:0:8396:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a96dcda, atime: 0x6a96dcd9, ctime: 0x6a96dcda, blocks: 0x8 00010000:00010000:2.0:1788271838.544923:0:8396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=399s v=(0 0) 00010000:00010000:2.0:1788271838.544927:0:8396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271838.544936:0:8396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065045b01/0x99288105fd38f4ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6f9 expref: 8 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.544955:0:8396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000065045b01/0x99288105fd38f4ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6f9 expref: 8 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.544979:0:8396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d833f7200, rc 0) 00000100:00100000:2.0:1788271838.545079:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+8:11916:x1875138577525120:12345-192.168.201.3@tcp:101:bash.0 Request processed in 250us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271838.545086:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 66 00000100:00100000:3.0:1788271838.548350:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271838.549036:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577525248 00000100:00100000:2.0:1788271838.549048:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577525248 00002000:00010000:2.0:1788271838.549093:0:8403:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:2.0:1788271838.549098:0:8403:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f6d83b08e00 with x1875138577525248 ext(0->18446744073709551615) 00002000:00010000:2.0:1788271838.549119:0:8403:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f6d83b08e00. 00000100:00100000:2.0:1788271838.549198:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 5 00000100:00100000:2.0:1788271838.549208:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+8:2396:x1875138577525248:12345-192.168.201.3@tcp:10:bash.0 00002000:00010000:2.0:1788271838.549468:0:8403:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788271838.549472:0:8403:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788271834 -> 1788271837 00002000:00010000:2.0:1788271838.549475:0:8403:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1788271833 -> 1788271833 00002000:00010000:2.0:1788271838.549477:0:8403:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788271834 -> 1788271837 00002000:00010000:2.0:1788271838.549491:0:8403:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1788271838.549559:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+9:2396:x1875138577525248:12345-192.168.201.3@tcp:10:bash.0 Request processed in 352us (1214us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1788271838.549568:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 5 00002000:00010000:2.0:1788271838.549572:0:8403:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:2.0:1788271838.549575:0:8403:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f6d83b08e00 with x1875138577525248 ext(0->18446744073709551615) 00002000:00010000:2.0:1788271838.549580:0:8403:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f6d83b08e00. 00010000:00010000:0.0:1788271838.623055:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271838.625187:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271838.625255:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271838.625307:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577525504 00000100:00100000:1.0:1788271838.625318:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577525504 00000100:00100000:1.0:1788271838.625387:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 67 00000100:00100000:1.0:1788271838.625398:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+9:2398:x1875138577525504:12345-192.168.201.3@tcp:16:kworker.0 00000100:00100000:2.0:1788271838.625519:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577525376 00000100:00100000:2.0:1788271838.625524:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577525376 00002000:00100000:2.0:1788271838.625552:0:8402:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->7) req@ffff8f6d83ad0380 x1875138577525376/t0(0) o4->ef8df183-a1b1-4e56-bce5-924a894c4a71@192.168.201.3@tcp:744/0 lens 496/0 e 0 to 0 dl 1788271849 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788271838.625563:0:8402:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f6d83ad0380 with x1875138577525376 ext(0->7) 00002000:00010000:2.0:1788271838.625569:0:8402:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f6d83ad0380 00000100:00100000:2.0:1788271838.625596:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 6 00000100:00100000:2.0:1788271838.625603:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+10:2398:x1875138577525376:12345-192.168.201.3@tcp:4:bash.0 00000100:00100000:2.0:1788271838.627276:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+12:2398:x1875138577525376:12345-192.168.201.3@tcp:4:bash.0 Request processed in 1666us (2014us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788271838.627287:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 6 00002000:00100000:2.0:1788271838.627306:0:8402:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->7) req@ffff8f6d83ad0380 x1875138577525376/t4294967320(0) o4->ef8df183-a1b1-4e56-bce5-924a894c4a71@192.168.201.3@tcp:744/0 lens 496/448 e 0 to 0 dl 1788271849 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788271838.627316:0:8402:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f6d83ad0380 with x1875138577525376 ext(0->7) 00002000:00010000:2.0:1788271838.627321:0:8402:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f6d83ad0380 00000001:00080000:0.0:1788271838.632685:0:9475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:0.0:1788271838.632700:0:9475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000100:00100000:1.0:1788271838.636260:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+9:2398:x1875138577525504:12345-192.168.201.3@tcp:16:kworker.0 Request processed in 10853us (11070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271838.636273:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 67 00000100:00100000:0.0:1788271838.645126:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271838.645198:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577525632 00000100:00100000:3.0:1788271838.645207:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577525632 00000100:00100000:3.0:1788271838.645318:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 210 00000100:00100000:3.0:1788271838.645328:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+35:12406:x1875138577525632:12345-192.168.201.3@tcp:34:lfs.0 00010000:00010000:3.0:1788271838.645396:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f4f4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.645414:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f4f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.645425:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f4f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.645441:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f4fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.645448:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f4fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.645455:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f4fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.645522:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f502 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.645531:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f502 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.645538:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f502 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788271838.645597:0:6485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f502 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.645608:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f4f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.645615:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f4f4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.645673:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f4f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.645679:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4000 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271838.645684:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f4f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.645691:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f4f4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.645703:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f6d82060100) 00010000:00010000:3.0:1788271838.645705:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271838.645710:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f4f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.645715:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f4f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.645728:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f4fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.645733:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f4fb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.645744:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f4fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.645749:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4c00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271838.645752:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f4fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.645758:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f4fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.645766:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f6e920a2700) 00010000:00010000:3.0:1788271838.645769:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271838.645771:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f4fb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.645777:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f4fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.645791:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f502 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.645978:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f502 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.645985:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f502 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.645990:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c5000 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271838.645993:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f502 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.646010:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f502 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.646019:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6d82060300) 00010000:00010000:3.0:1788271838.646021:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271838.646024:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f502 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.646030:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f502 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271838.646109:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+35:12406:x1875138577525632:12345-192.168.201.3@tcp:34:lfs.0 Request processed in 781us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271838.646116:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 210 00000100:00100000:1.0:1788271838.683328:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271838.683435:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577525888 00000100:00100000:2.0:1788271838.683445:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577525888 00000100:00100000:2.0:1788271838.683508:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 211 00000100:00100000:2.0:1788271838.683519:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+35:12409:x1875138577525888:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788271838.683540:0:12164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271838.683559:0:12164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7c00/0x99288105fd38f509 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd700 expref: -99 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.683664:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7000/0x99288105fd38f510 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.683677:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7000/0x99288105fd38f510 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.683688:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7000/0x99288105fd38f510 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.683701:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7a00/0x99288105fd38f517 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.683708:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7a00/0x99288105fd38f517 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.683714:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7a00/0x99288105fd38f517 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.683830:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f51e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.683839:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f51e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.683847:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f51e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271838.683856:0:12164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788271838.683929:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7000/0x99288105fd38f510 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.683937:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7000/0x99288105fd38f510 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.683944:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7000/0x99288105fd38f510 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.683950:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f7000 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271838.683954:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7000/0x99288105fd38f510 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.683962:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7000/0x99288105fd38f510 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.683985:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f6d82060100) 00010000:00010000:2.0:1788271838.683988:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271838.683992:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7000/0x99288105fd38f510 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.684009:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7000/0x99288105fd38f510 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.684023:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7a00/0x99288105fd38f517 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.684029:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7a00/0x99288105fd38f517 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.684036:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7a00/0x99288105fd38f517 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.684041:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f7a00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271838.684044:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7a00/0x99288105fd38f517 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.684050:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7a00/0x99288105fd38f517 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.684057:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f6eb35a5b00) 00010000:00010000:2.0:1788271838.684060:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271838.684062:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7a00/0x99288105fd38f517 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.684067:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7a00/0x99288105fd38f517 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.684104:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7c00/0x99288105fd38f509 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd700 expref: 38 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.684128:0:12164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f51e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd700 expref: 37 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.684135:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6d82060300) 00010000:00010000:2.0:1788271838.684138:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788271838.684140:0:12164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d833f6000, rc 0) 00000100:00100000:2.0:1788271838.684191:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+37:12409:x1875138577525888:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 673us (875us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1788271838.684198:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 211 00000100:00100000:0.0:1788271838.687435:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271838.687549:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577526016 00000100:00100000:1.0:1788271838.687558:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577526016 00000100:00100000:1.0:1788271838.687721:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 212 00000100:00100000:1.0:1788271838.687735:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+37:12409:x1875138577526016:12345-192.168.201.3@tcp:54:lfs.0 00010000:00010000:1.0:1788271838.688133:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f52c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.688150:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6600/0x99288105fd38f4c3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6e4 expref: 37 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.688160:0:6484:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f52c lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.688201:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6600/0x99288105fd38f4c3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6e4 expref: 37 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.688215:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6600/0x99288105fd38f4c3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6e4 expref: 37 pid: 9899 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271838.688229:0:6484:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83393800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1875138590158080:192.168.201.3@tcp:104: 00000100:00100000:1.0:1788271838.688636:0:6484:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e89061a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788271838.695043:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271838.695341:0:6484:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83393800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6484:1875138590158080:192.168.201.3@tcp:104: 00010000:00010000:1.0:1788271838.695367:0:6484:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f52c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271838.695459:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577526272 00000100:00100000:3.0:1788271838.695468:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577526272 00000100:00100000:3.0:1788271838.695646:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 52 00000100:00100000:3.0:1788271838.695657:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+38:6637:x1875138577526272:12345-192.168.201.3@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788271838.696005:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+39:6637:x1875138577526272:12345-192.168.201.3@tcp:35:ldlm_bl.0 Request processed in 349us (971us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1788271838.696014:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 52 00000100:00100000:2.0:1788271838.698835:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271838.698936:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577526400 00000100:00100000:3.0:1788271838.698945:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577526400 00010000:00010000:3.0:1788271838.698989:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6600/0x99288105fd38f4c3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6e4 expref: 39 pid: 9899 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271838.699076:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 96 00000100:00100000:3.0:1788271838.699086:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3598c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+39:2397:x1875138577526400:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788271838.699111:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271838.699118:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6600/0x99288105fd38f4c3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6e4 expref: 39 pid: 9899 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.699131:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6600/0x99288105fd38f4c3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6e4 expref: 39 pid: 9899 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.699151:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6600/0x99288105fd38f4c3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6e4 expref: 39 pid: 9899 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.699166:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6d82060300) 00010000:00010000:3.0:1788271838.699171:0:6468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f52c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.699181:0:6468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f52c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.699188:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f52c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.699225:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271838.699277:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3598c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+38:2397:x1875138577526400:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 192us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271838.699284:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 96 00010000:00010000:2.0:1788271838.699524:0:6484:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f52c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.699533:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f52c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.699571:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f52c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.699578:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f52c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.699584:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f52c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.699591:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e92d33e00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271838.699595:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f52c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.699613:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f52c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.699652:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6d82060300) 00010000:00010000:2.0:1788271838.699655:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788271838.699659:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f52c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.699665:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f52c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271838.699706:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+37:12409:x1875138577526016:12345-192.168.201.3@tcp:54:lfs.0 Request processed in 11975us (12279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271838.699713:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 212 00000100:00100000:2.0:1788271838.703028:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271838.703129:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577526656 00000100:00100000:0.0:1788271838.703139:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577526656 00000100:00100000:0.0:1788271838.703218:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 53 00000100:00100000:0.0:1788271838.703227:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+37:12409:x1875138577526656:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:0.0:1788271838.703572:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+38:12409:x1875138577526656:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 345us (551us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1788271838.703593:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 53 00000100:00100000:2.0:1788271838.750049:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83ad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590158208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788271838.750127:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271838.750389:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788271838.750399:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83aa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590158336:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788271838.750431:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271838.750511:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590158336 00000100:00100000:3.0:1788271838.750518:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590158336 00000100:00100000:3.0:1788271838.750572:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788271838.750583:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590158336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788271838.750634:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788271838.750698:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83a3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590158336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271838.750705:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788271838.750749:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83aa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590158336:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788271838.750950:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590158208 00000100:00100000:0.0:1788271838.750955:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590158208 00000100:00100000:0.0:1788271838.751013:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788271838.751021:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3606:x1875138590158208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788271838.751041:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788271838.751078:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3606:x1875138590158208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271838.751084:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788271838.751112:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83ad0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590158208:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788271838.751168:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788271838.751567:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788271838.751578:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83a3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590158464:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788271838.751611:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271838.751752:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590158464 00000100:00100000:3.0:1788271838.751757:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590158464 00000100:00100000:3.0:1788271838.751811:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788271838.751820:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83393800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590158464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788271838.751832:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271838.751865:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83393800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590158464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271838.751872:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:2.0:1788271838.751989:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788271838.752051:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83a3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590158464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788271838.788096:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271838.788197:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577526912 00000100:00100000:3.0:1788271838.788207:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577526912 00000100:00100000:3.0:1788271838.788287:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 213 00000100:00100000:3.0:1788271838.788299:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+38:12420:x1875138577526912:12345-192.168.201.3@tcp:101:cat.0 00010000:00010000:3.0:1788271838.788323:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271838.788343:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f533 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd707 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.788420:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f53a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.788435:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f53a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.788446:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f53a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.788704:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f541 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.788713:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f541 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.788720:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f541 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.788832:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38f548 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.788842:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38f548 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.788850:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38f548 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271838.788859:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:3.0:1788271838.788933:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f53a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.788939:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f53a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.788946:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f53a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.788952:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4c00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271838.788958:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f53a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.788988:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f53a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.789002:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f6d82060100) 00010000:00010000:3.0:1788271838.789005:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271838.789009:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f53a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.789016:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f53a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.789028:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f541 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.789033:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f541 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.789039:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f541 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.789045:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4000 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271838.789048:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f541 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.789054:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f541 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.789062:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f6e920a2700) 00010000:00010000:3.0:1788271838.789064:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271838.789067:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f541 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.789082:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f541 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.789121:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f533 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd707 expref: 41 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.789134:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38f548 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd707 expref: 40 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.789142:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6d82060300) 00010000:00010000:3.0:1788271838.789145:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788271838.789147:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c5400, rc 0) 00000100:00100000:3.0:1788271838.789306:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+40:12420:x1875138577526912:12345-192.168.201.3@tcp:101:cat.0 Request processed in 1009us (1219us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1788271838.789314:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 213 00000100:00100000:1.0:1788271838.795077:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271838.795161:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577527168 00000100:00100000:3.0:1788271838.795172:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577527168 00000100:00100000:3.0:1788271838.795250:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 54 00000100:00100000:3.0:1788271838.795262:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8399d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+40:12420:x1875138577527168:12345-192.168.201.3@tcp:35:cat.0 00000100:00100000:3.0:1788271838.795767:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8399d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+41:12420:x1875138577527168:12345-192.168.201.3@tcp:35:cat.0 Request processed in 506us (701us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1788271838.795775:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 54 00000100:00100000:2.0:1788271838.812494:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271838.812895:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577527424 00000100:00100000:1.0:1788271838.812905:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577527424 00000100:00100000:1.0:1788271838.812959:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 214 00000100:00100000:1.0:1788271838.812979:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+41:12421:x1875138577527424:12345-192.168.201.3@tcp:36:rm.0 00010000:00010000:1.0:1788271838.813064:0:9899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1788271838.813087:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7800/0x99288105fd38f4e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6f2 expref: 41 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.813106:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5400/0x99288105fd38f548 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd707 expref: 40 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.813113:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f51e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd700 expref: 39 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.813121:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f4d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6eb expref: 38 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.813128:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6d82060300) 00010000:00010000:1.0:1788271838.813131:0:9899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788271838.813147:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38f556 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.813159:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38f556 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.813166:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38f556 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.813180:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38f55d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.813184:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38f55d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.813188:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38f55d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.813261:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f564 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.813268:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f564 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.813275:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f564 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788271838.813739:0:9899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:1.0:1788271838.813750:0:9899:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 399903130236ns, next at 400903127506ns, rc = 0 00010000:00010000:1.0:1788271838.813805:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f56b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.813814:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f56b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.813822:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f56b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.813830:0:9899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f56b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.813846:0:9899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f56b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.813852:0:9899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f56b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.813878:0:9899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788271838.813898:0:9899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f564 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.813904:0:9899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f564 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.813906:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271838.813910:0:9899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f564 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.813912:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f56b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.813916:0:9899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e92d32600 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271838.813918:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e92d33e00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:1.0:1788271838.813920:0:9899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f564 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.813927:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f56b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.813929:0:9899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f564 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.813934:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f56b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.813938:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6d82060300) 00010000:00010000:1.0:1788271838.813941:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788271838.813944:0:9899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f564 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.813947:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6d82060300) 00010000:00010000:3.0:1788271838.813949:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788271838.813950:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f564 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.813952:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f56b lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.813958:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f56b lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.813975:0:9899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38f556 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271838.813980:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271838.813982:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271838.813983:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271838.813985:0:9899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38f556 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.813991:0:9899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38f556 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.813996:0:9899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e92d32c00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271838.814000:0:9899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38f556 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.814006:0:9899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38f556 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.814012:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f6d82060100) 00010000:00010000:1.0:1788271838.814013:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271838.814015:0:9899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38f556 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.814019:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38f556 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788271838.814025:0:9899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000079f3b5cf reply state 0000000083ff7f1d transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38f55d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.814032:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38f55d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.814036:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f6d82060e00) 00010000:00010000:1.0:1788271838.814037:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788271838.814039:0:9899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788271838.814108:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83a3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+39:12421:x1875138577527424:12345-192.168.201.3@tcp:36:rm.0 Request processed in 1131us (1636us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1788271838.814121:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 214 00000100:00100000:0.0:1788271838.858411:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271838.858517:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577527680 00000100:00100000:2.0:1788271838.858529:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577527680 00000100:00100000:2.0:1788271838.858594:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 215 00000100:00100000:2.0:1788271838.858605:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+39:12427:x1875138577527680:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:2.0:1788271838.858659:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271838.858692:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7a00/0x99288105fd38f572 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd70e expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.858791:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7000/0x99288105fd38f579 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.858812:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7000/0x99288105fd38f579 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.858819:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7000/0x99288105fd38f579 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.858826:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6200/0x99288105fd38f580 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.858831:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6200/0x99288105fd38f580 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.858834:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6200/0x99288105fd38f580 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788271838.859154:0:6484:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:2.0:1788271838.859290:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f587 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.859300:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f587 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.859306:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f587 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.859335:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7000/0x99288105fd38f579 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.859351:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7000/0x99288105fd38f579 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.859358:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7000/0x99288105fd38f579 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.859363:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f7000 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271838.859367:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7000/0x99288105fd38f579 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.859373:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7000/0x99288105fd38f579 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.859387:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f6d82060100) 00010000:00010000:2.0:1788271838.859389:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271838.859394:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7000/0x99288105fd38f579 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.859399:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7000/0x99288105fd38f579 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788271838.859413:0:6484:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d416c0f4 reply state 0000000085bc9443 transno 4294967485 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6200/0x99288105fd38f580 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.859423:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6200/0x99288105fd38f580 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.859428:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f6d82060e00) 00010000:00010000:2.0:1788271838.859430:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788271838.859432:0:6484:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788271838.859457:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7a00/0x99288105fd38f572 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd70e expref: 42 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.859476:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f587 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd70e expref: 41 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.859484:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6eb35a5b00) 00010000:00010000:2.0:1788271838.859486:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788271838.859493:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d833f6000, rc 0) 00000100:00100000:2.0:1788271838.859563:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+42:12427:x1875138577527680:12345-192.168.201.3@tcp:101:bash.0 Request processed in 959us (1161us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1788271838.859571:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 215 00000100:00100000:0.0:1788271838.865688:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271838.865727:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577527808 00000100:00100000:1.0:1788271838.865738:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577527808 00000100:00100000:1.0:1788271838.865902:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 68 00000100:00100000:1.0:1788271838.865914:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2397:x1875138577527808:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:1.0:1788271838.865932:0:12967:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271838.865952:0:12967:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9748023/0x99288105fd38f595 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd715 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788271838.865988:0:12967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788271838.866010:0:12967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=399s v=(0 0) 00010000:00010000:1.0:1788271838.866015:0:12967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271838.866025:0:12967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9748023/0x99288105fd38f595 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd715 expref: 8 pid: 12967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.866045:0:12967:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9748023/0x99288105fd38f595 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd715 expref: 8 pid: 12967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271838.866059:0:12967:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e92d32600, rc 0) 00000100:00100000:1.0:1788271838.866169:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+8:2397:x1875138577527808:12345-192.168.201.3@tcp:101:bash.0 Request processed in 256us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271838.866176:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 68 00000100:00100000:1.0:1788271838.870513:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271838.870774:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577527936 00000100:00100000:3.0:1788271838.870784:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577527936 00000100:00100000:2.0:1788271838.871048:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 69 00000100:00100000:2.0:1788271838.871060:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8399d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+8:12427:x1875138577527936:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:2.0:1788271838.871078:0:8397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271838.871097:0:8397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e69071fc/0x99288105fd38f59c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd71c expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.871131:0:8397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9748023/0x99288105fd38f595 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd715 expref: 9 pid: 12967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.871139:0:8397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271838.871144:0:8397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271838.871149:0:8397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e69071fc/0x99288105fd38f59c lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd71c expref: 9 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.871183:0:8397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d9748023/0x99288105fd38f595 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd715 expref: 9 pid: 12967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.871215:0:8397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d9748023/0x99288105fd38f595 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd715 expref: 9 pid: 12967 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271838.871231:0:8397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83a3ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8397:1875138590158592:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788271838.871332:0:8397:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d821f8300 going to sleep for 11 seconds 00000100:00100000:3.0:1788271838.875175:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271838.875260:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577528064 00000100:00100000:0.0:1788271838.875271:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577528064 00010000:00010000:0.0:1788271838.875317:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d9748023/0x99288105fd38f595 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd715 expref: 10 pid: 12967 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271838.875358:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 97 00000100:00100000:0.0:1788271838.875375:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+10:2398:x1875138577528064:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271838.875396:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271838.875420:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d9748023/0x99288105fd38f595 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd715 expref: 10 pid: 12967 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271838.875432:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d9748023/0x99288105fd38f595 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd715 expref: 10 pid: 12967 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271838.875467:0:6469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271838.875470:0:6469:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271838.875478:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e69071fc/0x99288105fd38f59c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd71c expref: 10 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271838.875488:0:6469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e69071fc/0x99288105fd38f59c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd71c expref: 10 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271838.875527:0:6469:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e69071fc/0x99288105fd38f59c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd71c expref: 10 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271838.875540:0:6469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83ad1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6469:1875138590158720:192.168.201.3@tcp:105: 00000100:00100000:0.0:1788271838.875613:0:6469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d9b780 going to sleep for 11 seconds 00010000:00010000:2.0:1788271838.875909:0:8397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9748023/0x99288105fd38f595 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd715 expref: 10 pid: 12967 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271838.875925:0:8397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83a3ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8397:1875138590158592:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788271838.875952:0:8397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e69071fc/0x99288105fd38f59c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd71c expref: 9 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271838.875974:0:8397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d833f7a00, rc 0) 00000100:00100000:2.0:1788271838.876015:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8399d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+9:12427:x1875138577527936:12345-192.168.201.3@tcp:101:bash.0 Request processed in 4957us (5513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271838.876023:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 69 00000100:00100000:3.0:1788271838.883050:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271838.883120:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577528320 00000100:00100000:2.0:1788271838.883129:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577528320 00000100:00100000:2.0:1788271838.883181:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 55 00000100:00100000:2.0:1788271838.883189:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+42:12427:x1875138577528320:12345-192.168.201.3@tcp:35:bash.0 00000100:00100000:2.0:1788271838.883500:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+43:12427:x1875138577528320:12345-192.168.201.3@tcp:35:bash.0 Request processed in 310us (457us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1788271838.883508:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 55 00000100:00100000:0.0:1788271838.884340:0:6469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83ad1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6469:1875138590158720:192.168.201.3@tcp:105: 00010000:00010000:0.0:1788271838.884362:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271838.884417:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+8:2398:x1875138577528064:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 9050us (9254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271838.884427:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 97 00000100:00100000:3.0:1788271839.002004:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271839.002146:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577528448 00000100:00100000:1.0:1788271839.002157:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577528448 00000100:00100000:1.0:1788271839.002689:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 216 00000100:00100000:1.0:1788271839.002714:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e84d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+43:12443:x1875138577528448:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:1.0:1788271839.002738:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271839.002757:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38f5a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd723 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.002816:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f5aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.002831:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f5aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.002843:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f5aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271839.002881:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788271839.002884:0:6485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788271839.002903:0:6485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f5aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.002925:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38f5a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd723 expref: 45 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.002943:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f5aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd723 expref: 44 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.002952:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f6d82060100) 00010000:00010000:1.0:1788271839.002954:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788271839.002969:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e92d33e00, rc 0) 00000100:00100000:1.0:1788271839.003077:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e84d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+44:12443:x1875138577528448:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 365us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271839.003092:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 216 00000100:00100000:1.0:1788271839.006142:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271839.006977:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577528704 00000100:00100000:2.0:1788271839.006988:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577528704 00000100:00100000:2.0:1788271839.007077:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 217 00000100:00100000:2.0:1788271839.007088:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8399c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+44:12443:x1875138577528704:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788271839.007110:0:9899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271839.007129:0:9899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7000/0x99288105fd38f5b1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd72a expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.007265:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7800/0x99288105fd38f5b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.007280:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7800/0x99288105fd38f5b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.007292:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7800/0x99288105fd38f5b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271839.007303:0:9899:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788271839.007410:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7000/0x99288105fd38f5b1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd72a expref: 47 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.007430:0:9899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7800/0x99288105fd38f5b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd72a expref: 46 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.007439:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6eb35a5b00) 00010000:00010000:2.0:1788271839.007443:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788271839.007446:0:9899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d833f7800, rc 0) 00000100:00100000:2.0:1788271839.007521:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8399c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+46:12443:x1875138577528704:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 435us (1389us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1788271839.007545:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 217 00000100:00100000:0.0:1788271839.012874:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271839.012912:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271839.012914:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577528960 00000100:00100000:2.0:1788271839.012925:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577528960 00000100:00100000:2.0:1788271839.012994:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 218 00000100:00100000:2.0:1788271839.013005:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+46:12443:x1875138577528960:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788271839.013030:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1788271839.013034:0:9486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577529088 00000100:00100000:1.0:1788271839.013038:0:9486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577529088 00010000:00010000:2.0:1788271839.013052:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7c00/0x99288105fd38f5c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd731 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271839.013118:0:9486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 15 00000100:00100000:1.0:1788271839.013126:0:9486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+48:2396:x1875138577529088:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271839.013135:0:9486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271839.013155:0:9486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7800/0x99288105fd38f5b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd72a expref: 48 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.013158:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6600/0x99288105fd38f5cd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.013171:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6600/0x99288105fd38f5cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.013179:0:9486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6eb35a5b00) 00010000:00010000:2.0:1788271839.013180:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6600/0x99288105fd38f5cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.013184:0:9486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:2.0:1788271839.013192:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788271839.013381:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7c00/0x99288105fd38f5c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd731 expref: 49 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.013396:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6600/0x99288105fd38f5cd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd731 expref: 48 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.013404:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6eb35a5b00) 00010000:00010000:2.0:1788271839.013407:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788271839.013409:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d833f6600, rc 0) 00000100:00100000:2.0:1788271839.013449:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+48:12443:x1875138577528960:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 446us (582us total) trans 4294967488 rc 0/0 00000100:00100000:2.0:1788271839.013456:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 218 00000100:00100000:1.0:1788271839.013482:0:9486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+47:2396:x1875138577529088:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 115us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271839.013490:0:9486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 15 00000100:00100000:3.0:1788271839.022245:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271839.022351:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577529216 00000100:00100000:1.0:1788271839.022360:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577529216 00000100:00100000:1.0:1788271839.022419:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 70 00000100:00100000:1.0:1788271839.022431:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+8:2398:x1875138577529216:12345-192.168.201.3@tcp:1:lfs.0 00010000:00010000:1.0:1788271839.022478:0:8452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003cfd1bbe/0x99288105fd38f5db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.022499:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e69071fc/0x99288105fd38f59c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd71c expref: 8 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.022508:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788271839.022518:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788271839.022523:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003cfd1bbe/0x99288105fd38f5db lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.022557:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e69071fc/0x99288105fd38f59c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd71c expref: 8 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.022572:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e69071fc/0x99288105fd38f59c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd71c expref: 8 pid: 8397 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271839.022587:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8399f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8452:1875138590158848:192.168.201.3@tcp:104: 00000100:00100000:1.0:1788271839.022707:0:8452:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e89061e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788271839.026145:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271839.026236:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577529344 00000100:00100000:2.0:1788271839.026246:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577529344 00002000:00100000:2.0:1788271839.026303:0:8403:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8f6d83b38a80 x1875138577529344/t0(0) o4->ef8df183-a1b1-4e56-bce5-924a894c4a71@192.168.201.3@tcp:745/0 lens 504/0 e 0 to 0 dl 1788271850 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788271839.026314:0:8403:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f6d83b38a80 with x1875138577529344 ext(0->8) 00010000:00010000:2.0:1788271839.026322:0:8403:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e69071fc/0x99288105fd38f59c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd71c expref: 9 pid: 8397 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.026338:0:8403:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e69071fc/0x99288105fd38f59c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd71c expref: 9 pid: 8397 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788271839.026345:0:8403:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8f6d83b38a80 00000100:00100000:2.0:1788271839.026382:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 3 00000100:00100000:2.0:1788271839.026391:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+9:2397:x1875138577529344:12345-192.168.201.3@tcp:4:lfs.0 00000100:00100000:1.0:1788271839.027061:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8399f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8452:1875138590158848:192.168.201.3@tcp:104: 00010000:00010000:1.0:1788271839.027090:0:8452:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003cfd1bbe/0x99288105fd38f5db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271839.027460:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+11:2397:x1875138577529344:12345-192.168.201.3@tcp:4:lfs.0 Request processed in 1069us (1326us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788271839.027713:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 3 00002000:00100000:2.0:1788271839.027725:0:8403:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8f6d83b38a80 x1875138577529344/t4294967309(0) o4->ef8df183-a1b1-4e56-bce5-924a894c4a71@192.168.201.3@tcp:745/0 lens 504/448 e 0 to 0 dl 1788271850 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788271839.027734:0:8403:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f6d83b38a80 with x1875138577529344 ext(0->8) 00010000:00010000:2.0:1788271839.027740:0:8403:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e69071fc/0x99288105fd38f59c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd71c expref: 11 pid: 8397 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.027765:0:8403:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e69071fc/0x99288105fd38f59c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd71c expref: 11 pid: 8397 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788271839.027772:0:8403:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8f6d83b38a80 00000001:00080000:0.0:1788271839.029681:0:8391:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:0.0:1788271839.029700:0:8391:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:2.0:1788271839.031180:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271839.031279:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577529472 00000100:00100000:3.0:1788271839.031290:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577529472 00010000:00010000:3.0:1788271839.031332:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e69071fc/0x99288105fd38f59c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd71c expref: 7 pid: 8397 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271839.031434:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 98 00000100:00100000:3.0:1788271839.031447:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2397:x1875138577529472:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788271839.031462:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788271839.031503:0:6468:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788271839.031506:0:6468:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788271838 00002000:00010000:3.0:1788271839.031508:0:6468:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788271838 00002000:00010000:3.0:1788271839.031511:0:6468:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788271838 00002000:00010000:3.0:1788271839.031513:0:6468:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788271839.031520:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e69071fc/0x99288105fd38f59c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd71c expref: 7 pid: 8397 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271839.031534:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e69071fc/0x99288105fd38f59c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd71c expref: 7 pid: 8397 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271839.031558:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e69071fc/0x99288105fd38f59c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd71c expref: 7 pid: 8397 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271839.031576:0:6468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788271839.031581:0:6468:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788271839.031587:0:6468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003cfd1bbe/0x99288105fd38f5db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271839.031597:0:6468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003cfd1bbe/0x99288105fd38f5db lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271839.031683:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271839.031740:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+6:2397:x1875138577529472:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 295us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271839.031748:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 98 00010000:00010000:2.0:1788271839.031931:0:8452:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003cfd1bbe/0x99288105fd38f5db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.031942:0:8452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003cfd1bbe/0x99288105fd38f5db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.031971:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003cfd1bbe/0x99288105fd38f5db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.031979:0:8452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003cfd1bbe/0x99288105fd38f5db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.031986:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003cfd1bbe/0x99288105fd38f5db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.031993:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e92d32c00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:2.0:1788271839.031997:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003cfd1bbe/0x99288105fd38f5db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.032006:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003cfd1bbe/0x99288105fd38f5db lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.032026:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003cfd1bbe/0x99288105fd38f5db lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.032033:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003cfd1bbe/0x99288105fd38f5db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271839.032084:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2398:x1875138577529216:12345-192.168.201.3@tcp:1:lfs.0 Request processed in 9655us (9848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271839.032092:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 70 00000100:00100000:0.0:1788271839.034825:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271839.034875:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577529728 00000100:00100000:2.0:1788271839.034885:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577529728 00000100:00100000:2.0:1788271839.034943:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 56 00000100:00100000:2.0:1788271839.034953:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb36aec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+47:12443:x1875138577529728:12345-192.168.201.3@tcp:35:lfs.0 00000004:00010000:2.0:1788271839.035026:0:6486:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6600/0x99288105fd38f5cd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd731 expref: 47 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788271839.035227:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1788271839.035438:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:2.0:1788271839.035902:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00010000:00010000:2.0:1788271839.035942:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7e00/0x99288105fd38f5e2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.035969:0:6486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f587 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd70e expref: 51 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.035978:0:6486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7e00/0x99288105fd38f5e2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.036032:0:6486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f587 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd70e expref: 51 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.036048:0:6486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f587 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd70e expref: 51 pid: 6484 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271839.036063:0:6486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83a3df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6486:1875138590158976:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788271839.036145:0:6486:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d821f8480 going to sleep for 11 seconds 00000100:00100000:0.0:1788271839.039810:0:6486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83a3df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6486:1875138590158976:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788271839.039858:0:6486:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7e00/0x99288105fd38f5e2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271839.041309:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271839.041553:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577529856 00000100:00100000:2.0:1788271839.041563:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577529856 00010000:00010000:2.0:1788271839.041605:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f587 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd70e expref: 52 pid: 6484 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271839.041685:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 99 00000100:00100000:2.0:1788271839.041695:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+52:2398:x1875138577529856:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271839.041710:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271839.041718:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f587 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd70e expref: 52 pid: 6484 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.041731:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f587 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd70e expref: 52 pid: 6484 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.041754:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f587 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd70e expref: 52 pid: 6484 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.041772:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6eb35a5b00) 00010000:00010000:2.0:1788271839.041790:0:6469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7e00/0x99288105fd38f5e2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.041800:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7e00/0x99288105fd38f5e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.041809:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7e00/0x99288105fd38f5e2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.041829:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271839.041889:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+51:2398:x1875138577529856:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 195us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271839.041896:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 99 00010000:00010000:0.0:1788271839.042660:0:6486:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7e00/0x99288105fd38f5e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271839.042669:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7e00/0x99288105fd38f5e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788271839.042779:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000001:00080000:0.0:1788271839.042881:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:0.0:1788271839.042976:0:6486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83b38000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6486:1875138590159104:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788271839.043026:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271839.043053:0:6486:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d9bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788271839.043139:0:14136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590159104 00000100:00100000:2.0:1788271839.043145:0:14136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590159104 00000100:00100000:2.0:1788271839.043188:0:14136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788271839.043196:0:14136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6486:x1875138590159104:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788271839.043296:0:14136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6486:x1875138590159104:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 100us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271839.043303:0:14136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788271839.043519:0:6486:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:1.0:1788271839.043524:0:6486:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:1.0:1788271839.043543:0:6486:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f6d83a3ce00, transno 4294967308 00000100:00100000:1.0:1788271839.043562:0:6486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83b38000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6486:1875138590159104:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788271839.043682:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000100:00100000:1.0:1788271839.043720:0:6486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8399f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6486:1875138590159232:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788271839.043748:0:6486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271839.043775:0:6486:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e89061c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788271839.043826:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590159232 00000100:00100000:3.0:1788271839.043841:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590159232 00000100:00100000:3.0:1788271839.043874:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788271839.043880:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8399dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6486:x1875138590159232:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788271839.043989:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8399dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6486:x1875138590159232:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 109us (240us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788271839.043996:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788271839.044519:0:6486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8399f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6486:1875138590159232:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788271839.044567:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:1.0:1788271839.044601:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7e00/0x99288105fd38f5e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.044612:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7e00/0x99288105fd38f5e2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.044649:0:6486:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7e00/0x99288105fd38f5e2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.044657:0:6486:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f7e00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271839.044662:0:6486:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7e00/0x99288105fd38f5e2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.044670:0:6486:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7e00/0x99288105fd38f5e2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.044684:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6eb35a5b00) 00010000:00010000:1.0:1788271839.044688:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788271839.044692:0:6486:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7e00/0x99288105fd38f5e2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.044698:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7e00/0x99288105fd38f5e2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788271839.044795:0:6486:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788271839.044851:0:6486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1788271839.044862:0:6486:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 400134242679ns, next at 401134240502ns, rc = 0 00000001:00080000:1.0:1788271839.044869:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:1.0:1788271839.044890:0:6486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6eb35a5b00) 00010000:00010000:1.0:1788271839.044893:0:6486:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788271839.044905:0:6486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6600/0x99288105fd38f5cd lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd731 expref: 55 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271839.045007:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb36aec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+54:12443:x1875138577529728:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 10055us (10200us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1788271839.045017:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 56 00000020:00080000:1.0:1788271839.045021:0:6486:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788271839.049033:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271839.049133:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577529984 00000100:00100000:1.0:1788271839.049144:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577529984 00000100:00100000:1.0:1788271839.049206:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 219 00000100:00100000:1.0:1788271839.049222:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+54:12443:x1875138577529984:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:1.0:1788271839.049252:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271839.049273:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f5e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd738 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.049329:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f5e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd738 expref: 55 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.049343:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f5e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd738 expref: 55 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.049361:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6d82060700) 00010000:00010000:1.0:1788271839.049364:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788271839.049368:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e92d32600, rc 0) 00000100:00100000:1.0:1788271839.049431:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+55:12443:x1875138577529984:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 209us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271839.049437:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 219 00000100:00100000:3.0:1788271839.052364:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271839.052453:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577530240 00000100:00100000:0.0:1788271839.052461:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577530240 00000100:00100000:0.0:1788271839.052519:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 57 00000100:00100000:0.0:1788271839.052530:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+55:12443:x1875138577530240:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:0.0:1788271839.052796:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+56:12443:x1875138577530240:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 268us (440us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1788271839.052805:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 57 00000100:00100000:0.0:1788271839.152867:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271839.152981:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577530368 00000100:00100000:2.0:1788271839.152992:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577530368 00000100:00100000:2.0:1788271839.153056:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 220 00000100:00100000:2.0:1788271839.153066:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+56:12453:x1875138577530368:12345-192.168.201.3@tcp:34:lfs.0 00010000:00010000:2.0:1788271839.153150:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f5f0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.153168:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f5f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.153198:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f5f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.153222:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f5f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.153230:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.153237:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.153324:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6e00/0x99288105fd38f5fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.153333:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6e00/0x99288105fd38f5fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.153340:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6e00/0x99288105fd38f5fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788271839.153387:0:9899:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6e00/0x99288105fd38f5fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.153400:0:9899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f5f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.153406:0:9899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f5f0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.153412:0:9899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f5f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.153427:0:9899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f6000 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271839.153432:0:9899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f5f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.153440:0:9899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f5f0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.153452:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f6d82060100) 00010000:00010000:2.0:1788271839.153455:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271839.153459:0:9899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f5f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.153465:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f5f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.153493:0:9899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.153499:0:9899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f5f7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.153506:0:9899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f5f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.153511:0:9899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f6a00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271839.153513:0:9899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f5f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.153519:0:9899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f5f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.153537:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f6d82060e00) 00010000:00010000:2.0:1788271839.153539:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271839.153542:0:9899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f5f7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.153548:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f5f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.153558:0:9899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6e00/0x99288105fd38f5fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.153563:0:9899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6e00/0x99288105fd38f5fe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.153568:0:9899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6e00/0x99288105fd38f5fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.153573:0:9899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f6e00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271839.153576:0:9899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6e00/0x99288105fd38f5fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.153581:0:9899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6e00/0x99288105fd38f5fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.153587:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6d82060700) 00010000:00010000:2.0:1788271839.153589:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271839.153591:0:9899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6e00/0x99288105fd38f5fe lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.153596:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6e00/0x99288105fd38f5fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271839.153779:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+56:12453:x1875138577530368:12345-192.168.201.3@tcp:34:lfs.0 Request processed in 713us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271839.153788:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 220 00000100:00100000:3.0:1788271839.183429:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271839.183495:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577530624 00000100:00100000:2.0:1788271839.183506:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577530624 00000100:00100000:2.0:1788271839.183616:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 221 00000100:00100000:2.0:1788271839.183652:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+56:12456:x1875138577530624:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788271839.183674:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271839.183697:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6e00/0x99288105fd38f605 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd73f expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.183769:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f60c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.183784:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f60c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.183806:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f60c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.183818:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f613 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.183826:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f613 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.183832:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f613 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.183945:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7600/0x99288105fd38f61a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.183951:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7600/0x99288105fd38f61a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.183976:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7600/0x99288105fd38f61a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271839.183984:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788271839.184054:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f60c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.184060:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f60c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.184064:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f60c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.184068:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f6a00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271839.184071:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f60c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.184075:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f60c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.184084:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f6d82060100) 00010000:00010000:2.0:1788271839.184086:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271839.184089:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f60c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.184101:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f60c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.184112:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f613 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.184115:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f613 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.184119:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f613 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.184122:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f6000 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271839.184123:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f613 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.184126:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f613 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.184130:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f6d82060e00) 00010000:00010000:2.0:1788271839.184132:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271839.184133:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f613 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.184136:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f613 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.184166:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6e00/0x99288105fd38f605 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd73f expref: 59 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.184179:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7600/0x99288105fd38f61a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd73f expref: 58 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.184192:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6d82060700) 00010000:00010000:2.0:1788271839.184194:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788271839.184197:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d833f7600, rc 0) 00000100:00100000:2.0:1788271839.184274:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+58:12456:x1875138577530624:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 623us (854us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1788271839.184281:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 221 00000100:00100000:1.0:1788271839.186917:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271839.186982:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577530752 00000100:00100000:2.0:1788271839.186991:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577530752 00000100:00100000:2.0:1788271839.187049:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 222 00000100:00100000:2.0:1788271839.187060:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8399d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+58:12456:x1875138577530752:12345-192.168.201.3@tcp:54:lfs.0 00010000:00010000:2.0:1788271839.187117:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f628 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.187129:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f628 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.187306:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f628 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.187353:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f628 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.187361:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f628 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.187369:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f628 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.187375:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f6800 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271839.187386:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f628 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.187393:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f628 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.187405:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6d82060700) 00010000:00010000:2.0:1788271839.187408:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788271839.187413:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f628 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.187419:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f628 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271839.187526:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8399d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+58:12456:x1875138577530752:12345-192.168.201.3@tcp:54:lfs.0 Request processed in 467us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271839.187534:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 222 00000100:00100000:0.0:1788271839.189975:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271839.190066:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577531008 00000100:00100000:3.0:1788271839.190074:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577531008 00000100:00100000:3.0:1788271839.190124:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 58 00000100:00100000:3.0:1788271839.190134:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+58:12456:x1875138577531008:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:3.0:1788271839.190414:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+59:12456:x1875138577531008:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 280us (455us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1788271839.190422:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 58 00000100:00100000:3.0:1788271839.277586:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271839.277770:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577531264 00000100:00100000:1.0:1788271839.277781:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577531264 00000100:00100000:1.0:1788271839.277844:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 223 00000100:00100000:1.0:1788271839.277856:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+59:12466:x1875138577531264:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:1.0:1788271839.277887:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271839.277891:0:6483:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788271839.277917:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f5aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd723 expref: 59 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.277935:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f6d82060100) 00010000:00010000:1.0:1788271839.277940:0:6483:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788271839.277953:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38f62f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd746 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.278066:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f636 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.278081:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7600/0x99288105fd38f61a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd73f expref: 59 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.278090:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f636 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.278124:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7600/0x99288105fd38f61a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd73f expref: 59 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.278137:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7600/0x99288105fd38f61a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd73f expref: 59 pid: 6484 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271839.278180:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83ad0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6483:1875138590159360:192.168.201.3@tcp:104: 00000100:00100000:1.0:1788271839.278572:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e89061540 going to sleep for 11 seconds 00000100:00100000:3.0:1788271839.286899:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83ad0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6483:1875138590159360:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788271839.286927:0:6483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f636 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271839.291357:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271839.291523:0:9486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577531392 00000100:00100000:1.0:1788271839.291534:0:9486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577531392 00010000:00010000:1.0:1788271839.291582:0:9486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7600/0x99288105fd38f61a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd73f expref: 60 pid: 6484 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271839.292373:0:9486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 100 00000100:00100000:1.0:1788271839.292388:0:9486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+60:2398:x1875138577531392:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271839.292404:0:9486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271839.292412:0:9486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7600/0x99288105fd38f61a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd73f expref: 60 pid: 6484 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.292428:0:9486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7600/0x99288105fd38f61a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd73f expref: 60 pid: 6484 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.292449:0:9486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7600/0x99288105fd38f61a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd73f expref: 60 pid: 6484 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.292468:0:9486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6d82060700) 00010000:00010000:1.0:1788271839.292473:0:9486:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f636 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.292483:0:9486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f636 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.292509:0:9486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f636 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.292542:0:9486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788271839.292685:0:6483:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f636 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271839.292695:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f636 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271839.292717:0:6483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788271839.292865:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38f62f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd746 expref: 61 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271839.292883:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f636 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd746 expref: 60 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271839.292891:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6d82060700) 00010000:00010000:3.0:1788271839.292894:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788271839.292896:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e92d33a00, rc 0) 00000100:00100000:1.0:1788271839.295108:0:9486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+60:2398:x1875138577531392:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 2713us (3751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271839.295122:0:9486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 100 00000100:00100000:3.0:1788271839.296252:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+59:12466:x1875138577531264:12345-192.168.201.3@tcp:101:bash.0 Request processed in 18383us (18661us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1788271839.296262:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 223 00000100:00100000:1.0:1788271839.305108:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271839.305286:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577531520 00000100:00100000:2.0:1788271839.305297:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577531520 00000100:00100000:2.0:1788271839.305397:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 224 00000100:00100000:2.0:1788271839.305408:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+59:12466:x1875138577531520:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:2.0:1788271839.305434:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271839.305458:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6e00/0x99288105fd38f644 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd74d expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.305507:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f64b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.305522:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f64b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.305551:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f64b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.305710:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6e00/0x99288105fd38f644 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd74d expref: 61 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.305731:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f64b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd74d expref: 60 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.305741:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6d82060700) 00010000:00010000:2.0:1788271839.305744:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788271839.305748:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d833f6000, rc 0) 00000100:00100000:2.0:1788271839.305823:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+60:12466:x1875138577531520:12345-192.168.201.3@tcp:101:bash.0 Request processed in 416us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271839.305831:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 224 00000100:00100000:2.0:1788271839.313134:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271839.313341:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577531776 00000100:00100000:1.0:1788271839.313351:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577531776 00000100:00100000:1.0:1788271839.313410:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 225 00000100:00100000:1.0:1788271839.313418:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+60:12466:x1875138577531776:12345-192.168.201.3@tcp:36:bash.0 00010000:00010000:1.0:1788271839.313779:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f652 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.313797:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f652 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.313809:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f652 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788271839.313851:0:12164:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967502 00000004:00010000:1.0:1788271839.313875:0:12164:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000073cb53ee reply state 00000000e26fa17f transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f652 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.313887:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f652 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.313895:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6d82060700) 00010000:00010000:1.0:1788271839.313910:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788271839.313914:0:12164:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788271839.314097:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83a3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+63:12466:x1875138577531776:12345-192.168.201.3@tcp:36:bash.0 Request processed in 678us (972us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1788271839.314105:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 225 00000020:00080000:1.0:1788271839.314109:0:12164:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788271839.318773:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271839.318865:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577531904 00000100:00100000:1.0:1788271839.318876:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577531904 00000100:00100000:1.0:1788271839.318938:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 226 00000100:00100000:1.0:1788271839.318949:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+63:12466:x1875138577531904:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:1.0:1788271839.318983:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271839.319005:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38f659 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd754 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.319096:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f660 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.319112:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f636 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd746 expref: 64 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.319121:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f660 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.319170:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f636 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd746 expref: 64 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.319185:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f636 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd746 expref: 64 pid: 6483 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271839.319198:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83aaaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6483:1875138590159488:192.168.201.3@tcp:104: 00000100:00100000:1.0:1788271839.319369:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e89061540 going to sleep for 11 seconds 00000100:00100000:3.0:1788271839.331461:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83aaaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6483:1875138590159488:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788271839.331496:0:6483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f660 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271839.334735:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271839.340675:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577532032 00000100:00100000:1.0:1788271839.340697:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577532032 00010000:00010000:0.0:1788271839.341295:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f636 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd746 expref: 65 pid: 6483 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271839.341373:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 101 00000100:00100000:0.0:1788271839.341384:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+65:2398:x1875138577532032:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271839.341400:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271839.341407:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f636 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd746 expref: 65 pid: 6483 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271839.341421:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f636 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd746 expref: 65 pid: 6483 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271839.341444:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33a00/0x99288105fd38f636 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd746 expref: 65 pid: 6483 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271839.341462:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6d82060700) 00010000:00010000:0.0:1788271839.341728:0:6468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f660 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271839.341740:0:6468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f660 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271839.341748:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f660 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271839.341781:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271839.341849:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+64:2398:x1875138577532032:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 467us (7124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271839.341858:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 101 00010000:00010000:3.0:1788271839.342045:0:6483:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f660 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271839.342055:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f660 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271839.343031:0:6483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788271839.343037:0:6483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788271839.343059:0:6483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f660 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271839.343092:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32c00/0x99288105fd38f659 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd754 expref: 64 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271839.343123:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f660 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd754 expref: 63 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271839.343131:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6d82060700) 00010000:00010000:3.0:1788271839.343134:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788271839.343219:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4ed4a00, rc 0) 00000100:00100000:3.0:1788271839.343276:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+63:12466:x1875138577531904:12345-192.168.201.3@tcp:101:bash.0 Request processed in 24328us (24512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271839.343284:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 226 00000100:00100000:2.0:1788271839.347596:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271839.347671:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577532288 00000100:00100000:1.0:1788271839.347682:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577532288 00000100:00100000:1.0:1788271839.347741:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 59 00000100:00100000:1.0:1788271839.347753:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+63:12466:x1875138577532288:12345-192.168.201.3@tcp:35:bash.0 00000100:00100000:1.0:1788271839.347985:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83a3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+64:12466:x1875138577532288:12345-192.168.201.3@tcp:35:bash.0 Request processed in 233us (398us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1788271839.347994:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 59 00000100:00100000:0.0:1788271839.424537:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271839.424661:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577532416 00000100:00100000:2.0:1788271839.424673:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577532416 00000100:00100000:2.0:1788271839.424742:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 227 00000100:00100000:2.0:1788271839.424755:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+64:12472:x1875138577532416:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788271839.424780:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271839.424803:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6e00/0x99288105fd38f667 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd75b expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.424868:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f66e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.424894:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f66e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.424906:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f66e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271839.424964:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788271839.424969:0:6484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788271839.424989:0:6484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f66e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.425018:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6e00/0x99288105fd38f667 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd75b expref: 66 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.425039:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f66e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd75b expref: 65 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.425049:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f6d82060100) 00010000:00010000:2.0:1788271839.425052:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788271839.425056:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d833f6a00, rc 0) 00000100:00100000:2.0:1788271839.425123:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+65:12472:x1875138577532416:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 371us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271839.425131:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 227 00000100:00100000:0.0:1788271839.429200:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271839.429455:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577532544 00000100:00100000:1.0:1788271839.429545:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577532544 00000100:00100000:1.0:1788271839.429713:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 228 00000100:00100000:1.0:1788271839.429728:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+65:12472:x1875138577532544:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:1.0:1788271839.429760:0:12164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271839.429791:0:12164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f675 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd762 expref: -99 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.430058:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38f67c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.430077:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38f67c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.430091:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38f67c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.430103:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f683 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.430131:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f683 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.430138:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f683 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.430231:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f68a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.430302:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f68a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.430310:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f68a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271839.430363:0:12164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788271839.430368:0:12164:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788271839.430391:0:12164:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f68a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.430404:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f68a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.430413:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38f67c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.430419:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38f67c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.430427:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38f67c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.430442:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4ed5e00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271839.430447:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38f67c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.430455:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38f67c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.430616:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f6d82060100) 00010000:00010000:1.0:1788271839.430644:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271839.430651:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38f67c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.430658:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38f67c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.430674:0:12164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f683 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.430680:0:12164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f683 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.430686:0:12164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f683 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.430691:0:12164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e21000 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271839.430694:0:12164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f683 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.430699:0:12164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f683 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.430716:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f6d82060e00) 00010000:00010000:1.0:1788271839.430719:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271839.430722:0:12164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f683 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.430728:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f683 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.430763:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f675 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd762 expref: 67 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.430780:0:12164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f68a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd762 expref: 66 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.430788:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6d82060700) 00010000:00010000:1.0:1788271839.430791:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788271839.430793:0:12164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e20200, rc 0) 00000100:00100000:1.0:1788271839.431053:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+66:12472:x1875138577532544:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 1327us (1866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271839.431062:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 228 00000100:00100000:0.0:1788271839.435374:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271839.435474:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271839.435686:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577532800 00000100:00100000:3.0:1788271839.435699:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577532800 00000100:00100000:3.0:1788271839.435784:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 229 00000100:00100000:3.0:1788271839.435797:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+66:12472:x1875138577532800:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:3.0:1788271839.435829:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271839.435856:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f691 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd769 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271839.436448:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f698 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271839.436532:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f660 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd754 expref: 67 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271839.436542:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f68a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd762 expref: 67 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271839.436576:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f698 lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271839.436650:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f68a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd762 expref: 67 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271839.436667:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f68a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd762 expref: 67 pid: 12164 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271839.436684:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6483:1875138590159616:192.168.201.3@tcp:104: 00000100:00100000:1.0:1788271839.436802:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577532928 00000100:00100000:1.0:1788271839.436809:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577532928 00010000:00010000:1.0:1788271839.436845:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f68a lrc: 6/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd762 expref: 68 pid: 12164 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271839.437101:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 102 00000100:00100000:1.0:1788271839.437116:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3598050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+68:2395:x1875138577532928:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271839.437139:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271839.437147:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f68a lrc: 6/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd762 expref: 68 pid: 12164 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.437162:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f68a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd762 expref: 68 pid: 12164 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.437185:0:6470:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6d82060700) 00010000:00010000:1.0:1788271839.437190:0:6470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f698 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.437197:0:6470:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f698 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.437325:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271839.437376:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3598050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+68:2395:x1875138577532928:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 263us (1907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271839.437385:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 102 00010000:00010000:2.0:1788271839.437461:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f660 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd754 expref: 67 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.437485:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f660 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd754 expref: 67 pid: 6483 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271839.437521:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83a3ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6483:1875138590159744:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788271839.437577:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e83021a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788271839.448681:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00010000:00010000:2.0:1788271839.448769:0:6483:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.3@tcp) returned -22 from blocking AST (req@00000000ed62ee76 x1875138590159616) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f68a lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd762 expref: 67 pid: 12164 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.448788:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f68a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd762 expref: 67 pid: 12164 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271839.448801:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6483:1875138590159616:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788271839.448812:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83a3ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6483:1875138590159744:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788271839.448832:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6d82060700) 00010000:00010000:2.0:1788271839.448837:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f698 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.448844:0:6483:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f698 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.448851:0:6483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f698 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271839.450597:0:9486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577533056 00000100:00100000:1.0:1788271839.450660:0:9486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577533056 00010000:00010000:1.0:1788271839.450728:0:9486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f660 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd754 expref: 67 pid: 6483 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271839.450782:0:9486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 103 00000100:00100000:1.0:1788271839.450793:0:9486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+67:2398:x1875138577533056:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271839.450813:0:9486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271839.450827:0:9486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f660 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd754 expref: 67 pid: 6483 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.450876:0:9486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f660 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd754 expref: 67 pid: 6483 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.451445:0:9486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f660 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd754 expref: 67 pid: 6483 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.451996:0:9486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6d82060700) 00010000:00010000:1.0:1788271839.452004:0:9486:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f698 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.452018:0:9486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f698 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.452028:0:9486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f698 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.452075:0:9486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788271839.452111:0:6483:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f698 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.452132:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f698 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271839.452186:0:6483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000100:00100000:1.0:1788271839.452261:0:9486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+67:2398:x1875138577533056:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 1465us (3582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271839.452273:0:9486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 103 00010000:00010000:2.0:1788271839.452325:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38f691 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd769 expref: 67 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.452343:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f698 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd769 expref: 66 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.452350:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6d82060700) 00010000:00010000:2.0:1788271839.452352:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788271839.452354:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c4000, rc 0) 00000100:00100000:2.0:1788271839.452419:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+66:12472:x1875138577532800:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 16625us (17060us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1788271839.452425:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 229 00000100:00100000:1.0:1788271839.477353:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271839.477449:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577533312 00000100:00100000:3.0:1788271839.477459:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577533312 00000100:00100000:3.0:1788271839.477560:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 16 00000100:00100000:3.0:1788271839.477581:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+66:12472:x1875138577533312:12345-192.168.201.3@tcp:103:lfs.0 00010000:00010000:3.0:1788271839.477596:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271839.477744:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d32600/0x99288105fd38f5e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd738 expref: 66 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271839.477764:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6d82060700) 00010000:00010000:3.0:1788271839.477769:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271839.477882:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+65:12472:x1875138577533312:12345-192.168.201.3@tcp:103:lfs.0 Request processed in 302us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271839.477891:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 16 00000100:00100000:0.0:1788271839.484549:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271839.484667:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577533440 00000100:00100000:3.0:1788271839.484677:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577533440 00000100:00100000:3.0:1788271839.484731:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 230 00000100:00100000:3.0:1788271839.484740:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+65:12472:x1875138577533440:12345-192.168.201.3@tcp:58:lfs.0 00010000:00010000:3.0:1788271839.484844:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f6a6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271839.484874:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f6a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271839.484885:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f6a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788271839.484994:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1788271839.485227:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+65:12472:x1875138577533440:12345-192.168.201.3@tcp:58:lfs.0 Request processed in 486us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271839.485235:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 230 00000100:00100000:3.0:1788271839.487105:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271839.489329:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577533568 00000100:00100000:1.0:1788271839.489344:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577533568 00000100:00100000:1.0:1788271839.489469:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 231 00000100:00100000:1.0:1788271839.489480:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+65:12472:x1875138577533568:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:1.0:1788271839.489500:0:12164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271839.489520:0:12164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f6ad lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd770 expref: -99 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.489602:0:12164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f6a6 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.489614:0:12164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f6ad lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd770 expref: 66 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.489656:0:12164:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f6a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.489670:0:12164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f6ad lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd770 expref: 66 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.489683:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6d82060700) 00010000:00010000:1.0:1788271839.489686:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788271839.489690:0:12164:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f6ad lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd770 expref: 66 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.489699:0:12164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e20a00, rc 0) 00000100:00100000:1.0:1788271839.489765:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+66:12472:x1875138577533568:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 288us (2666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271839.489772:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 231 00010000:00010000:3.0:1788271839.646148:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271839.777314:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788271839.777342:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590159872:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788271839.777420:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271839.777574:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590159872 00000100:00100000:3.0:1788271839.777582:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590159872 00000100:00100000:3.0:1788271839.777658:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788271839.777668:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590159872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788271839.777705:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788271839.777764:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590159872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271839.777772:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788271839.778246:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590159872:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788271839.843170:0:13762:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788271839.843181:0:13762:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788271839.843209:0:13762:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1788271839.843218:0:13762:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788271839.843352:0:13762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83b39500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13762:1875138590160000:192.168.201.3@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788271839.843490:0:13762:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d9b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271839.846181:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271839.846775:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577533696 00000100:00100000:1.0:1788271839.846793:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577533696 00000100:00100000:1.0:1788271839.846872:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 232 00000100:00100000:1.0:1788271839.846896:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+67:12473:x1875138577533696:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788271839.846935:0:6483:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788271839.847091:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+67:12473:x1875138577533696:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 Request processed in 207us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271839.847100:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 232 00000100:00100000:0.0:1788271839.849293:0:13762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83b39500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13762:1875138590160000:192.168.201.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788271839.854927:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271839.860486:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577533824 00000100:00100000:1.0:1788271839.860508:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577533824 00000100:00100000:1.0:1788271839.860721:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 233 00000100:00100000:1.0:1788271839.860736:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+66:12473:x1875138577533824:12345-192.168.201.3@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788271839.860837:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f6b4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.860858:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f6b4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.860873:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f6b4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.860890:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f6bb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.860897:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f6bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.860903:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f6bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.860930:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f6c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.860940:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f6c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.860961:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f6c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271839.861040:0:6485:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788271839.861045:0:6485:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788271839.861062:0:6485:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f6c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.861075:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f6b4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.861083:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f6b4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.861090:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f6b4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.861097:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e21e00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271839.861103:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f6b4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.861111:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f6b4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.861138:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f6e90141900) 00010000:00010000:1.0:1788271839.861141:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271839.861148:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f6b4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.861155:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38f6b4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.861179:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f6bb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.862439:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f6bb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.862449:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f6bb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.862455:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e21000 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271839.862460:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f6bb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.862468:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f6bb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.862483:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff8f6d82060b00) 00010000:00010000:1.0:1788271839.862486:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271839.862490:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f6bb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.862497:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38f6bb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.862525:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f6c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.862531:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f6c2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.862537:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f6c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.862541:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e20200 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271839.862560:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f6c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.862567:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f6c2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.862575:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6d82060700) 00010000:00010000:1.0:1788271839.862578:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271839.862580:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f6c2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.862586:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f6c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271839.862725:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+66:12473:x1875138577533824:12345-192.168.201.3@tcp:34:lhsmtool_posix.0 Request processed in 1987us (7808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271839.862735:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 233 00000100:00100000:2.0:1788271839.866998:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271839.879568:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577534080 00000100:00100000:0.0:1788271839.879592:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577534080 00000100:00100000:1.0:1788271839.882682:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 234 00000100:00100000:1.0:1788271839.882702:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+66:12473:x1875138577534080:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788271839.882736:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271839.882769:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f6c9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd777 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.882925:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f6d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.882959:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f6d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.882974:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f6d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788271839.883010:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788271839.883135:0:6484:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f6d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.883143:0:6484:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f6d0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.883150:0:6484:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f6d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.883157:0:6484:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4ed4c00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271839.883173:0:6484:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f6d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.883184:0:6484:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f6d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.888247:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6d82060700) 00010000:00010000:1.0:1788271839.888269:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788271839.888286:0:6484:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f6d0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.888303:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f6d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.888443:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f6c9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd777 expref: 68 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.888463:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f6e90141900) 00010000:00010000:1.0:1788271839.888466:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788271839.888508:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f6c9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd777 expref: 68 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.888520:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4ed4a00, rc 0) 00000100:00100000:1.0:1788271839.888764:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+67:12473:x1875138577534080:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 6063us (21777us total) trans 4294967506 rc 301/301 00000100:00100000:1.0:1788271839.888778:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 234 00000100:00100000:2.0:1788271839.901096:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271839.901392:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577534208 00000100:00100000:1.0:1788271839.901406:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577534208 00000100:00100000:1.0:1788271839.901485:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 235 00000100:00100000:1.0:1788271839.901498:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+67:12473:x1875138577534208:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788271839.901547:0:6483:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788271839.901732:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+67:12473:x1875138577534208:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 Request processed in 236us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271839.901741:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 235 00000100:00100000:3.0:1788271839.906426:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271839.906522:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577534464 00000100:00100000:1.0:1788271839.906536:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577534464 00000100:00100000:1.0:1788271839.906720:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 236 00000100:00100000:1.0:1788271839.906735:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+67:12473:x1875138577534464:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788271839.906768:0:12164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271839.906772:0:12164:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788271839.906810:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6a00/0x99288105fd38f66e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd75b expref: 67 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.906838:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f6d82060100) 00010000:00010000:1.0:1788271839.906845:0:12164:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788271839.906862:0:12164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f6de lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd77e expref: -99 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788271839.907443:0:12164:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:1.0:1788271839.907676:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f6e5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.907694:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.907706:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.907769:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4a00/0x99288105fd38f6de lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd77e expref: 69 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.907787:0:12164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f6e5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd77e expref: 68 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.907796:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f6d82060b00) 00010000:00010000:1.0:1788271839.907799:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788271839.907802:0:12164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4ed4c00, rc 0) 00000100:00100000:1.0:1788271839.907881:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+68:12473:x1875138577534464:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 1149us (1469us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1788271839.907891:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 236 00000100:00100000:2.0:1788271839.917548:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271839.923696:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577534720 00000100:00100000:1.0:1788271839.923722:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577534720 00000100:00100000:1.0:1788271839.923903:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 237 00000100:00100000:1.0:1788271839.923918:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+68:12473:x1875138577534720:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788271839.924038:0:9899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271839.924086:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f6e5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd77e expref: 68 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.924111:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f6d82060b00) 00010000:00010000:1.0:1788271839.924138:0:9899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788271839.925724:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38f6f3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.925752:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38f6f3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.925768:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38f6f3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.925983:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f6fa lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xbba9528d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.926008:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f6fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xbba9528d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.926021:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f6fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xbba9528d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.926123:0:9899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38f6f3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.926132:0:9899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38f6f3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.926139:0:9899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38f6f3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.926145:0:9899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4ed5e00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271839.926164:0:9899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38f6f3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.926173:0:9899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38f6f3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.926187:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f6d82060100) 00010000:00010000:1.0:1788271839.926190:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271839.926195:0:9899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38f6f3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.926202:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5e00/0x99288105fd38f6f3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.926224:0:9899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f6fa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xbba9528d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.926230:0:9899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f6fa lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xbba9528d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.926236:0:9899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f6fa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xbba9528d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.926241:0:9899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e20200 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271839.926244:0:9899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f6fa lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xbba9528d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.926250:0:9899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f6fa lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xbba9528d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.926257:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xbba9528d (ffff8f6d82060500) 00010000:00010000:1.0:1788271839.926259:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271839.926282:0:9899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f6fa lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xbba9528d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.926288:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f6fa lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xbba9528d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271839.926405:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+67:12473:x1875138577534720:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 Request processed in 2486us (8870us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788271839.926415:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 237 00000100:00100000:0.0:1788271839.935131:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271839.935255:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577534848 00000100:00100000:3.0:1788271839.935269:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577534848 00000100:00100000:3.0:1788271839.935344:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 238 00000100:00100000:3.0:1788271839.935355:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e9ab04850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+67:12473:x1875138577534848:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788271839.935384:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271839.935437:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38f701 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd785 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271839.935486:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38f708 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271839.935503:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38f708 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271839.935515:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38f708 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271839.935690:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38f701 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd785 expref: 69 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271839.935712:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38f708 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd785 expref: 68 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271839.935722:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f6e920a2700) 00010000:00010000:3.0:1788271839.935726:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788271839.935729:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c5a00, rc 0) 00000100:00100000:3.0:1788271839.935806:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e9ab04850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+68:12473:x1875138577534848:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 452us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271839.935813:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 238 00000100:00100000:0.0:1788271839.941728:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271839.942816:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577535104 00000100:00100000:2.0:1788271839.942829:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577535104 00000100:00100000:2.0:1788271839.942904:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 239 00000100:00100000:2.0:1788271839.942916:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+68:12473:x1875138577535104:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788271839.943024:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f70f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.943060:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f70f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.943072:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f70f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788271839.943232:0:12164:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:2.0:1788271839.943241:0:12164:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 401032620448ns, next at 402032618393ns, rc = 0 00000004:00010000:2.0:1788271839.943282:0:12164:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b4f6e09d reply state 000000007f7ffcbf transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f70f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.943295:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f70f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.943302:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f6e920a2700) 00010000:00010000:2.0:1788271839.943305:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788271839.943308:0:12164:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788271839.943609:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+70:12473:x1875138577535104:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 Request processed in 694us (1893us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1788271839.943617:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 239 00000100:00100000:0.0:1788271839.963035:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271839.966259:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577535232 00000100:00100000:1.0:1788271839.966279:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577535232 00000100:00100000:1.0:1788271839.966357:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 240 00000100:00100000:1.0:1788271839.966366:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+70:12473:x1875138577535232:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788271839.966388:0:9899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271839.966405:0:9899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f716 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd78c expref: -99 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.966456:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f716 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd78c expref: 71 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.966466:0:9899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f716 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd78c expref: 71 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271839.966481:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f6e920a2700) 00010000:00010000:1.0:1788271839.966483:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788271839.966486:0:9899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e20200, rc 0) 00000100:00100000:1.0:1788271839.966542:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+71:12473:x1875138577535232:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 178us (3525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271839.966548:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 240 00000100:00100000:2.0:1788271839.969467:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271839.969552:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577535360 00000100:00100000:1.0:1788271839.969560:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577535360 00000100:00100000:1.0:1788271839.969607:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 71 00000100:00100000:1.0:1788271839.969615:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+9:2397:x1875138577535360:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788271839.969837:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+10:2397:x1875138577535360:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 Request processed in 223us (378us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1788271839.969843:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 71 00000100:00100000:3.0:1788271839.976674:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271839.976934:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577535616 00000100:00100000:0.0:1788271839.976974:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577535616 00000100:00100000:0.0:1788271839.977065:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 60 00000100:00100000:0.0:1788271839.977082:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+71:12473:x1875138577535616:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788271839.978335:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+72:12473:x1875138577535616:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 Request processed in 1251us (1722us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1788271839.978348:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 60 00000100:00100000:0.0:1788271839.983516:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271839.988408:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577535872 00000100:00100000:3.0:1788271839.988432:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577535872 00000100:00100000:3.0:1788271839.988533:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 241 00000100:00100000:3.0:1788271839.988546:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+72:12473:x1875138577535872:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788271839.988924:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+72:12473:x1875138577535872:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 Request processed in 378us (5421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271839.988933:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 241 00000100:00100000:0.0:1788271839.993045:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271839.993974:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577536000 00000100:00100000:2.0:1788271839.993991:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577536000 00000100:00100000:2.0:1788271839.994092:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 242 00000100:00100000:2.0:1788271839.994105:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+72:12473:x1875138577536000:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788271839.994149:0:12164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271839.994182:0:12164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6600/0x99288105fd38f71d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd793 expref: -99 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.994283:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7e00/0x99288105fd38f724 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.994304:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7e00/0x99288105fd38f724 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.994319:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7e00/0x99288105fd38f724 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271839.994382:0:12164:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788271839.994408:0:12164:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7e00/0x99288105fd38f724 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.994440:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6600/0x99288105fd38f71d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd793 expref: 74 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.994464:0:12164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7e00/0x99288105fd38f724 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd793 expref: 73 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271839.994474:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f6e920a2700) 00010000:00010000:2.0:1788271839.994477:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788271839.994481:0:12164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d833f7e00, rc 0) 00000100:00100000:2.0:1788271839.994565:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+73:12473:x1875138577536000:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 463us (1536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271839.994574:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 242 00000100:00100000:0.0:1788271840.000673:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271840.001002:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577536128 00000100:00100000:2.0:1788271840.001016:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577536128 00000100:00100000:2.0:1788271840.001110:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 72 00000100:00100000:2.0:1788271840.001125:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+10:2398:x1875138577536128:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788271840.001148:0:8397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271840.001175:0:8397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e69071fc/0x99288105fd38f72b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd79a expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788271840.001209:0:8397:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96dcdf, blocks: 0x0 00010000:00010000:2.0:1788271840.001235:0:8397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=401s v=(0 0) 00010000:00010000:2.0:1788271840.001241:0:8397:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271840.001253:0:8397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e69071fc/0x99288105fd38f72b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd79a expref: 11 pid: 8397 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271840.001279:0:8397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e69071fc/0x99288105fd38f72b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd79a expref: 11 pid: 8397 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271840.001296:0:8397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d833f7a00, rc 0) 00000100:00100000:2.0:1788271840.001389:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+11:2398:x1875138577536128:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 268us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271840.001397:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 72 00000100:00080000:1.0:1788271840.001954:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788271840.011183:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271840.011341:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577536384 00000100:00100000:2.0:1788271840.011354:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577536384 00000100:00100000:2.0:1788271840.011458:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 243 00000100:00100000:2.0:1788271840.011473:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+73:12473:x1875138577536384:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788271840.011656:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+73:12473:x1875138577536384:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 Request processed in 152us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271840.011684:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 243 00000100:00080000:1.0:1788271840.011774:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788271840.014211:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271840.014373:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577536512 00000100:00100000:2.0:1788271840.014387:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577536512 00000100:00100000:2.0:1788271840.014461:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 73 00000100:00100000:2.0:1788271840.014475:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+11:12473:x1875138577536512:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788271840.014500:0:8452:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271840.014525:0:8452:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067473f03/0x99288105fd38f732 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd7a1 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271840.014566:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e69071fc/0x99288105fd38f72b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd79a expref: 12 pid: 8397 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271840.014576:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271840.014580:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271840.014586:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067473f03/0x99288105fd38f732 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd7a1 expref: 12 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271840.014675:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e69071fc/0x99288105fd38f72b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd79a expref: 12 pid: 8397 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271840.014691:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e69071fc/0x99288105fd38f72b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd79a expref: 12 pid: 8397 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271840.014709:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8452:1875138590160128:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788271840.014839:0:8452:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d821f8900 going to sleep for 11 seconds 00000100:00100000:2.0:1788271840.017514:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8452:1875138590160128:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788271840.017565:0:8452:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000067473f03/0x99288105fd38f732 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd7a1 expref: 12 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271840.017593:0:8452:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d833f6600, rc 0) 00000100:00100000:2.0:1788271840.017755:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+12:12473:x1875138577536512:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 3281us (3568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271840.017765:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 73 00000100:00100000:0.0:1788271840.028657:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271840.029224:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577536640 00000100:00100000:1.0:1788271840.029239:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577536640 00010000:00010000:1.0:1788271840.029303:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e69071fc/0x99288105fd38f72b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd79a expref: 12 pid: 8397 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271840.029363:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 104 00000100:00100000:1.0:1788271840.029376:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+12:2398:x1875138577536640:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271840.029396:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271840.029426:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e69071fc/0x99288105fd38f72b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd79a expref: 12 pid: 8397 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.029442:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e69071fc/0x99288105fd38f72b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd79a expref: 12 pid: 8397 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.029474:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e69071fc/0x99288105fd38f72b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd79a expref: 12 pid: 8397 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.029525:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271840.029531:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271840.029541:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000067473f03/0x99288105fd38f732 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd7a1 expref: 11 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.029552:0:6470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067473f03/0x99288105fd38f732 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd7a1 expref: 11 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.029602:0:6470:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000067473f03/0x99288105fd38f732 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd7a1 expref: 11 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271840.029681:0:6470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83aab800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6470:1875138590160256:192.168.201.3@tcp:105: 00000100:00100000:1.0:1788271840.030204:0:6470:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9836cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788271840.038985:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271840.039181:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577536768 00000100:00100000:2.0:1788271840.039202:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577536768 00002000:00100000:2.0:1788271840.039276:0:8402:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff8f6d83b39c00 x1875138577536768/t0(0) o4->ef8df183-a1b1-4e56-bce5-924a894c4a71@192.168.201.3@tcp:746/0 lens 504/0 e 0 to 0 dl 1788271851 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788271840.039290:0:8402:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f6d83b39c00 with x1875138577536768 ext(0->12) 00002000:00010000:2.0:1788271840.039297:0:8402:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f6d83b39c00 00000100:00100000:2.0:1788271840.039341:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:2.0:1788271840.039351:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+12:2397:x1875138577536768:12345-192.168.201.3@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788271840.040133:0:6470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83aab800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6470:1875138590160256:192.168.201.3@tcp:105: 00010000:00010000:1.0:1788271840.040164:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271840.040589:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b3b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+12:2398:x1875138577536640:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 11214us (11948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271840.040600:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 104 00000100:00100000:2.0:1788271840.040843:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+13:2397:x1875138577536768:12345-192.168.201.3@tcp:4:lhsmtool_posix.0 Request processed in 1492us (1874us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1788271840.040852:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 7 00002000:00100000:2.0:1788271840.040861:0:8402:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff8f6d83b39c00 x1875138577536768/t4294967322(0) o4->ef8df183-a1b1-4e56-bce5-924a894c4a71@192.168.201.3@tcp:746/0 lens 504/448 e 0 to 0 dl 1788271851 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788271840.040871:0:8402:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f6d83b39c00 with x1875138577536768 ext(0->12) 00002000:00010000:2.0:1788271840.040876:0:8402:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f6d83b39c00 00000100:00100000:0.0:1788271840.049374:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271840.049480:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577536896 00000100:00100000:3.0:1788271840.049490:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577536896 00000100:00100000:3.0:1788271840.049559:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 244 00000100:00100000:3.0:1788271840.049571:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+73:12473:x1875138577536896:12345-192.168.201.3@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788271840.051765:0:6462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 00000004:00080000:0.0:1788271840.051781:0:6462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:0.0:1788271840.051897:0:6462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1788271840.051923:0:6462:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f6e89061300 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1788271840.051928:0:6462:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f6d83136400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f6e89061e40 00000020:00080000:0.0:1788271840.051931:0:6462:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f6d83136f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f6d82d85600 00000004:00080000:0.0:1788271840.051960:0:6462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00010000:00010000:1.0:1788271840.052024:0:3592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511cc00/0x99288105fd38f437 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052037:0:3592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511cc00/0x99288105fd38f437 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052045:0:3592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511cc00/0x99288105fd38f437 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052063:0:3592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511cc00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271840.052068:0:3592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511cc00/0x99288105fd38f437 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052076:0:3592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511cc00/0x99288105fd38f437 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052092:0:3592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f6d82060d00) 00010000:00010000:1.0:1788271840.052095:0:3592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271840.052100:0:3592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511cc00/0x99288105fd38f437 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052106:0:3592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511cc00/0x99288105fd38f437 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052138:0:3592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f4df lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052144:0:3592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f4df lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052150:0:3592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f4df lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052155:0:3592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f6400 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271840.052158:0:3592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f4df lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052164:0:3592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f4df lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052183:0:3592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f6d82060300) 00010000:00010000:1.0:1788271840.052186:0:3592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271840.052189:0:3592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f4df lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052195:0:3592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6400/0x99288105fd38f4df lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052212:0:3592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38f55d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052218:0:3592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38f55d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052223:0:3592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38f55d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052229:0:3592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e92d33c00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271840.052231:0:3592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38f55d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052237:0:3592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38f55d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052244:0:3592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f6d82060e00) 00010000:00010000:1.0:1788271840.052247:0:3592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271840.052249:0:3592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38f55d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052255:0:3592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33c00/0x99288105fd38f55d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052276:0:3592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6200/0x99288105fd38f580 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052282:0:3592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6200/0x99288105fd38f580 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052288:0:3592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6200/0x99288105fd38f580 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052293:0:3592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f6200 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271840.052296:0:3592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6200/0x99288105fd38f580 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052302:0:3592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6200/0x99288105fd38f580 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052310:0:3592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f6d82060e00) 00010000:00010000:1.0:1788271840.052312:0:3592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271840.052315:0:3592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6200/0x99288105fd38f580 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052321:0:3592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6200/0x99288105fd38f580 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052336:0:3592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f652 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052343:0:3592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f652 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052349:0:3592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f652 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052359:0:3592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e92d33e00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271840.052363:0:3592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f652 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052369:0:3592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f652 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052377:0:3592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6d82060700) 00010000:00010000:1.0:1788271840.052379:0:3592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271840.052382:0:3592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f652 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052388:0:3592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33e00/0x99288105fd38f652 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052401:0:3592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f70f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052407:0:3592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f70f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052413:0:3592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f70f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052418:0:3592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f6800 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271840.052421:0:3592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f70f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052427:0:3592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f70f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052443:0:3592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f6e920a2700) 00010000:00010000:1.0:1788271840.052445:0:3592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788271840.052449:0:3592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f70f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.052467:0:3592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6800/0x99288105fd38f70f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788271840.052487:0:6515:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788271840.052709:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788271840.052727:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590160384:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788271840.052792:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271840.052840:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590160384 00000100:00100000:3.0:1788271840.052847:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590160384 00000100:00100000:3.0:1788271840.052912:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788271840.052921:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3607:x1875138590160384:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788271840.052960:0:12967:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:3.0:1788271840.052993:0:12967:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a96dcde, atime: 0x6a96dcde, ctime: 0x6a96dcde, blocks: 0x8 00010000:00010000:3.0:1788271840.053000:0:12967:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea0af31e/0x99288105fd38f739 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.053015:0:12967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=401s v=(0 0) 00010000:00010000:3.0:1788271840.053019:0:12967:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271840.053025:0:12967:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea0af31e/0x99288105fd38f739 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.053040:0:12967:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea0af31e/0x99288105fd38f739 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.053055:0:12967:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea0af31e/0x99288105fd38f739 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.053062:0:12967:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea0af31e/0x99288105fd38f739 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.053079:0:12967:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788271840.053232:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3607:x1875138590160384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 311us (439us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788271840.053240:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:3.0:1788271840.053266:0:8412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788271840.053272:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea0af31e/0x99288105fd38f739 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.053279:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4200 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:3.0:1788271840.053282:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea0af31e/0x99288105fd38f739 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.053290:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea0af31e/0x99288105fd38f739 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.053303:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea0af31e/0x99288105fd38f739 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.053310:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea0af31e/0x99288105fd38f739 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12967 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.053333:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271840.053335:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271840.053338:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788271840.053348:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788271840.053378:0:3607:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f6d8406f100/2, rc 0, transno 4294967311 00000100:00100000:3.0:1788271840.053384:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590160384:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788271840.054292:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590160512:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788271840.054332:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271840.054399:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590160512 00000100:00100000:1.0:1788271840.054405:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590160512 00000100:00100000:1.0:1788271840.054447:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788271840.054465:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590160512:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788271840.054483:0:8396:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:1.0:1788271840.054502:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed941fb1/0x99288105fd38f740 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.054519:0:8396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000065045b01/0x99288105fd38f4ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6f9 expref: 12 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.054527:0:8396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1788271840.054531:0:8396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788271840.054534:0:8396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed941fb1/0x99288105fd38f740 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.054561:0:8396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000065045b01/0x99288105fd38f4ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6f9 expref: 12 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.054588:0:8396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000065045b01/0x99288105fd38f4ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6f9 expref: 12 pid: 8396 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271840.054602:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83aab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8396:1875138590160640:192.168.201.3@tcp:104: 00000100:00100000:1.0:1788271840.054702:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9836cb40 going to sleep for 11 seconds 00000100:00080000:1.0:1788271840.054716:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788271840.055655:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590160768:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788271840.055705:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271840.055749:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590160768 00000100:00100000:2.0:1788271840.055754:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590160768 00000100:00100000:2.0:1788271840.055790:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788271840.055798:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3608:x1875138590160768:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788271840.056102:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788271840.056106:0:8452:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788271839 00002000:00010000:2.0:1788271840.056109:0:8452:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788271840.056111:0:8452:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788271839 -> 1788271839 00002000:00010000:2.0:1788271840.056113:0:8452:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788271840.056150:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3608:x1875138590160768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 352us (444us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1788271840.056157:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788271840.056191:0:3608:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967318 gen 2 00000004:00080000:2.0:1788271840.056196:0:3608:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967318 00000100:00100000:2.0:1788271840.056219:0:3608:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8f6d81f42a00 x1875138590160768/t4294967323(4294967323) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788271856 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788271840.056229:0:3608:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f6d81f42a00/2, rc 0, transno 4294967323 00000100:00100000:2.0:1788271840.056234:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590160768:0@lo:2:osp-syn-1-0.0 00000020:00080000:0.0:1788271840.056729:0:6462:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f6d82d9bc00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1788271840.056734:0:6462:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f6e89079d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f6d82d9b0c0 00000020:00080000:0.0:1788271840.056737:0:6462:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f6eb4074700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f6d8408f800 00000020:00080000:0.0:1788271840.056750:0:6462:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1788271840.056867:0:6515:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1788271840.057080:0:6515:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788271840.057260:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+21:12473:x1875138577536896:12345-192.168.201.3@tcp:44:lhsmtool_posix.0 Request processed in 7689us (7893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271840.057269:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 244 00000100:00100000:0.0:1788271840.060563:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271840.060670:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271840.060925:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83aab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8396:1875138590160640:192.168.201.3@tcp:104: 00010000:00010000:1.0:1788271840.060962:0:8396:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ed941fb1/0x99288105fd38f740 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271840.061339:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577537152 00000100:00100000:3.0:1788271840.061347:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577537152 00000100:00100000:3.0:1788271840.061436:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 77 00000100:00100000:3.0:1788271840.061446:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+13:2397:x1875138577537152:12345-192.168.201.3@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788271840.062696:0:9486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577537024 00000100:00100000:2.0:1788271840.062706:0:9486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577537024 00010000:00010000:2.0:1788271840.062741:0:9486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000065045b01/0x99288105fd38f4ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6f9 expref: 14 pid: 8396 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271840.062774:0:9486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 105 00000100:00100000:2.0:1788271840.062782:0:9486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+14:2398:x1875138577537024:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271840.062803:0:9486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271840.062809:0:9486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000065045b01/0x99288105fd38f4ed lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6f9 expref: 14 pid: 8396 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271840.062824:0:9486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000065045b01/0x99288105fd38f4ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6f9 expref: 14 pid: 8396 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271840.062845:0:9486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065045b01/0x99288105fd38f4ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6f9 expref: 14 pid: 8396 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271840.062862:0:9486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788271840.062867:0:9486:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788271840.062872:0:9486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ed941fb1/0x99288105fd38f740 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271840.062952:0:9486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed941fb1/0x99288105fd38f740 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271840.062989:0:9486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271840.063047:0:9486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+13:2398:x1875138577537024:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 265us (2495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271840.063055:0:9486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 105 00010000:00010000:3.0:1788271840.063473:0:8396:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ed941fb1/0x99288105fd38f740 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.063484:0:8396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed941fb1/0x99288105fd38f740 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.063494:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed941fb1/0x99288105fd38f740 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.063502:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed941fb1/0x99288105fd38f740 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.063526:0:8396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788271840.063737:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3607:x1875138590160512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9281us (9403us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1788271840.063746:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:0.0:1788271840.063799:0:8413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271840.063806:0:8413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed941fb1/0x99288105fd38f740 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.063813:0:8413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e21e00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:0.0:1788271840.063824:0:8413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed941fb1/0x99288105fd38f740 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.063833:0:8413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed941fb1/0x99288105fd38f740 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.063846:0:8413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed941fb1/0x99288105fd38f740 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.063853:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed941fb1/0x99288105fd38f740 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.063873:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271840.063875:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271840.063876:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788271840.064101:0:3607:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f6d81f40700/2, rc 0, transno 4294967324 00000100:00100000:2.0:1788271840.064109:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590160512:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1788271840.064512:0:9475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:0.0:1788271840.064519:0:9475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000100:00100000:2.0:1788271840.064672:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2397:x1875138577537152:12345-192.168.201.3@tcp:16:lhsmtool_posix.0 Request processed in 3226us (4000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271840.064690:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 77 00000100:00100000:1.0:1788271840.068616:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271840.068806:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577537408 00000100:00100000:2.0:1788271840.068817:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577537408 00000100:00100000:2.0:1788271840.068879:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 245 00000100:00100000:2.0:1788271840.068891:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+21:12473:x1875138577537408:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788271840.068960:0:9899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271840.068988:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7e00/0x99288105fd38f724 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd793 expref: 21 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271840.069007:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f6e920a2700) 00010000:00010000:2.0:1788271840.069012:0:9899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788271840.069042:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7200/0x99288105fd38f747 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271840.069056:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7200/0x99288105fd38f747 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271840.069065:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7200/0x99288105fd38f747 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788271840.069183:0:9899:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ea49069a reply state 00000000493296a4 transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7200/0x99288105fd38f747 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271840.069207:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7200/0x99288105fd38f747 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271840.069213:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f6e920a2700) 00010000:00010000:2.0:1788271840.069216:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788271840.069232:0:9899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788271840.069326:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+22:12473:x1875138577537408:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 Request processed in 437us (718us total) trans 4294967510 rc 0/0 00000100:00100000:2.0:1788271840.069334:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 245 00000100:00100000:0.0:1788271840.072062:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271840.072155:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577537536 00000100:00100000:2.0:1788271840.072165:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577537536 00000100:00100000:2.0:1788271840.072246:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 78 00000100:00100000:2.0:1788271840.072257:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2395:x1875138577537536:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788271840.072409:0:8452:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788271840.072413:0:8452:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1788271839 -> 1788271838 00002000:00010000:2.0:1788271840.072416:0:8452:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788271838 00002000:00010000:2.0:1788271840.072418:0:8452:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788271839 -> 1788271838 00002000:00010000:2.0:1788271840.072420:0:8452:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788271840.072828:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+8:2395:x1875138577537536:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 Request processed in 571us (775us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1788271840.072836:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 78 00000100:00100000:0.0:1788271840.075698:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271840.075786:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577537792 00000100:00100000:3.0:1788271840.075798:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577537792 00000100:00100000:3.0:1788271840.075858:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 246 00000100:00100000:3.0:1788271840.075869:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+22:12473:x1875138577537792:12345-192.168.201.3@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788271840.075953:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38f74e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.075970:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38f708 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd785 expref: 22 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.075980:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38f74e lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.076021:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38f708 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd785 expref: 22 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.076036:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38f708 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd785 expref: 22 pid: 6485 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271840.076050:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6483:1875138590160896:192.168.201.3@tcp:104: 00000100:00100000:3.0:1788271840.076139:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e83021a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788271840.079665:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271840.079788:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577537920 00000100:00100000:2.0:1788271840.079799:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577537920 00010000:00010000:2.0:1788271840.079844:0:6468:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38f708 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd785 expref: 23 pid: 6485 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271840.079885:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 106 00000100:00100000:2.0:1788271840.079896:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+23:2397:x1875138577537920:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271840.079911:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271840.079918:0:6468:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38f708 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd785 expref: 23 pid: 6485 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271840.079979:0:6468:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38f708 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd785 expref: 23 pid: 6485 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271840.080003:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f6e920a2700) 00010000:00010000:2.0:1788271840.080008:0:6468:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38f74e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271840.080017:0:6468:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38f74e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271840.080024:0:6468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38f74e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271840.080043:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271840.080102:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+23:2397:x1875138577537920:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 207us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271840.080109:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 106 00010000:00010000:3.0:1788271840.080264:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38f708 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd785 expref: 22 pid: 6485 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271840.080283:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6483:1875138590160896:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788271840.080316:0:6483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38f74e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.080325:0:6483:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38f74e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.080331:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38f74e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.080367:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38f74e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.080374:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38f74e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.080381:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38f74e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.080387:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4200 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271840.080390:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38f74e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.080398:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38f74e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.080407:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f6e920a2700) 00010000:00010000:3.0:1788271840.080410:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788271840.080413:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38f74e lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.080419:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38f74e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271840.080469:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+21:12473:x1875138577537792:12345-192.168.201.3@tcp:55:lhsmtool_posix.0 Request processed in 4602us (4781us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788271840.080476:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 246 00000100:00100000:0.0:1788271840.085437:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271840.085947:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577538048 00000100:00100000:1.0:1788271840.085959:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577538048 00000100:00100000:1.0:1788271840.086024:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 79 00000100:00100000:1.0:1788271840.086035:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+8:2396:x1875138577538048:12345-192.168.201.3@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788271840.086087:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000021470cef/0x99288105fd38f755 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.086104:0:8398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000067473f03/0x99288105fd38f732 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd7a1 expref: 8 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.086126:0:8398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271840.086129:0:8398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788271840.086132:0:8398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021470cef/0x99288105fd38f755 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.086160:0:8398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000067473f03/0x99288105fd38f732 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd7a1 expref: 8 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271840.086171:0:8398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000067473f03/0x99288105fd38f732 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd7a1 expref: 8 pid: 8452 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271840.086182:0:8398:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83aa9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8398:1875138590161024:192.168.201.3@tcp:104: 00000100:00100000:1.0:1788271840.086498:0:8398:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9836cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788271840.098131:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271840.098240:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577538176 00000100:00100000:2.0:1788271840.098250:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577538176 00010000:00010000:2.0:1788271840.098290:0:6470:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000067473f03/0x99288105fd38f732 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd7a1 expref: 9 pid: 8452 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271840.098335:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 107 00000100:00100000:2.0:1788271840.098345:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+9:2398:x1875138577538176:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271840.098361:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271840.098381:0:6470:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000067473f03/0x99288105fd38f732 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd7a1 expref: 9 pid: 8452 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271840.098415:0:6470:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000067473f03/0x99288105fd38f732 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd7a1 expref: 9 pid: 8452 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271840.098439:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788271840.098444:0:6470:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788271840.098522:0:6470:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000021470cef/0x99288105fd38f755 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271840.098534:0:6470:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021470cef/0x99288105fd38f755 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271840.098557:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271840.098706:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+9:2398:x1875138577538176:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 360us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271840.098715:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 107 00010000:00010000:3.0:1788271840.098816:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067473f03/0x99288105fd38f732 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd7a1 expref: 8 pid: 8452 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271840.098834:0:8398:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83aa9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8398:1875138590161024:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788271840.098871:0:8398:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000021470cef/0x99288105fd38f755 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.098882:0:8398:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000021470cef/0x99288105fd38f755 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.098891:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021470cef/0x99288105fd38f755 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.098912:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000021470cef/0x99288105fd38f755 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.098921:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021470cef/0x99288105fd38f755 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.098929:0:8398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021470cef/0x99288105fd38f755 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.098958:0:8398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4ed4a00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:3.0:1788271840.098962:0:8398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021470cef/0x99288105fd38f755 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.098972:0:8398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021470cef/0x99288105fd38f755 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.098984:0:8398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021470cef/0x99288105fd38f755 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.098992:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021470cef/0x99288105fd38f755 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271840.099040:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2396:x1875138577538048:12345-192.168.201.3@tcp:1:lhsmtool_posix.0 Request processed in 13007us (13613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271840.099048:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 79 00000100:00100000:2.0:1788271840.107737:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271840.107839:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577538432 00000100:00100000:0.0:1788271840.107848:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577538432 00000100:00100000:0.0:1788271840.107916:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 247 00000100:00100000:0.0:1788271840.107926:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+21:12473:x1875138577538432:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788271840.108019:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d400/0x99288105fd38f75c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.108037:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f64b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd74d expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.108063:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d400/0x99288105fd38f75c lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.108102:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f64b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd74d expref: 21 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.108116:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f64b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd74d expref: 21 pid: 6484 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271840.108129:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8336a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1875138590161152:192.168.201.3@tcp:104: 00000100:00100000:0.0:1788271840.108228:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d9bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271840.113072:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8336a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1875138590161152:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788271840.113106:0:6485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d400/0x99288105fd38f75c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271840.115133:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271840.115410:0:9485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577538560 00000100:00100000:0.0:1788271840.115420:0:9485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577538560 00010000:00010000:0.0:1788271840.115457:0:9485:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f64b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd74d expref: 22 pid: 6484 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271840.115502:0:9485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 108 00000100:00100000:0.0:1788271840.115513:0:9485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+22:2397:x1875138577538560:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271840.115527:0:9485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271840.115534:0:9485:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f64b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd74d expref: 22 pid: 6484 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.115548:0:9485:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f64b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd74d expref: 22 pid: 6484 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.115570:0:9485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6000/0x99288105fd38f64b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd74d expref: 22 pid: 6484 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.115601:0:9485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6d82060700) 00010000:00010000:0.0:1788271840.115608:0:9485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f6ad lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd770 expref: 21 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.115666:0:9485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d400/0x99288105fd38f75c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.115677:0:9485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d400/0x99288105fd38f75c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.115689:0:9485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d400/0x99288105fd38f75c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.115715:0:9485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271840.115765:0:9485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+21:2397:x1875138577538560:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 254us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271840.115772:0:9485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 108 00010000:00010000:3.0:1788271840.116598:0:6485:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d400/0x99288105fd38f75c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.116607:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d400/0x99288105fd38f75c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.116848:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38f763 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.116866:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f716 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd78c expref: 21 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.116875:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38f763 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.116919:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f716 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd78c expref: 21 pid: 9899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.116933:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f716 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd78c expref: 21 pid: 9899 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271840.116958:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1875138590161280:192.168.201.3@tcp:104: 00000100:00100000:3.0:1788271840.117017:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e830210c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271840.123163:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1875138590161280:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788271840.123260:0:6485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38f763 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271840.125145:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271840.125227:0:6469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577538688 00000100:00100000:0.0:1788271840.125236:0:6469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577538688 00010000:00010000:0.0:1788271840.125279:0:6469:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f716 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd78c expref: 22 pid: 9899 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271840.125318:0:6469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 109 00000100:00100000:0.0:1788271840.125328:0:6469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+22:2397:x1875138577538688:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271840.125343:0:6469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271840.125350:0:6469:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f716 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd78c expref: 22 pid: 9899 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.125380:0:6469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f716 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd78c expref: 22 pid: 9899 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.125402:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38f716 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd78c expref: 22 pid: 9899 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.125417:0:6469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f6e920a2700) 00010000:00010000:0.0:1788271840.125422:0:6469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38f763 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.125431:0:6469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38f763 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.125438:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38f763 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.125468:0:6469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271840.125514:0:6469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+21:2397:x1875138577538688:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 187us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271840.125521:0:6469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 109 00010000:00010000:3.0:1788271840.125868:0:6485:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38f763 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.126095:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38f763 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788271840.126220:0:6485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:3.0:1788271840.126341:0:6485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000001:00080000:3.0:1788271840.126375:0:6485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:3.0:1788271840.126568:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6485:1875138590161408:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788271840.126761:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271840.127678:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb3f2f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271840.130316:0:14136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590161408 00000100:00100000:2.0:1788271840.130331:0:14136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590161408 00000100:00100000:2.0:1788271840.130438:0:14136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788271840.130449:0:14136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6485:x1875138590161408:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788271840.130656:0:14136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6485:x1875138590161408:12345-0@lo:1000:mdt00_002.0 Request processed in 208us (3894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271840.130664:0:14136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788271840.130843:0:6485:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:0.0:1788271840.130850:0:6485:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f6d81f42a00, transno 4294967323 00000100:00100000:0.0:1788271840.130864:0:6485:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8f6d81f40700 x1875138590160512/t4294967324(4294967324) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788271856 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271840.130877:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6485:1875138590161408:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788271840.131167:0:6485:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:0.0:1788271840.131312:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83369880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6485:1875138590161536:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788271840.131365:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271840.131434:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d9b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271840.131677:0:14136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590161536 00000100:00100000:2.0:1788271840.131683:0:14136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590161536 00000100:00100000:2.0:1788271840.131723:0:14136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788271840.131731:0:14136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6485:x1875138590161536:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788271840.131838:0:14136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6485:x1875138590161536:12345-0@lo:1000:mdt00_002.0 Request processed in 108us (473us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1788271840.131845:0:14136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788271840.132162:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83369880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6485:1875138590161536:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788271840.132212:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38f763 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.132222:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38f763 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.132229:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38f763 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.132235:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4200 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271840.132240:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38f763 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.132247:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38f763 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.132264:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f6e920a2700) 00010000:00010000:0.0:1788271840.132268:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788271840.132273:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38f763 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.132279:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38f763 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.132302:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f6a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.132309:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f6a6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.132323:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f6a6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.132328:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4c00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271840.132331:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f6a6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.132338:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f6a6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.132346:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6d82060700) 00010000:00010000:0.0:1788271840.132348:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788271840.132354:0:6485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f6ad lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd770 expref: 24 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.132365:0:6485:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f6ad lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd770 expref: 24 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.132374:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f6ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd770 expref: 24 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.132399:0:6485:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f6ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd770 expref: 24 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271840.132410:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83368380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1875138590161664:192.168.201.3@tcp:105: 00000100:00100000:0.0:1788271840.132589:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d9b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271840.137323:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271840.137419:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83368380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6485:1875138590161664:192.168.201.3@tcp:105: 00010000:00010000:0.0:1788271840.137459:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f6a6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.137469:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38f6a6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.137502:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38f76a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.137515:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38f76a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.137525:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38f76a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.137535:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38f76a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.137541:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38f76a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.137547:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38f76a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.137551:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511da00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271840.137555:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38f76a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.137562:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38f76a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.137570:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6d82060700) 00010000:00010000:0.0:1788271840.137573:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271840.137581:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38f76a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.137588:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511da00/0x99288105fd38f76a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.137598:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d400/0x99288105fd38f75c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.137603:0:6485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d400/0x99288105fd38f75c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.137608:0:6485:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d400/0x99288105fd38f75c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.137612:0:6485:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511d400 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271840.137614:0:6485:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d400/0x99288105fd38f75c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.137662:0:6485:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d400/0x99288105fd38f75c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.137670:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6d82060700) 00010000:00010000:0.0:1788271840.137673:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788271840.137675:0:6485:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d400/0x99288105fd38f75c lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271840.137681:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d400/0x99288105fd38f75c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6485 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271840.137828:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+24:12473:x1875138577538432:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 Request processed in 29903us (30100us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1788271840.137839:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 247 00000020:00080000:0.0:1788271840.137851:0:6485:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1788271840.138034:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577538816 00000100:00100000:1.0:1788271840.138042:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577538816 00000100:00100000:1.0:1788271840.138094:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 61 00000100:00100000:1.0:1788271840.138103:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+24:12472:x1875138577538816:12345-192.168.201.3@tcp:49:lfs.0 00000100:00100000:1.0:1788271840.138197:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+24:12472:x1875138577538816:12345-192.168.201.3@tcp:49:lfs.0 Request processed in 85us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271840.138205:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 61 00000040:00080000:3.0:1788271840.138450:0:13762:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788271840.138455:0:13762:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788271840.138982:0:13762:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788271840.138991:0:13762:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788271840.142694:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271840.142805:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577539072 00000100:00100000:2.0:1788271840.142816:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577539072 00000100:00100000:2.0:1788271840.142887:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 248 00000100:00100000:2.0:1788271840.142898:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+24:12472:x1875138577539072:12345-192.168.201.3@tcp:58:lfs.0 00000040:00080000:2.0:1788271840.143083:0:6484:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1788271840.143168:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+24:12472:x1875138577539072:12345-192.168.201.3@tcp:58:lfs.0 Request processed in 272us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271840.143176:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 248 00000100:00100000:1.0:1788271840.148979:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271840.149666:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577539328 00000100:00100000:2.0:1788271840.149678:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577539328 00000100:00100000:2.0:1788271840.149729:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 62 00000100:00100000:2.0:1788271840.149739:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb369e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+24:12473:x1875138577539328:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788271840.150211:0:6486:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788271840.150264:0:6486:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967516 00010000:00010000:2.0:1788271840.150297:0:6486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7000/0x99288105fd38f771 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271840.150315:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7000/0x99288105fd38f771 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271840.150342:0:6486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7000/0x99288105fd38f771 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271840.150350:0:6486:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7000/0x99288105fd38f771 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271840.150356:0:6486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7000/0x99288105fd38f771 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271840.150362:0:6486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7000/0x99288105fd38f771 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271840.150384:0:6486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788271840.150600:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788271840.150608:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7000/0x99288105fd38f771 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.150616:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f7000 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:3.0:1788271840.150641:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7000/0x99288105fd38f771 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.150649:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7000/0x99288105fd38f771 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.150664:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f6e920a2700) 00010000:00010000:3.0:1788271840.150667:0:6472:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788271840.150672:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7000/0x99288105fd38f771 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.150678:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7000/0x99288105fd38f771 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6486 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.150692:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271840.150693:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271840.150695:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271840.150921:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb369e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+26:12473:x1875138577539328:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 Request processed in 1181us (1949us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1788271840.150930:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 62 00000020:00080000:2.0:1788271840.150935:0:6486:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788271840.189485:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271840.189580:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577539456 00000100:00100000:3.0:1788271840.189601:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577539456 00000100:00100000:3.0:1788271840.189679:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 249 00000100:00100000:3.0:1788271840.189687:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+26:12475:x1875138577539456:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:3.0:1788271840.189707:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271840.189724:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38f778 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd7a8 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.189773:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5800/0x99288105fd38f77f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.189783:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5800/0x99288105fd38f77f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.189791:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5800/0x99288105fd38f77f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.189799:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5200/0x99288105fd38f786 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.189803:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5200/0x99288105fd38f786 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.189807:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5200/0x99288105fd38f786 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.189866:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38f78d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.189876:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f698 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd769 expref: 27 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.189894:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38f78d lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.189934:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f698 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd769 expref: 27 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.189958:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f698 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd769 expref: 27 pid: 6483 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271840.189972:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6483:1875138590161792:192.168.201.3@tcp:104: 00000100:00100000:3.0:1788271840.190069:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb3f2fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788271840.193140:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271840.193358:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577539712 00000100:00100000:0.0:1788271840.193368:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577539712 00000100:00100000:0.0:1788271840.193424:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 63 00000100:00100000:0.0:1788271840.193434:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+28:6167:x1875138577539712:12345-192.168.201.3@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788271840.193682:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+29:6167:x1875138577539712:12345-192.168.201.3@tcp:35:ldlm_bl.0 Request processed in 249us (551us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1788271840.193689:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 63 00000100:00100000:3.0:1788271840.195564:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6483:1875138590161792:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788271840.195589:0:6483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38f78d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271840.195708:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271840.195774:0:9486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577539840 00000100:00100000:2.0:1788271840.195779:0:9486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577539840 00010000:00010000:2.0:1788271840.195805:0:9486:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f698 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd769 expref: 29 pid: 6483 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271840.195832:0:9486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 110 00000100:00100000:2.0:1788271840.195838:0:9486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+29:2398:x1875138577539840:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271840.195847:0:9486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271840.195852:0:9486:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f698 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd769 expref: 29 pid: 6483 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271840.195882:0:9486:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f698 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd769 expref: 29 pid: 6483 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271840.195903:0:9486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38f698 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd769 expref: 29 pid: 6483 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271840.195919:0:9486:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6d82060700) 00010000:00010000:2.0:1788271840.195923:0:9486:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38f78d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271840.195933:0:9486:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38f78d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271840.195948:0:9486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38f78d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271840.195973:0:9486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271840.196017:0:9486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+28:2398:x1875138577539840:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 178us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271840.196024:0:9486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 110 00010000:00010000:3.0:1788271840.196977:0:6483:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38f78d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.196986:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38f78d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271840.197034:0:6483:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788271840.197038:0:6483:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788271840.197056:0:6483:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38f78d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.197069:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38f78d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.197079:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5800/0x99288105fd38f77f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.197099:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5800/0x99288105fd38f77f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.197105:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5800/0x99288105fd38f77f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.197111:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c5800 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271840.197116:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5800/0x99288105fd38f77f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.197123:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5800/0x99288105fd38f77f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.197133:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f6d82060100) 00010000:00010000:3.0:1788271840.197136:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271840.197140:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5800/0x99288105fd38f77f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.197146:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5800/0x99288105fd38f77f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.197158:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5200/0x99288105fd38f786 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.197164:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5200/0x99288105fd38f786 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.197170:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5200/0x99288105fd38f786 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.197175:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c5200 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271840.197184:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5200/0x99288105fd38f786 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.197201:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5200/0x99288105fd38f786 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.197210:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f6e920a2000) 00010000:00010000:3.0:1788271840.197213:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271840.197216:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5200/0x99288105fd38f786 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.197221:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5200/0x99288105fd38f786 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.197363:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38f778 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd7a8 expref: 28 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.197374:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38f78d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd7a8 expref: 27 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271840.197379:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6d82060700) 00010000:00010000:3.0:1788271840.197380:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788271840.197382:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c4400, rc 0) 00000100:00100000:3.0:1788271840.197419:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+27:12475:x1875138577539456:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 7733us (7942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271840.197423:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 249 00000100:00100000:3.0:1788271840.285836:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83aa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590161920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788271840.285908:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271840.286051:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590161920 00000100:00100000:1.0:1788271840.286059:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590161920 00000100:00100000:1.0:1788271840.286109:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788271840.286118:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3609:x1875138590161920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788271840.286142:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691941888 00000100:00100000:1.0:1788271840.286203:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3609:x1875138590161920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271840.286210:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788271840.286370:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83aa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590161920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788271840.286883:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590162304:0@lo:400:kworker.0 00000100:00100000:1.0:1788271840.286917:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271840.286949:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83aa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3608:1875138590162816:0@lo:400:kworker.0 00000100:00100000:1.0:1788271840.286975:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271840.286992:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83ad2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590163328:0@lo:400:kworker.0 00000100:00100000:1.0:1788271840.287016:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271840.287044:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788271840.287050:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83aaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875138590162432:0@lo:400:kworker.0 00000100:00100000:1.0:1788271840.287071:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271840.287088:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83aa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590162944:0@lo:400:kworker.0 00000100:00100000:1.0:1788271840.287130:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271840.287158:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590163328 00000100:00100000:1.0:1788271840.287163:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590163328 00000100:00100000:1.0:1788271840.287211:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590162944 00000100:00100000:1.0:1788271840.287215:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590162944 00000100:00100000:1.0:1788271840.287238:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788271840.287266:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590163328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271840.287306:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590163328:12345-0@lo:400:kworker.0 Request processed in 41us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271840.287312:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788271840.287326:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788271840.287332:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590162944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271840.287360:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590162944:12345-0@lo:400:kworker.0 Request processed in 28us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271840.287366:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:1.0:1788271840.287382:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788271840.287387:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788271840.287405:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83aa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590162944:0@lo:400:kworker.0 00000100:00100000:1.0:1788271840.287417:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83ad2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590163328:0@lo:400:kworker.0 00000100:00100000:1.0:1788271840.287439:0:14136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590162304 00000100:00100000:1.0:1788271840.287443:0:14136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590162304 00000100:00100000:1.0:1788271840.287683:0:14136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788271840.287690:0:14136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590162304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271840.287731:0:14136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590162304:12345-0@lo:400:kworker.0 Request processed in 42us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271840.287738:0:14136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788271840.287766:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83aa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590162304:0@lo:400:kworker.0 00000100:00100000:1.0:1788271840.287788:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83aa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875138590162176:0@lo:400:kworker.0 00000100:00100000:1.0:1788271840.287813:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271840.287831:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83aaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3607:1875138590162688:0@lo:400:kworker.0 00000100:00100000:1.0:1788271840.287862:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271840.287880:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83aa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3607:1875138590163200:0@lo:400:kworker.0 00000100:00100000:1.0:1788271840.287900:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271840.287919:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788271840.287925:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83aa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590162048:0@lo:400:kworker.0 00000100:00100000:1.0:1788271840.287963:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271840.287984:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590162048 00000100:00100000:1.0:1788271840.287988:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590162048 00000100:00100000:1.0:1788271840.288014:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1788271840.288021:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3607:x1875138590162048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271840.288050:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3607:x1875138590162048:12345-0@lo:400:kworker.0 Request processed in 29us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271840.288056:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1788271840.288083:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590162816 00000100:00100000:1.0:1788271840.288087:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590162816 00000100:00080000:1.0:1788271840.288101:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788271840.288119:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590162432 00000100:00100000:1.0:1788271840.288122:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590162432 00000100:00100000:1.0:1788271840.288133:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590162176 00000100:00100000:1.0:1788271840.288135:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590162176 00000100:00100000:1.0:1788271840.288145:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590162688 00000100:00100000:1.0:1788271840.288147:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590162688 00000100:00080000:1.0:1788271840.288160:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271840.288171:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590163200 00000100:00100000:1.0:1788271840.288174:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590163200 00000100:00080000:1.0:1788271840.288514:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788271840.288538:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1788271840.288545:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875138590162816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271840.288582:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875138590162816:12345-0@lo:400:kworker.0 Request processed in 38us (1607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271840.288595:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00010000:00080000:1.0:1788271840.288641:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83aa8380 x1875138590162816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271840.288652:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83aa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3608:1875138590162816:0@lo:400:kworker.0 00000100:00100000:1.0:1788271840.288671:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1788271840.288677:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875138590162432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271840.288710:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875138590162432:12345-0@lo:400:kworker.0 Request processed in 34us (1638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271840.288716:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1788271840.288736:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83aaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875138590162432:0@lo:400:kworker.0 00000100:00100000:1.0:1788271840.288753:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1788271840.288759:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875138590162176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271840.288787:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875138590162176:12345-0@lo:400:kworker.0 Request processed in 28us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271840.288793:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1788271840.288805:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1788271840.288810:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875138590162688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271840.288837:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875138590162688:12345-0@lo:400:kworker.0 Request processed in 26us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271840.288842:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1788271840.288854:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788271840.288860:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875138590163200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271840.288885:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875138590163200:12345-0@lo:400:kworker.0 Request processed in 26us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271840.288898:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788271840.288930:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83aa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590162048:0@lo:400:kworker.0 00000100:00100000:1.0:1788271840.288946:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83aaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590162560:0@lo:400:kworker.0 00000100:00100000:1.0:1788271840.288973:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271840.288998:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590162560 00000100:00100000:1.0:1788271840.289002:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590162560 00000100:00100000:1.0:1788271840.289023:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788271840.289029:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590162560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271840.289061:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590162560:12345-0@lo:400:kworker.0 Request processed in 32us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271840.289067:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788271840.289091:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83aaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590162560:0@lo:400:kworker.0 00000100:00100000:1.0:1788271840.289097:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83aa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3607:1875138590163072:0@lo:400:kworker.0 00000100:00100000:1.0:1788271840.289120:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271840.289143:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83aa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875138590162176:0@lo:400:kworker.0 00000100:00100000:1.0:1788271840.289153:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83aaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3607:1875138590162688:0@lo:400:kworker.0 00010000:00080000:1.0:1788271840.289163:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83aa9c00 x1875138590163200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271840.289172:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83aa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3607:1875138590163200:0@lo:400:kworker.0 00000100:00100000:0.0:1788271840.289469:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590163072 00000100:00100000:0.0:1788271840.289474:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590163072 00000100:00100000:0.0:1788271840.289507:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788271840.289512:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875138590163072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271840.289543:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875138590163072:12345-0@lo:400:kworker.0 Request processed in 31us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271840.289548:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00080000:0.0:1788271840.289591:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788271840.289881:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590163456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788271840.289912:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271840.290000:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590163456 00000100:00100000:3.0:1788271840.290012:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590163456 00000100:00100000:3.0:1788271840.290049:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788271840.290056:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83368380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590163456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788271840.290071:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691941888 00000100:00100000:3.0:1788271840.290112:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83368380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590163456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271840.290117:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788271840.290151:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590163456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788271840.294048:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83aa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3607:1875138590163072:0@lo:400:kworker.0 00010000:00010000:3.0:1788271840.671827:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788271840.808159:0:14776:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788271840.808168:0:14776:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788271840.808277:0:14776:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788271840.808285:0:14776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788271841.182314:0:13762:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788271841.182325:0:13762:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788271841.182352:0:13762:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788271841.182358:0:13762:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788271841.182488:0:13762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13762:1875138590163584:192.168.201.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788271841.182609:0:13762:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb3f2f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271841.189372:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271841.189573:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577539968 00000100:00100000:0.0:1788271841.189582:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577539968 00000100:00100000:0.0:1788271841.189673:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 250 00000100:00100000:0.0:1788271841.189683:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+28:12488:x1875138577539968:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788271841.189718:0:6485:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788271841.189846:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+28:12488:x1875138577539968:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 Request processed in 163us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271841.189854:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 250 00000100:00100000:3.0:1788271841.191901:0:13762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13762:1875138590163584:192.168.201.3@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788271841.194820:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271841.194986:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577540224 00000100:00100000:0.0:1788271841.194995:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577540224 00000100:00100000:0.0:1788271841.195055:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 251 00000100:00100000:0.0:1788271841.195065:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+27:12488:x1875138577540224:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788271841.195087:0:12164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271841.195107:0:12164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d400/0x99288105fd38f794 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd7af expref: -99 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271841.195208:0:12164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511ca00/0x99288105fd38f79b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271841.195223:0:12164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511ca00/0x99288105fd38f79b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271841.195237:0:12164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511ca00/0x99288105fd38f79b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12164 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271841.195248:0:12164:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788271841.195351:0:12164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d400/0x99288105fd38f794 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd7af expref: 30 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271841.195369:0:12164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511ca00/0x99288105fd38f79b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd7af expref: 29 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271841.195378:0:12164:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6d82060700) 00010000:00010000:0.0:1788271841.195381:0:12164:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788271841.195384:0:12164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e8511ca00, rc 0) 00000100:00100000:0.0:1788271841.195453:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+29:12488:x1875138577540224:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 389us (642us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1788271841.195477:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 251 00000100:00100000:1.0:1788271841.201126:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271841.201213:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577540480 00000100:00100000:0.0:1788271841.201222:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577540480 00000100:00100000:0.0:1788271841.201285:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 252 00000100:00100000:0.0:1788271841.201296:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+29:12488:x1875138577540480:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788271841.201376:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d400/0x99288105fd38f7a9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271841.201394:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d400/0x99288105fd38f7a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271841.201405:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d400/0x99288105fd38f7a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271841.201537:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d400/0x99288105fd38f7a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271841.201545:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d400/0x99288105fd38f7a9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271841.201553:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d400/0x99288105fd38f7a9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271841.201559:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511d400 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271841.201564:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d400/0x99288105fd38f7a9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271841.201572:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d400/0x99288105fd38f7a9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271841.201604:0:6483:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6d82060700) 00010000:00010000:0.0:1788271841.201607:0:6483:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788271841.201612:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d400/0x99288105fd38f7a9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271841.201655:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d400/0x99288105fd38f7a9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6483 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271841.202024:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+30:12488:x1875138577540480:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 Request processed in 727us (905us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1788271841.202033:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 252 00000040:00080000:3.0:1788271841.202166:0:13762:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788271841.202172:0:13762:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788271841.204261:0:13762:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788271841.204277:0:13762:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788271841.214059:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271841.214147:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271841.214428:0:6468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577540608 00000100:00100000:0.0:1788271841.214439:0:6468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577540608 00000100:00100000:0.0:1788271841.214507:0:6468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 17 00000100:00100000:0.0:1788271841.214518:0:6468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+30:2398:x1875138577540608:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271841.214534:0:6468:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271841.214556:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511ca00/0x99288105fd38f79b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd7af expref: 30 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271841.214570:0:6468:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6d82060700) 00010000:00010000:0.0:1788271841.214573:0:6468:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271841.214610:0:6468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+29:2398:x1875138577540608:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 95us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271841.214641:0:6468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 17 00000100:00100000:3.0:1788271841.214790:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577540864 00000100:00100000:3.0:1788271841.214795:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577540864 00000100:00100000:3.0:1788271841.214839:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 64 00000100:00100000:3.0:1788271841.214845:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+29:12488:x1875138577540864:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788271841.215023:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+30:12488:x1875138577540864:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 Request processed in 177us (874us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788271841.215047:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 64 00010000:00010000:3.0:1788271841.694237:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788271842.632140:0:14828:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788271842.632151:0:14828:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788271842.632185:0:14828:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788271842.632193:0:14828:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788271842.717730:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271842.756518:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271842.756991:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577541120 00000100:00100000:3.0:1788271842.757002:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577541120 00000100:00100000:3.0:1788271842.757075:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 253 00000100:00100000:3.0:1788271842.757087:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+30:12508:x1875138577541120:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:3.0:1788271842.757114:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271842.757135:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38f7b0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd7b6 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271842.757263:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5200/0x99288105fd38f7b7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271842.757281:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5200/0x99288105fd38f7b7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271842.757292:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5200/0x99288105fd38f7b7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271842.757303:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788271842.757431:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5a00/0x99288105fd38f7b0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd7b6 expref: 33 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271842.757450:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5200/0x99288105fd38f7b7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd7b6 expref: 32 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271842.757459:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6d82060700) 00010000:00010000:3.0:1788271842.757462:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788271842.757475:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c5200, rc 0) 00000100:00100000:3.0:1788271842.757533:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+32:12508:x1875138577541120:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 449us (1028us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1788271842.757541:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 253 00000100:00080000:1.0:1788271842.758417:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788271842.764140:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271842.764216:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577541248 00000100:00100000:1.0:1788271842.764225:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577541248 00000100:00100000:1.0:1788271842.764273:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 254 00000100:00100000:1.0:1788271842.764283:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+32:12508:x1875138577541248:12345-192.168.201.3@tcp:54:lfs.0 00010000:00010000:1.0:1788271842.764348:0:9899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f7c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271842.764365:0:9899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f7c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271842.764375:0:9899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f7c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271842.764410:0:9899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f7c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271842.764417:0:9899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f7c5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271842.764424:0:9899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f7c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271842.764437:0:9899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4ed4c00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271842.764441:0:9899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f7c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271842.764448:0:9899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f7c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271842.764460:0:9899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6d82060700) 00010000:00010000:1.0:1788271842.764463:0:9899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788271842.764467:0:9899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f7c5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271842.764471:0:9899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed4c00/0x99288105fd38f7c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271842.764531:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+32:12508:x1875138577541248:12345-192.168.201.3@tcp:54:lfs.0 Request processed in 249us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271842.764539:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 254 00000100:00100000:3.0:1788271842.883387:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271842.884876:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577541376 00000100:00100000:1.0:1788271842.884900:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577541376 00000100:00100000:1.0:1788271842.884988:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 80 00000100:00100000:1.0:1788271842.885005:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2397:x1875138577541376:12345-192.168.201.3@tcp:101:cat.0 00010000:00010000:1.0:1788271842.885023:0:8398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271842.885044:0:8398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071f8bb7c/0x99288105fd38f7cc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd7bd expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788271842.885071:0:8398:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a96dcde, atime: 0x6a96dcde, ctime: 0x6a96dcde, blocks: 0x8 00010000:00010000:1.0:1788271842.885090:0:8398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=403s v=(0 0) 00010000:00010000:1.0:1788271842.885108:0:8398:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271842.885118:0:8398:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071f8bb7c/0x99288105fd38f7cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd7bd expref: 8 pid: 8398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788271842.885252:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788271842.885295:0:8398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000071f8bb7c/0x99288105fd38f7cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd7bd expref: 8 pid: 8398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271842.885311:0:8398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4ed4c00, rc 0) 00000100:00100000:0.0:1788271842.885448:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+8:2397:x1875138577541376:12345-192.168.201.3@tcp:101:cat.0 Request processed in 448us (2081us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271842.885462:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 80 00000100:00100000:2.0:1788271842.891319:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271842.891447:0:8401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577541504 00000100:00100000:3.0:1788271842.891459:0:8401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577541504 00002000:00100000:3.0:1788271842.891513:0:8401:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff8f6d81f43100 x1875138577541504/t0(0) o3->ef8df183-a1b1-4e56-bce5-924a894c4a71@192.168.201.3@tcp:748/0 lens 488/0 e 0 to 0 dl 1788271853 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788271842.891525:0:8401:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f6d81f43100 with x1875138577541504 ext(0->4095) 00002000:00010000:3.0:1788271842.891530:0:8401:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f6d81f43100 00000100:00100000:3.0:1788271842.891565:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 8 00000100:00100000:3.0:1788271842.891576:0:8401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+8:2398:x1875138577541504:12345-192.168.201.3@tcp:3:cat.0 00000100:00100000:3.0:1788271842.891809:0:8401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+8:2398:x1875138577541504:12345-192.168.201.3@tcp:3:cat.0 Request processed in 234us (498us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788271842.891817:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 8 00002000:00100000:3.0:1788271842.891824:0:8401:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff8f6d81f43100 x1875138577541504/t0(0) o3->ef8df183-a1b1-4e56-bce5-924a894c4a71@192.168.201.3@tcp:748/0 lens 488/4536 e 0 to 0 dl 1788271853 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788271842.891833:0:8401:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f6d81f43100 with x1875138577541504 ext(0->4095) 00002000:00010000:3.0:1788271842.891836:0:8401:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f6d81f43100 00000040:00080000:0.0:1788271843.102678:0:13766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788271843.234187:0:13762:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788271843.234198:0:13762:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788271843.234218:0:13762:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788271843.234226:0:13762:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788271843.252020:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271843.252057:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271843.252095:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271843.252119:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271843.252146:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271843.252188:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271843.252215:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577541888 00000100:00100000:3.0:1788271843.252224:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577541888 00000100:00100000:3.0:1788271843.252282:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577542144 00000100:00100000:3.0:1788271843.252285:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577542144 00000100:00100000:3.0:1788271843.252300:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577541760 00000100:00100000:3.0:1788271843.252302:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577541760 00000100:00100000:3.0:1788271843.252312:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577542272 00000100:00100000:3.0:1788271843.252314:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577542272 00000100:00100000:3.0:1788271843.252330:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 315 00000100:00100000:3.0:1788271843.252339:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2396:x1875138577541888:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271843.252410:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2396:x1875138577541888:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 72us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271843.252418:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 315 00000100:00100000:3.0:1788271843.252437:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 316 00000100:00100000:3.0:1788271843.252443:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:956fb91b-4885-4e88-90fb-3061936b51ca+5:2396:x1875138577542144:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271843.252468:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:956fb91b-4885-4e88-90fb-3061936b51ca+5:2396:x1875138577542144:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 26us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271843.252474:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 316 00000100:00100000:3.0:1788271843.252484:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 317 00000100:00100000:3.0:1788271843.252490:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+32:2396:x1875138577541760:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271843.252511:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef8df183-a1b1-4e56-bce5-924a894c4a71+32:2396:x1875138577541760:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 21us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271843.252516:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 317 00000100:00100000:3.0:1788271843.252525:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 318 00000100:00100000:3.0:1788271843.252530:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:956fb91b-4885-4e88-90fb-3061936b51ca+5:2396:x1875138577542272:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271843.252559:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:956fb91b-4885-4e88-90fb-3061936b51ca+5:2396:x1875138577542272:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 29us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271843.252564:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 318 00000100:00100000:3.0:1788271843.252586:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577542016 00000100:00100000:3.0:1788271843.252589:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577542016 00000100:00100000:3.0:1788271843.252613:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 126 00000100:00100000:3.0:1788271843.252657:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2396:x1875138577542016:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271843.252683:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2396:x1875138577542016:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 65us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271843.252689:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 126 00000100:00080000:3.0:1788271843.252703:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788271843.252707:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788271843.252709:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788271843.254695:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577541632 00000100:00100000:1.0:1788271843.254706:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577541632 00000100:00100000:1.0:1788271843.254770:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 388 00000100:00100000:1.0:1788271843.254780:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2396:x1875138577541632:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271843.254845:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2396:x1875138577541632:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 66us (2835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271843.254852:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 388 00010000:00010000:1.0:1788271843.756341:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271843.871773:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8336ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590163712:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788271843.871842:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271843.871912:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590163712 00000100:00100000:3.0:1788271843.871921:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590163712 00000100:00100000:0.0:1788271843.871926:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788271843.871935:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590163840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788271843.871965:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271843.871974:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788271843.871984:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8336a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590163712:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788271843.872014:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590163840 00000004:00000024:3.0:1788271843.872019:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788271843.872020:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590163840 00000100:00100000:0.0:1788271843.872064:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788271843.872073:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3606:x1875138590163840:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788271843.872080:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8336a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590163712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271843.872089:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00002000:00000024:0.0:1788271843.872097:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788271843.872135:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3606:x1875138590163840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271843.872141:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:0.0:1788271843.872158:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788271843.872189:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590163840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788271843.872203:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8336ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590163712:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788271843.872516:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788271843.872529:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590163968:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788271843.872566:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271843.872593:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590163968 00000100:00100000:2.0:1788271843.872599:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590163968 00000100:00080000:3.0:1788271843.872650:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788271843.872661:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788271843.872670:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebcd55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590163968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788271843.872682:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788271843.872736:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebcd55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590163968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271843.872743:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788271843.872924:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590163968:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788271844.769976:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271844.894442:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590164096:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788271844.894528:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271844.894979:0:14136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590164096 00000100:00100000:1.0:1788271844.894987:0:14136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590164096 00000100:00100000:1.0:1788271844.895106:0:14136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788271844.895117:0:14136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590164096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788271844.895153:0:14136:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788271844.895215:0:14136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590164096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271844.895222:0:14136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788271844.895290:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590164096:0@lo:41:osp-pre-0-1.0 00000001:00080000:2.0:1788271844.899439:0:8391:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000100:00100000:1.0:1788271845.406424:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83aa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590164224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788271845.406496:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271845.406584:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590164224 00000100:00100000:1.0:1788271845.406591:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590164224 00000100:00100000:0.0:1788271845.406973:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875138590164480:0@lo:400:kworker.0 00000100:00100000:3.0:1788271845.406979:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8336b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590164608:0@lo:400:kworker.0 00000100:00100000:0.0:1788271845.407019:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271845.407026:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271845.407144:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590164480 00000100:00100000:3.0:1788271845.407148:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590164480 00000100:00100000:3.0:1788271845.407224:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788271845.407234:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8336a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875138590164480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271845.407397:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8336a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875138590164480:12345-0@lo:400:kworker.0 Request processed in 164us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271845.407405:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00080000:2.0:1788271845.407669:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788271845.407682:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8336ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590164352:0@lo:400:kworker.0 00000100:00100000:2.0:1788271845.407716:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271845.408102:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590164608 00000100:00100000:3.0:1788271845.408108:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590164608 00000100:00100000:3.0:1788271845.408138:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788271845.408144:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590164608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271845.408181:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590164608:12345-0@lo:400:kworker.0 Request processed in 37us (1156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271845.408187:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788271845.408300:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590164352 00000100:00100000:2.0:1788271845.408304:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590164352 00000100:00100000:2.0:1788271845.408372:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1788271845.408380:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3607:x1875138590164352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271845.408417:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3607:x1875138590164352:12345-0@lo:400:kworker.0 Request processed in 38us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271845.408424:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1788271845.408545:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875138590164480:0@lo:400:kworker.0 00000100:00100000:2.0:1788271845.408549:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8336b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590164608:0@lo:400:kworker.0 00000100:00100000:2.0:1788271845.408559:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8336aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3609:1875138590165120:0@lo:400:kworker.0 00000100:00100000:0.0:1788271845.408567:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3608:1875138590164992:0@lo:400:kworker.0 00000100:00100000:2.0:1788271845.408592:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271845.408640:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3609:1875138590165632:0@lo:400:kworker.0 00000100:00100000:2.0:1788271845.408664:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271845.408708:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590165120 00000100:00100000:2.0:1788271845.408712:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590165120 00000100:00100000:2.0:1788271845.408743:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590165632 00000100:00100000:2.0:1788271845.408746:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590165632 00000100:00100000:2.0:1788271845.408768:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1788271845.408774:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875138590165120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271845.408868:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8336ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590164352:0@lo:400:kworker.0 00000100:00100000:3.0:1788271845.408876:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8336b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590164864:0@lo:400:kworker.0 00000100:00100000:3.0:1788271845.408907:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271845.408931:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590165376:0@lo:400:kworker.0 00000100:00100000:3.0:1788271845.408955:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271845.408974:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590165888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788271845.409007:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271845.409035:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788271845.409043:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8336bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875138590164736:0@lo:400:kworker.0 00000100:00100000:3.0:1788271845.409066:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271845.409082:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590165248:0@lo:400:kworker.0 00000100:00100000:3.0:1788271845.409106:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271845.409123:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590165760:0@lo:400:kworker.0 00000100:00100000:3.0:1788271845.409144:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271845.409170:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590165376 00000100:00100000:3.0:1788271845.409175:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590165376 00000100:00100000:3.0:1788271845.409202:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590165248 00000100:00100000:3.0:1788271845.409205:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590165248 00000100:00100000:3.0:1788271845.409221:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590165760 00000100:00100000:3.0:1788271845.409224:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590165760 00000100:00100000:2.0:1788271845.409307:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875138590165120:12345-0@lo:400:kworker.0 Request processed in 532us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271845.409314:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1788271845.409326:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590164736 00000100:00100000:2.0:1788271845.409330:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590164736 00000100:00100000:2.0:1788271845.409344:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788271845.409350:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875138590165632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271845.409382:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875138590165632:12345-0@lo:400:kworker.0 Request processed in 31us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271845.409388:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788271845.409400:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1788271845.409406:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875138590164736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271845.409435:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875138590164736:12345-0@lo:400:kworker.0 Request processed in 30us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271845.409440:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00080000:2.0:1788271845.409457:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788271845.409461:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788271845.409463:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788271845.409477:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590165888 00000100:00100000:2.0:1788271845.409481:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590165888 00000100:00100000:2.0:1788271845.409505:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788271845.409512:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3607:x1875138590165888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788271845.409534:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788271845.409564:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3607:x1875138590165888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271845.409569:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788271845.409602:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788271845.409610:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590165376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271845.409665:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590165376:12345-0@lo:400:kworker.0 Request processed in 57us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271845.409713:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788271845.409727:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebcb82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590165248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271845.409767:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebcb82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590165248:12345-0@lo:400:kworker.0 Request processed in 42us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271845.409773:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788271845.409788:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788271845.409794:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590165760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271845.409820:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590165760:12345-0@lo:400:kworker.0 Request processed in 27us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271845.409826:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00010000:00080000:2.0:1788271845.409872:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d8336aa00 x1875138590165120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271845.409885:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8336aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3609:1875138590165120:0@lo:400:kworker.0 00010000:00080000:2.0:1788271845.409901:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83368380 x1875138590165632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271845.409910:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3609:1875138590165632:0@lo:400:kworker.0 00000100:00100000:2.0:1788271845.409935:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271845.409957:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3608:1875138590165504:0@lo:400:kworker.0 00000100:00100000:2.0:1788271845.409979:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271845.410006:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590164992 00000100:00100000:2.0:1788271845.410010:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590164992 00000100:00100000:2.0:1788271845.410037:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590165504 00000100:00100000:2.0:1788271845.410040:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590165504 00000100:00100000:2.0:1788271845.410058:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1788271845.410064:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875138590164992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271845.410097:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875138590164992:12345-0@lo:400:kworker.0 Request processed in 32us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271845.410109:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1788271845.410121:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1788271845.410126:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875138590165504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271845.410153:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875138590165504:12345-0@lo:400:kworker.0 Request processed in 27us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271845.410158:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00080000:2.0:1788271845.410171:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788271845.410191:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3608:1875138590164992:0@lo:400:kworker.0 00000100:00100000:2.0:1788271845.410200:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3608:1875138590165504:0@lo:400:kworker.0 00000100:00100000:2.0:1788271845.410222:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8336bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875138590164736:0@lo:400:kworker.0 00000100:00100000:2.0:1788271845.410233:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590165248:0@lo:400:kworker.0 00000100:00100000:2.0:1788271845.410255:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83369500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590165760:0@lo:400:kworker.0 00000100:00100000:2.0:1788271845.410265:0:3607:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1788271845.410270:0:3607:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:2.0:1788271845.410295:0:3607:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f6d8406f100, transno 4294967311 00000100:00100000:2.0:1788271845.410308:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590165376:0@lo:400:kworker.0 00000100:00100000:2.0:1788271845.410327:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590165888:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788271845.410368:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788271845.410377:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3606:x1875138590164224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788271845.410387:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788271845.410416:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3606:x1875138590164224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (3922us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271845.410422:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788271845.410439:0:14136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590164864 00000100:00100000:1.0:1788271845.410442:0:14136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590164864 00000100:00100000:1.0:1788271845.410463:0:14136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788271845.410468:0:14136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590164864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271845.410500:0:14136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590164864:12345-0@lo:400:kworker.0 Request processed in 32us (1593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271845.410506:0:14136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788271845.410537:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83aa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590164224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788271845.410685:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8336b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590164864:0@lo:400:kworker.0 00000100:00100000:3.0:1788271845.413962:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000001:00080000:1.0:1788271845.415478:0:6462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:1.0:1788271845.415507:0:6462:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f6d82d9be40 refcount 2 committed 0 result 0 batchid 8 00010000:00010000:3.0:1788271845.415508:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7200/0x99288105fd38f747 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788271845.415512:0:6462:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f6e91718300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f6d82d9b3c0 00000020:00080000:1.0:1788271845.415516:0:6462:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f6e91718c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f6eb0c66c00 00010000:00010000:3.0:1788271845.415519:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7200/0x99288105fd38f747 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271845.415527:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7200/0x99288105fd38f747 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271845.415533:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f7200 already unused, calling callback (ffffffffc174a4f0) 00000020:00080000:1.0:1788271845.415539:0:6462:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:3.0:1788271845.415543:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7200/0x99288105fd38f747 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271845.415551:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7200/0x99288105fd38f747 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271845.415571:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f6e920a2700) 00010000:00010000:3.0:1788271845.415574:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271845.415579:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7200/0x99288105fd38f747 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271845.415585:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7200/0x99288105fd38f747 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9899 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788271845.415959:0:6515:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1788271845.416026:0:6515:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1788271845.789875:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788271845.931857:0:9475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967326 is committed 00000001:00080000:0.0:1788271845.931872:0:9475:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00010000:00010000:0.0:1788271846.813758:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271847.817447:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271847.817651:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577542400 00000100:00100000:0.0:1788271847.817661:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577542400 00000100:00100000:0.0:1788271847.817734:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 255 00000100:00100000:0.0:1788271847.817744:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+18:12153:x1875138577542400:12345-192.168.201.3@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788271847.817861:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+18:12153:x1875138577542400:12345-192.168.201.3@tcp:60:lhsmtool_posix.0 Request processed in 118us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271847.817869:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 255 00000100:00080000:2.0:1788271847.817928:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788271847.821555:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271847.823441:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577542528 00000100:00100000:2.0:1788271847.823468:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577542528 00000100:00100000:2.0:1788271847.823597:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 256 00000100:00100000:2.0:1788271847.823610:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:12153:x1875138577542528:12345-192.168.201.3@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788271847.823735:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:12153:x1875138577542528:12345-192.168.201.3@tcp:60:lhsmtool_posix.0 Request processed in 130us (2193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271847.823742:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 256 00000100:00080000:0.0:1788271847.824075:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788271847.829897:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271847.831568:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577542784 00000100:00100000:0.0:1788271847.831584:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577542784 00000100:00100000:0.0:1788271847.831679:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 65 00000100:00100000:0.0:1788271847.831691:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+18:12153:x1875138577542784:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788271847.832214:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+19:12153:x1875138577542784:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 Request processed in 523us (2324us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788271847.832223:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 65 00010000:00010000:1.0:1788271847.838533:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271848.152995:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271848.153157:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577542912 00000100:00100000:2.0:1788271848.153166:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577542912 00000100:00100000:2.0:1788271848.153250:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 257 00000100:00100000:2.0:1788271848.153262:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:956fb91b-4885-4e88-90fb-3061936b51ca+5:12965:x1875138577542912:12345-192.168.201.3@tcp:101:lsof.0 00010000:00010000:2.0:1788271848.153283:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271848.153306:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7200/0x99288105fd38f7d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd7c4 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271848.153375:0:6484:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7a00/0x99288105fd38f7da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271848.153389:0:6484:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7a00/0x99288105fd38f7da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271848.153401:0:6484:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7a00/0x99288105fd38f7da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271848.153463:0:6484:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788271848.153467:0:6484:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788271848.153489:0:6484:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7a00/0x99288105fd38f7da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6484 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271848.153515:0:6484:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7200/0x99288105fd38f7d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd7c4 expref: 7 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271848.153555:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7a00/0x99288105fd38f7da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd7c4 expref: 6 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271848.153564:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6d83055900) 00010000:00010000:2.0:1788271848.153567:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788271848.153571:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d833f7a00, rc 0) 00000100:00100000:2.0:1788271848.153678:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:956fb91b-4885-4e88-90fb-3061936b51ca+6:12965:x1875138577542912:12345-192.168.201.3@tcp:101:lsof.0 Request processed in 418us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271848.153686:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 257 00000100:00080000:0.0:1788271848.153878:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788271848.351241:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271848.351281:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271848.351301:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271848.351341:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271848.351366:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577543424 00000100:00100000:3.0:1788271848.351374:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577543424 00000100:00100000:3.0:1788271848.351439:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 325 00000100:00100000:3.0:1788271848.351447:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:956fb91b-4885-4e88-90fb-3061936b51ca+5:2396:x1875138577543424:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271848.351513:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:956fb91b-4885-4e88-90fb-3061936b51ca+5:2396:x1875138577543424:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 67us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271848.351521:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 325 00000100:00080000:3.0:1788271848.351543:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788271848.351671:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577543296 00000100:00100000:1.0:1788271848.351675:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577543296 00000100:00100000:1.0:1788271848.351706:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577543168 00000100:00100000:1.0:1788271848.351716:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577543168 00000100:00100000:1.0:1788271848.351732:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 130 00000100:00100000:1.0:1788271848.351736:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83250380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2396:x1875138577543296:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271848.351760:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83250380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2396:x1875138577543296:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 24us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271848.351765:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 130 00000100:00100000:1.0:1788271848.351773:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 131 00000100:00100000:1.0:1788271848.351788:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2396:x1875138577543168:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271848.351824:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2396:x1875138577543168:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 46us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271848.351830:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 131 00000100:00100000:2.0:1788271848.351986:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577543040 00000100:00100000:2.0:1788271848.351989:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577543040 00000100:00100000:2.0:1788271848.352017:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 390 00000100:00100000:2.0:1788271848.352022:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2396:x1875138577543040:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788271848.352045:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2396:x1875138577543040:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 24us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271848.352050:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 390 00000100:00080000:3.0:1788271848.352196:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788271848.352199:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788271848.861912:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271848.989943:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788271848.989971:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8336b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590166016:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788271848.990049:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271848.990183:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590166016 00000100:00100000:0.0:1788271848.990192:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590166016 00000100:00100000:0.0:1788271848.990249:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788271848.990259:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590166016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788271848.990292:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788271848.990354:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590166016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271848.990362:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788271848.990454:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8336b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590166016:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788271848.990858:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590166144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788271848.990892:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271848.990974:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590166144 00000100:00100000:2.0:1788271848.990980:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590166144 00000100:00100000:2.0:1788271848.991035:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788271848.991043:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590166144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788271848.991063:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788271848.991098:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590166144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271848.991104:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:0.0:1788271848.991163:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788271848.991234:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590166144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788271848.991519:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788271848.991530:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590166272:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788271848.991564:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271848.991759:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590166272 00000100:00100000:2.0:1788271848.991774:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590166272 00000100:00100000:2.0:1788271848.991831:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788271848.991839:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83250700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590166272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788271848.991852:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788271848.991895:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83250700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590166272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271848.991902:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:0.0:1788271848.991960:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788271848.992367:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590166272:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788271849.885892:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271850.013829:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590166400:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788271850.013911:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271850.014022:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590166400 00000100:00100000:3.0:1788271850.014029:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590166400 00000100:00100000:3.0:1788271850.014068:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788271850.014078:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590166400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788271850.014108:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788271850.014958:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590166400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 880us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271850.014968:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788271850.014982:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590166400:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788271850.526366:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83aab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875138590166656:0@lo:400:kworker.0 00000100:00100000:2.0:1788271850.526463:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271850.526526:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3609:1875138590167168:0@lo:400:kworker.0 00000100:00100000:2.0:1788271850.526549:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271850.526564:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3609:1875138590167680:0@lo:400:kworker.0 00000100:00100000:2.0:1788271850.526585:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271850.526600:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590168192:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788271850.526640:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271850.526674:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1788271850.526681:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83aa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590166528:0@lo:400:kworker.0 00000100:00100000:2.0:1788271850.526711:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271850.526732:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3609:1875138590167040:0@lo:400:kworker.0 00000100:00100000:2.0:1788271850.526754:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271850.526784:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3609:1875138590167552:0@lo:400:kworker.0 00000100:00100000:2.0:1788271850.526818:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271850.526835:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590168064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788271850.526857:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271850.526901:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590166656 00000100:00100000:2.0:1788271850.526929:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590166656 00000100:00100000:2.0:1788271850.526980:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590167168 00000100:00100000:2.0:1788271850.526983:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590167168 00000100:00100000:2.0:1788271850.527009:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590167680 00000100:00100000:2.0:1788271850.527011:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590167680 00000100:00100000:2.0:1788271850.527023:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590167040 00000100:00100000:2.0:1788271850.527026:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590167040 00000100:00100000:2.0:1788271850.527038:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590167552 00000100:00100000:2.0:1788271850.527040:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590167552 00000100:00100000:2.0:1788271850.527054:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1788271850.527063:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875138590166656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271850.527131:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875138590166656:12345-0@lo:400:kworker.0 Request processed in 68us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271850.527139:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1788271850.527158:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1788271850.527164:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875138590167168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271850.527192:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3609:x1875138590167168:12345-0@lo:400:kworker.0 Request processed in 29us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271850.527198:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1788271850.527209:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1788271850.527215:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875138590167680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271850.527241:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875138590167680:12345-0@lo:400:kworker.0 Request processed in 26us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271850.527247:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1788271850.527258:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1788271850.527264:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875138590167040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271850.527287:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875138590167040:12345-0@lo:400:kworker.0 Request processed in 24us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271850.527303:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1788271850.527315:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1788271850.527320:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875138590167552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271850.527347:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875138590167552:12345-0@lo:400:kworker.0 Request processed in 27us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271850.527353:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1788271850.527382:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590166528 00000100:00100000:2.0:1788271850.527386:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590166528 00000100:00100000:2.0:1788271850.527414:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1788271850.527420:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3609:x1875138590166528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271850.527449:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3609:x1875138590166528:12345-0@lo:400:kworker.0 Request processed in 29us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271850.527455:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1788271850.527503:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590168192 00000100:00100000:2.0:1788271850.527507:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590168192 00000100:00100000:2.0:1788271850.527535:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590168064 00000100:00100000:2.0:1788271850.527538:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590168064 00000100:00100000:2.0:1788271850.527554:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788271850.527559:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590168192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788271850.527584:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788271850.527645:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590168192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271850.527651:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788271850.527662:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788271850.527668:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590168064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788271850.527677:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788271850.527708:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590168064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271850.527714:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788271850.527776:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83aa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590166528:0@lo:400:kworker.0 00000100:00100000:2.0:1788271850.527794:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3609:1875138590167040:0@lo:400:kworker.0 00000100:00100000:2.0:1788271850.527804:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3609:1875138590167552:0@lo:400:kworker.0 00000100:00100000:2.0:1788271850.527815:0:3609:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967326 gen 2 00000004:00080000:2.0:1788271850.527822:0:3609:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f6d81f40700, transno 4294967324 00000004:00080000:2.0:1788271850.527839:0:3609:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967326 committed transno 4294967326 00000100:00100000:2.0:1788271850.527875:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590168064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788271850.527888:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83aab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875138590166656:0@lo:400:kworker.0 00010000:00080000:2.0:1788271850.527901:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d816cd180 x1875138590167168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271850.527912:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3609:1875138590167168:0@lo:400:kworker.0 00010000:00080000:2.0:1788271850.527923:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d816cf480 x1875138590167680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271850.527930:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3609:1875138590167680:0@lo:400:kworker.0 00000100:00100000:2.0:1788271850.527943:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590168192:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788271850.528157:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83aaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590166912:0@lo:400:kworker.0 00000100:00100000:2.0:1788271850.528192:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271850.528216:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590167424:0@lo:400:kworker.0 00000100:00100000:2.0:1788271850.528239:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271850.528279:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590167936:0@lo:400:kworker.0 00000100:00100000:2.0:1788271850.528299:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271850.528319:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788271850.528325:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83aa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875138590166784:0@lo:400:kworker.0 00000100:00100000:2.0:1788271850.528347:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271850.528364:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590167296:0@lo:400:kworker.0 00000100:00100000:2.0:1788271850.528384:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271850.528399:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590167808:0@lo:400:kworker.0 00000100:00100000:2.0:1788271850.528417:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271850.528448:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590167424 00000100:00100000:2.0:1788271850.528453:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590167424 00000100:00100000:2.0:1788271850.528491:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590167936 00000100:00100000:2.0:1788271850.528494:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590167936 00000100:00100000:2.0:1788271850.528505:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590167296 00000100:00100000:2.0:1788271850.528507:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590167296 00000100:00100000:2.0:1788271850.528517:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590167808 00000100:00100000:2.0:1788271850.528520:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590167808 00000100:00100000:2.0:1788271850.528531:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788271850.528538:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590167424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271850.528581:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590167424:12345-0@lo:400:kworker.0 Request processed in 42us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271850.528588:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788271850.528600:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788271850.528606:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590167936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271850.528660:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590167936:12345-0@lo:400:kworker.0 Request processed in 54us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271850.528666:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788271850.528684:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788271850.528690:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590167296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271850.528721:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590167296:12345-0@lo:400:kworker.0 Request processed in 31us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271850.528727:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788271850.528736:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788271850.528742:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590167808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271850.528778:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590167808:12345-0@lo:400:kworker.0 Request processed in 36us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271850.528784:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788271850.528813:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590167296:0@lo:400:kworker.0 00000100:00100000:2.0:1788271850.528824:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590167808:0@lo:400:kworker.0 00000100:00100000:2.0:1788271850.528832:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590167424:0@lo:400:kworker.0 00000100:00100000:2.0:1788271850.528840:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590167936:0@lo:400:kworker.0 00000100:00100000:2.0:1788271850.528860:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590166784 00000100:00100000:2.0:1788271850.528863:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590166784 00000100:00100000:2.0:1788271850.528893:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1788271850.528900:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875138590166784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271850.528934:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875138590166784:12345-0@lo:400:kworker.0 Request processed in 34us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271850.528940:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1788271850.528968:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83aa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875138590166784:0@lo:400:kworker.0 00000100:00080000:2.0:1788271850.529031:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788271850.529037:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788271850.529047:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788271850.529050:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788271850.529084:0:14136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590166912 00000100:00100000:2.0:1788271850.529088:0:14136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590166912 00000100:00100000:2.0:1788271850.529117:0:14136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788271850.529123:0:14136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590166912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271850.529162:0:14136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590166912:12345-0@lo:400:kworker.0 Request processed in 39us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271850.529168:0:14136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788271850.529395:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83aaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590166912:0@lo:400:kworker.0 00000001:00080000:2.0:1788271850.534470:0:6462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:2.0:1788271850.534498:0:6462:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1788271850.534522:0:6515:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1788271850.534537:0:6515:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1788271850.910916:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788271851.171403:0:15025:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 10:10:48 (1788271848) 00010000:00010000:1.0:1788271851.936206:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271852.957930:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788271853.342524:0:13766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788271853.470824:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271853.470871:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271853.470907:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271853.470931:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271853.471160:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577543808 00000100:00100000:0.0:1788271853.471169:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577543808 00000100:00100000:0.0:1788271853.471229:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577543680 00000100:00100000:0.0:1788271853.471232:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577543680 00000100:00100000:0.0:1788271853.471257:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 332 00000100:00100000:0.0:1788271853.471268:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2396:x1875138577543808:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788271853.471355:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2396:x1875138577543808:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 89us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271853.471362:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 332 00000100:00100000:0.0:1788271853.471379:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 333 00000100:00100000:0.0:1788271853.471385:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+18:2395:x1875138577543680:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788271853.471424:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+18:2395:x1875138577543680:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 39us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271853.471429:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 333 00000100:00080000:0.0:1788271853.471580:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788271853.471585:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788271853.471595:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577543936 00000100:00100000:0.0:1788271853.471599:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577543936 00000100:00100000:0.0:1788271853.471667:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 136 00000100:00100000:0.0:1788271853.471675:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83252680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577543936:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788271853.471734:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83252680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2395:x1875138577543936:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 60us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271853.471741:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 136 00000100:00080000:0.0:1788271853.471757:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788271853.472537:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271853.472938:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577543552 00000100:00100000:1.0:1788271853.472947:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577543552 00000100:00100000:1.0:1788271853.473005:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 392 00000100:00100000:1.0:1788271853.473014:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2396:x1875138577543552:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271853.473064:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2396:x1875138577543552:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 51us (2250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271853.473083:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 392 00000100:00100000:0.0:1788271853.473593:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577544192 00000100:00100000:0.0:1788271853.473599:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577544192 00000100:00100000:0.0:1788271853.473746:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 334 00000100:00100000:0.0:1788271853.473754:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:956fb91b-4885-4e88-90fb-3061936b51ca+6:2395:x1875138577544192:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788271853.473791:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:956fb91b-4885-4e88-90fb-3061936b51ca+6:2395:x1875138577544192:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 39us (2833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271853.473798:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 334 00000040:00080000:2.0:1788271853.473936:0:13762:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788271853.473942:0:13762:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788271853.474056:0:13762:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788271853.474063:0:13762:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00080000:1.0:1788271853.474159:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271853.477824:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271853.477868:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271853.477964:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577544320 00000100:00100000:0.0:1788271853.477973:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577544320 00000100:00100000:0.0:1788271853.478043:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 335 00000100:00100000:0.0:1788271853.478053:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:956fb91b-4885-4e88-90fb-3061936b51ca+5:2396:x1875138577544320:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788271853.478122:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:956fb91b-4885-4e88-90fb-3061936b51ca+5:2396:x1875138577544320:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 71us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271853.478130:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 335 00000100:00080000:1.0:1788271853.478478:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788271853.478810:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577544064 00000100:00100000:2.0:1788271853.478816:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577544064 00000100:00100000:2.0:1788271853.478873:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 137 00000100:00100000:2.0:1788271853.478885:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2396:x1875138577544064:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788271853.478924:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2396:x1875138577544064:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 43us (1110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271853.478930:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 137 00000100:00080000:1.0:1788271853.478995:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788271853.985143:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271854.112328:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590168448:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788271854.112397:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271854.112480:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788271854.112487:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590168320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788271854.112517:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271854.112546:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590168448 00000100:00100000:2.0:1788271854.112554:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590168448 00000100:00100000:2.0:1788271854.112596:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788271854.112604:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590168448:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788271854.112664:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788271854.112719:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590168448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271854.112727:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788271854.112749:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590168320 00000100:00100000:2.0:1788271854.112754:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590168320 00000100:00100000:2.0:1788271854.112786:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788271854.112793:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590168320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788271854.112812:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788271854.112843:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590168320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271854.112850:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788271854.112894:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590168320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788271854.112907:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590168448:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788271854.113008:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788271854.113019:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590168576:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788271854.113049:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271854.115345:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590168576 00000100:00100000:2.0:1788271854.115358:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590168576 00000100:00100000:2.0:1788271854.115426:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788271854.115435:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590168576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788271854.115459:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788271854.115546:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590168576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (2496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271854.115554:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788271854.115690:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590168576:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788271854.116441:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788271855.005894:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271855.133994:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788271855.134029:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83aa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590168704:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788271855.134124:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271855.134349:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590168704 00000100:00100000:1.0:1788271855.134360:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590168704 00000100:00100000:1.0:1788271855.134432:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788271855.134445:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590168704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788271855.134604:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788271855.134706:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590168704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 264us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271855.134714:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788271855.134807:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83aa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590168704:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788271855.152863:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271855.153182:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577544576 00000100:00100000:0.0:1788271855.153207:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577544576 00000100:00100000:0.0:1788271855.153323:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 66 00000100:00100000:0.0:1788271855.153337:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+18:13188:x1875138577544576:12345-192.168.201.3@tcp:35:umount.0 00000100:00100000:0.0:1788271855.153750:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+19:13188:x1875138577544576:12345-192.168.201.3@tcp:35:umount.0 Request processed in 415us (900us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1788271855.153760:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 66 00000100:00080000:1.0:1788271855.154028:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788271855.155866:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271855.155971:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577544832 00000100:00100000:0.0:1788271855.155982:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577544832 00000100:00100000:0.0:1788271855.156048:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 67 00000100:00100000:0.0:1788271855.156061:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+19:13188:x1875138577544832:12345-192.168.201.3@tcp:35:umount.0 00000100:00100000:0.0:1788271855.156425:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+20:13188:x1875138577544832:12345-192.168.201.3@tcp:35:umount.0 Request processed in 365us (569us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1788271855.156434:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 67 00000100:00100000:2.0:1788271855.158735:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271855.158895:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577545088 00000100:00100000:0.0:1788271855.158907:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577545088 00000100:00100000:0.0:1788271855.159038:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 68 00000100:00100000:0.0:1788271855.159051:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb369c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+20:13188:x1875138577545088:12345-192.168.201.3@tcp:35:umount.0 00000100:00100000:0.0:1788271855.159439:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb369c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+21:13188:x1875138577545088:12345-192.168.201.3@tcp:35:umount.0 Request processed in 390us (717us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1788271855.159450:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 68 00000100:00100000:1.0:1788271855.161772:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271855.162033:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577545344 00000100:00100000:0.0:1788271855.162045:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577545344 00000100:00100000:0.0:1788271855.162117:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 69 00000100:00100000:0.0:1788271855.162129:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+21:13188:x1875138577545344:12345-192.168.201.3@tcp:35:umount.0 00000100:00100000:0.0:1788271855.162821:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+22:13188:x1875138577545344:12345-192.168.201.3@tcp:35:umount.0 Request processed in 690us (1059us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1788271855.162854:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 69 00000100:00100000:1.0:1788271855.171738:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271855.171784:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271855.171915:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271855.173036:0:9485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577545472 00000100:00100000:0.0:1788271855.173052:0:9485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577545472 00000100:00100000:0.0:1788271855.173124:0:9485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577545728 00000100:00100000:0.0:1788271855.173128:0:9485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577545728 00000100:00100000:0.0:1788271855.173147:0:9485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577545600 00000100:00100000:0.0:1788271855.173150:0:9485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577545600 00000100:00100000:0.0:1788271855.173173:0:9485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 18 00000100:00100000:0.0:1788271855.173184:0:9485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a94beb9-7f16-4b5a-842a-fac2e5234617+15:2395:x1875138577545472:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271855.173216:0:9485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271855.173243:0:9485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4ed4e00/0x99288105fd38e733 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd317 expref: 15 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271855.173267:0:9485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271855.173343:0:9485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a94beb9-7f16-4b5a-842a-fac2e5234617+14:2395:x1875138577545472:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 161us (1620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271855.173351:0:9485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 18 00000100:00100000:0.0:1788271855.173372:0:9485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 19 00000100:00100000:0.0:1788271855.173379:0:9485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a94beb9-7f16-4b5a-842a-fac2e5234617+13:2395:x1875138577545728:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271855.173387:0:9485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271855.173402:0:9485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4ed4200/0x99288105fd38e9cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3f0 expref: 13 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271855.173412:0:9485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271855.173432:0:9485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a94beb9-7f16-4b5a-842a-fac2e5234617+12:2395:x1875138577545728:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 53us (1647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271855.173439:0:9485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 19 00000100:00100000:0.0:1788271855.173845:0:9485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 20 00000100:00100000:0.0:1788271855.173855:0:9485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a94beb9-7f16-4b5a-842a-fac2e5234617+11:2395:x1875138577545600:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271855.173864:0:9485:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271855.173874:0:9485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4e20e00/0x99288105fd38e6f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd2d8 expref: 11 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271855.173886:0:9485:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271855.173919:0:9485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:2395:x1875138577545600:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 66us (2005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271855.173926:0:9485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 20 00000100:00100000:1.0:1788271855.178612:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271855.178858:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577546112 00000100:00100000:3.0:1788271855.178873:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577546112 00000100:00080000:1.0:1788271855.179011:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788271855.179118:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 81 00000100:00100000:3.0:1788271855.179131:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+7:2394:x1875138577546112:12345-192.168.201.3@tcp:9:umount.0 00000020:00000080:3.0:1788271855.179204:0:8398:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38ed45 00000020:00010000:3.0:1788271855.179214:0:8398:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8f6d838cb000: total 0 00000100:00080000:3.0:1788271855.179221:0:8398:0:(import.c:65:import_set_state_nolock()) ffff8f6d838cc800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788271855.179283:0:8398:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967326 00000020:00010000:1.0:1788271855.179572:0:6472:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8f6d838cb000: total 0 00010000:00010000:1.0:1788271855.179644:0:6472:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f6d838cb000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788271855.179722:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071f8bb7c/0x99288105fd38f7cc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd7bd expref: 5 pid: 8398 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271855.179768:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000130a941c/0x99288105fd38f0fd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5da expref: 4 pid: 12967 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271855.179789:0:6472:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f6d838cb000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1788271855.179802:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271855.179804:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271855.179806:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271855.180002:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2394:x1875138577546112:12345-192.168.201.3@tcp:9:umount.0 Request processed in 357us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271855.180014:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 81 00000100:00100000:1.0:1788271855.189904:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271855.190031:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577546240 00000100:00100000:0.0:1788271855.190043:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577546240 00000100:00100000:0.0:1788271855.190138:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 82 00000100:00100000:0.0:1788271855.190151:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2394:x1875138577546240:12345-192.168.201.3@tcp:9:umount.0 00000020:00000080:0.0:1788271855.190202:0:12967:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38eacf 00000100:00080000:0.0:1788271855.190215:0:12967:0:(import.c:65:import_set_state_nolock()) ffff8f6d83920000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788271855.190273:0:12967:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1788271855.190481:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:ef8df183-a1b1-4e56-bce5-924a894c4a71+2:2394:x1875138577546240:12345-192.168.201.3@tcp:9:umount.0 Request processed in 332us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271855.190490:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 82 00010000:00010000:3.0:1788271855.190560:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788271855.190719:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788271855.211403:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271855.212332:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577547264 00000100:00100000:0.0:1788271855.212349:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577547264 00000100:00100000:0.0:1788271855.212441:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 258 00000100:00100000:0.0:1788271855.212454:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+22:2394:x1875138577547264:12345-192.168.201.3@tcp:39:umount.0 00000020:00000080:0.0:1788271855.212502:0:6485:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e709 00000020:00010000:0.0:1788271855.212527:0:6485:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8f6d83211000: total 0 00000100:00080000:0.0:1788271855.212534:0:6485:0:(import.c:65:import_set_state_nolock()) ffff8f6d83212000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788271855.212592:0:6485:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:0.0:1788271855.212863:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef8df183-a1b1-4e56-bce5-924a894c4a71+21:2394:x1875138577547264:12345-192.168.201.3@tcp:39:umount.0 Request processed in 409us (1473us total) trans 4294967528 rc 0/0 00000100:00100000:0.0:1788271855.212872:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 258 00000020:00010000:1.0:1788271855.213456:0:8412:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8f6d83211000: total 0 00010000:00010000:1.0:1788271855.213527:0:8412:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f6d83211000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788271855.213570:0:8412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f6d82060100) 00010000:00010000:1.0:1788271855.213575:0:8412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788271855.213585:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f6c00/0x99288105fd38f182 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5fd expref: 20 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271855.213609:0:8412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6e8d1d8e00) 00010000:00010000:1.0:1788271855.213612:0:8412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788271855.213661:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4e00/0x99288105fd38efde lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd58d expref: 19 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271855.213713:0:8412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f6e90141400) 00010000:00010000:1.0:1788271855.213717:0:8412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788271855.213721:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1a00/0x99288105fd38ea2e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3fe expref: 18 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271855.213744:0:8412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6d82060700) 00010000:00010000:1.0:1788271855.213746:0:8412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788271855.213750:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38f78d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd7a8 expref: 17 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271855.213763:0:8412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6d82060700) 00010000:00010000:1.0:1788271855.213765:0:8412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788271855.213769:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5200/0x99288105fd38f7b7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd7b6 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271855.213781:0:8412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f6d83058800) 00010000:00010000:1.0:1788271855.213783:0:8412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788271855.213787:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4079e00/0x99288105fd38eaa5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd41a expref: 15 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271855.213799:0:8412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6e8d1d8e00) 00010000:00010000:1.0:1788271855.213801:0:8412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788271855.213805:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d600/0x99288105fd38f0be lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5c5 expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271855.213817:0:8412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f6d82060100) 00010000:00010000:1.0:1788271855.213820:0:8412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788271855.213831:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4ed5400/0x99288105fd38f46f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd6d6 expref: 13 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271855.213852:0:8412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6d83055900) 00010000:00010000:1.0:1788271855.213854:0:8412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788271855.213858:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e92d33000/0x99288105fd38f166 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5f6 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271855.213871:0:8412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f6e90141900) 00010000:00010000:1.0:1788271855.213874:0:8412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788271855.213878:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a0200/0x99288105fd38ea4a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd405 expref: 11 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271855.213893:0:8412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f6d82060700) 00010000:00010000:1.0:1788271855.213895:0:8412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788271855.213899:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38f6ad lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd770 expref: 10 pid: 12164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271855.213914:0:8412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f6e8d1d8e00) 00010000:00010000:1.0:1788271855.213917:0:8412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788271855.213920:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e813a1600/0x99288105fd38f0e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd5d3 expref: 9 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271855.213951:0:8412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f6d83058800) 00010000:00010000:1.0:1788271855.213953:0:8412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788271855.213957:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21200/0x99288105fd38eda0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd4f3 expref: 8 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271855.213971:0:8412:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f6d83211000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1788271855.213995:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271855.213997:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271855.213999:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271855.222913:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271855.223284:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577547392 00000100:00100000:3.0:1788271855.223299:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577547392 00000100:00100000:3.0:1788271855.223440:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 259 00000100:00100000:3.0:1788271855.223454:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+5:2394:x1875138577547392:12345-192.168.201.3@tcp:39:umount.0 00000020:00000080:3.0:1788271855.223499:0:6483:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e702 00000100:00080000:3.0:1788271855.223522:0:6483:0:(import.c:65:import_set_state_nolock()) ffff8f6d83216800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788271855.223751:0:6483:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1788271855.223751:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788271855.224291:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788271855.224397:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef8df183-a1b1-4e56-bce5-924a894c4a71+3:2394:x1875138577547392:12345-192.168.201.3@tcp:39:umount.0 Request processed in 937us (1491us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788271855.224413:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 259 00000100:00100000:0.0:1788271855.646454:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590169216:0@lo:400:kworker.0 00000100:00100000:0.0:1788271855.646797:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271855.646874:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8336ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590169728:0@lo:400:kworker.0 00000100:00100000:0.0:1788271855.646905:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271855.646926:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8336b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590170240:0@lo:400:kworker.0 00000100:00100000:0.0:1788271855.646949:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271855.646987:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788271855.646994:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875138590169088:0@lo:400:kworker.0 00000100:00100000:0.0:1788271855.647021:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271855.647042:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8336aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590169600:0@lo:400:kworker.0 00000100:00100000:0.0:1788271855.647066:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271855.647086:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590170112:0@lo:400:kworker.0 00000100:00100000:0.0:1788271855.647109:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271855.647152:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590169728 00000100:00100000:0.0:1788271855.647161:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590169728 00000100:00100000:0.0:1788271855.647225:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590170240 00000100:00100000:0.0:1788271855.647228:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590170240 00000100:00100000:0.0:1788271855.647253:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590169600 00000100:00100000:0.0:1788271855.647256:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590169600 00000100:00100000:0.0:1788271855.647266:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590170112 00000100:00100000:0.0:1788271855.647268:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590170112 00000100:00100000:0.0:1788271855.647289:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788271855.647297:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590169728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271855.647533:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590168832:0@lo:400:kworker.0 00000100:00100000:1.0:1788271855.647588:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271855.647614:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3606:1875138590169344:0@lo:400:kworker.0 00000100:00100000:1.0:1788271855.647663:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271855.647698:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8336b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3606:1875138590169856:0@lo:400:kworker.0 00000100:00100000:1.0:1788271855.647723:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271855.647752:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788271855.647762:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8336bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875138590168960:0@lo:400:kworker.0 00000100:00100000:1.0:1788271855.647786:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271855.647814:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590168832 00000100:00100000:1.0:1788271855.647819:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3606:1875138590169472:0@lo:400:kworker.0 00000100:00100000:2.0:1788271855.647831:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590168832 00000100:00100000:1.0:1788271855.647852:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271855.647880:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3606:1875138590169984:0@lo:400:kworker.0 00000100:00100000:2.0:1788271855.647914:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1788271855.647915:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271855.647934:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3606:x1875138590168832:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788271855.647952:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788271855.647969:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590169088 00000100:00100000:1.0:1788271855.647976:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590169088 00000100:00100000:1.0:1788271855.648019:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590169344 00000100:00100000:1.0:1788271855.648023:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590169344 00000100:00100000:2.0:1788271855.648047:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3606:x1875138590168832:12345-0@lo:400:kworker.0 Request processed in 118us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271855.648052:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590169856 00000100:00100000:1.0:1788271855.648058:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590169856 00000100:00100000:2.0:1788271855.648059:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1788271855.648085:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590168960 00000100:00100000:1.0:1788271855.648090:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590168960 00000100:00100000:1.0:1788271855.648109:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590169472 00000100:00100000:1.0:1788271855.648112:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590169472 00000100:00100000:1.0:1788271855.648151:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590169984 00000100:00100000:1.0:1788271855.648155:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590169984 00000100:00100000:1.0:1788271855.648182:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1788271855.648195:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875138590169088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271855.648205:0:14136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590169216 00000100:00100000:2.0:1788271855.648212:0:14136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590169216 00000100:00100000:2.0:1788271855.648248:0:14136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788271855.648260:0:14136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590169216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271855.648283:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875138590169088:12345-0@lo:400:kworker.0 Request processed in 91us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271855.648291:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1788271855.648319:0:14136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590169216:12345-0@lo:400:kworker.0 Request processed in 62us (1522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271855.648327:0:14136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788271855.648350:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788271855.648359:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590170240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271855.648389:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590170240:12345-0@lo:400:kworker.0 Request processed in 33us (1440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271855.648396:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788271855.648411:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788271855.648431:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590169600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271855.648461:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590169600:12345-0@lo:400:kworker.0 Request processed in 31us (1394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271855.648466:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788271855.648477:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788271855.648483:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590170112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271855.648504:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590170112:12345-0@lo:400:kworker.0 Request processed in 22us (1395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271855.648510:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788271855.648531:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1788271855.648538:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1875138590169344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271855.648563:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1875138590169344:12345-0@lo:400:kworker.0 Request processed in 26us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271855.648569:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1788271855.648582:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1788271855.648587:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3606:x1875138590169856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271855.648609:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3606:x1875138590169856:12345-0@lo:400:kworker.0 Request processed in 22us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271855.648614:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1788271855.648646:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1788271855.648652:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875138590168960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271855.648690:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875138590168960:12345-0@lo:400:kworker.0 Request processed in 38us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271855.648696:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1788271855.648706:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1788271855.648718:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1875138590169472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271855.648744:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1875138590169472:12345-0@lo:400:kworker.0 Request processed in 28us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271855.648750:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1788271855.648761:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1788271855.648768:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1875138590169984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271855.648793:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1875138590169984:12345-0@lo:400:kworker.0 Request processed in 27us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271855.648799:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1788271855.648825:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83aa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590170496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788271855.648857:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271855.648889:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788271855.648896:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83aa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590170368:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788271855.648931:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271855.648965:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590170496 00000100:00100000:2.0:1788271855.648970:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590170496 00000100:00100000:2.0:1788271855.649001:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590170368 00000100:00100000:2.0:1788271855.649005:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590170368 00000100:00100000:2.0:1788271855.649021:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788271855.649028:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83aa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590170496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788271855.649052:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788271855.649092:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83aa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590170496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271855.649100:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788271855.649121:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788271855.649129:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590170368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788271855.649148:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788271855.649184:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590170368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271855.649191:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788271855.649244:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83aa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590170368:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788271855.649265:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83aa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590170496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788271855.649302:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8336bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875138590168960:0@lo:400:kworker.0 00000100:00100000:2.0:1788271855.649365:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875138590169088:0@lo:400:kworker.0 00000100:00100000:2.0:1788271855.649379:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8336aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590169600:0@lo:400:kworker.0 00000100:00100000:2.0:1788271855.649388:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83369880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590170112:0@lo:400:kworker.0 00000100:00100000:2.0:1788271855.649399:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83368000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590169216:0@lo:400:kworker.0 00000100:00100000:2.0:1788271855.649408:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8336b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590170240:0@lo:400:kworker.0 00000100:00080000:2.0:1788271855.649442:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788271855.649447:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788271855.650164:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590169728:12345-0@lo:400:kworker.0 Request processed in 2865us (3256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271855.650176:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00010000:00080000:3.0:1788271855.651835:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83368380 x1875138590169472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271855.651856:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83368380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3606:1875138590169472:0@lo:400:kworker.0 00010000:00080000:3.0:1788271855.651874:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83369c00 x1875138590169984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271855.651884:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83369c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3606:1875138590169984:0@lo:400:kworker.0 00000100:00100000:3.0:1788271855.651925:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590168832:0@lo:400:kworker.0 00000100:00100000:3.0:1788271855.651941:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3606:1875138590169344:0@lo:400:kworker.0 00000100:00100000:3.0:1788271855.651956:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8336b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3606:1875138590169856:0@lo:400:kworker.0 00000100:00100000:2.0:1788271855.654748:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8336ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590169728:0@lo:400:kworker.0 00010000:00010000:1.0:1788271856.030105:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271857.056701:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271857.116137:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271857.116187:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271857.116352:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271857.123758:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577547520 00000100:00100000:0.0:1788271857.123779:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577547520 00000100:00100000:0.0:1788271857.123869:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577547648 00000100:00100000:0.0:1788271857.123874:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577547648 00000100:00100000:0.0:1788271857.123907:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577547776 00000100:00100000:0.0:1788271857.123911:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577547776 00000100:00100000:0.0:1788271857.123946:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 21 00000100:00100000:0.0:1788271857.123958:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a94beb9-7f16-4b5a-842a-fac2e5234617+12:2396:x1875138577547520:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271857.123978:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271857.124001:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4e21600/0x99288105fd38e805 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd32c expref: 12 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271857.124022:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271857.124100:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a94beb9-7f16-4b5a-842a-fac2e5234617+11:2396:x1875138577547520:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 143us (8177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271857.124110:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 21 00000100:00100000:0.0:1788271857.124164:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 22 00000100:00100000:0.0:1788271857.124171:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a94beb9-7f16-4b5a-842a-fac2e5234617+10:2396:x1875138577547648:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271857.124179:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271857.124189:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4ed5a00/0x99288105fd38e80c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd35d expref: 10 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271857.124198:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271857.124216:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a94beb9-7f16-4b5a-842a-fac2e5234617+9:2396:x1875138577547648:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 46us (8029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271857.124238:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 22 00000100:00100000:0.0:1788271857.124252:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 23 00000100:00100000:0.0:1788271857.124258:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a94beb9-7f16-4b5a-842a-fac2e5234617+8:2397:x1875138577547776:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271857.124266:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271857.124277:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6d830c4a00/0x99288105fd38e9c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd3e9 expref: 8 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271857.124286:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271857.124304:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8a94beb9-7f16-4b5a-842a-fac2e5234617+7:2397:x1875138577547776:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 46us (7953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271857.124311:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 23 00000100:00100000:3.0:1788271857.129397:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271857.129504:0:6484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577548032 00000100:00100000:2.0:1788271857.129513:0:6484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577548032 00000100:00100000:2.0:1788271857.129680:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 260 00000100:00100000:2.0:1788271857.129692:0:6484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:956fb91b-4885-4e88-90fb-3061936b51ca+6:2394:x1875138577548032:12345-192.168.201.3@tcp:39:umount.0 00000020:00000080:2.0:1788271857.129738:0:6484:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e81a 00000020:00010000:2.0:1788271857.129747:0:6484:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8f6ebfbe7800: total 0 00000100:00080000:2.0:1788271857.129766:0:6484:0:(import.c:65:import_set_state_nolock()) ffff8f6ebfbe1800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788271857.129798:0:6484:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00100000:2.0:1788271857.130234:0:6484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:956fb91b-4885-4e88-90fb-3061936b51ca+5:2394:x1875138577548032:12345-192.168.201.3@tcp:39:umount.0 Request processed in 543us (847us total) trans 4294967529 rc 0/0 00000100:00100000:2.0:1788271857.130244:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 260 00000020:00010000:0.0:1788271857.130560:0:8412:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8f6ebfbe7800: total 0 00010000:00010000:0.0:1788271857.130611:0:8412:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f6ebfbe7800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788271857.130684:0:8412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6d83055900) 00010000:00010000:0.0:1788271857.130689:0:8412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788271857.130697:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d833f7a00/0x99288105fd38f7da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd7c4 expref: 4 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271857.130719:0:8412:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f6ebfbe7800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788271857.130732:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271857.130734:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271857.130736:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788271857.131467:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788271857.139093:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271857.139182:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577548160 00000100:00100000:3.0:1788271857.139192:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577548160 00000100:00100000:3.0:1788271857.139271:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 261 00000100:00100000:3.0:1788271857.139283:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:956fb91b-4885-4e88-90fb-3061936b51ca+5:2394:x1875138577548160:12345-192.168.201.3@tcp:39:umount.0 00000020:00000080:3.0:1788271857.139325:0:9899:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e821 00000100:00080000:3.0:1788271857.139337:0:9899:0:(import.c:65:import_set_state_nolock()) ffff8f6ebfc07800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788271857.139372:0:9899:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788271857.139541:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:956fb91b-4885-4e88-90fb-3061936b51ca+3:2394:x1875138577548160:12345-192.168.201.3@tcp:39:umount.0 Request processed in 259us (457us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788271857.139549:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 261 00010000:00010000:0.0:1788271857.139833:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788271857.140006:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788271857.186678:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271857.186817:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577548416 00000100:00100000:2.0:1788271857.186834:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577548416 00000100:00100000:2.0:1788271857.186926:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 394 00000100:00100000:2.0:1788271857.186938:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+7:2394:x1875138577548416:12345-192.168.201.3@tcp:251:umount.0 00000020:00000080:2.0:1788271857.186992:0:6478:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e6df 00000020:00010000:2.0:1788271857.187001:0:6478:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8f6d82346800: total 0 00000100:00080000:2.0:1788271857.187007:0:6478:0:(import.c:65:import_set_state_nolock()) ffff8f6d82344000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788271857.187103:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8a94beb9-7f16-4b5a-842a-fac2e5234617+3:2394:x1875138577548416:12345-192.168.201.3@tcp:251:umount.0 Request processed in 167us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271857.187112:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 394 00000020:00010000:1.0:1788271857.187396:0:6472:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8f6d82346800: total 0 00010000:00010000:1.0:1788271857.187401:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271857.187454:0:6472:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f6d82346800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788271857.187488:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4e20600/0x99288105fd38e73a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd31e expref: 2 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271857.187504:0:6472:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f6d82346800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788271857.187514:0:6472:0:(genops.c:885:class_export_put()) final put ffff8f6d82346800/8a94beb9-7f16-4b5a-842a-fac2e5234617 00010000:00010000:1.0:1788271857.187533:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271857.187535:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271857.187537:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788271857.187577:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6d82346800/8a94beb9-7f16-4b5a-842a-fac2e5234617 for MGS 00000020:00000080:3.0:1788271857.187663:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f6d82344000 for MGS 00010000:00010000:3.0:1788271858.077878:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788271858.719522:0:6462:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 956fb91b-4885-4e88-90fb-3061936b51ca 00000001:00080000:2.0:1788271858.719537:0:6462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00000080:2.0:1788271858.719553:0:6462:0:(genops.c:885:class_export_put()) final put ffff8f6ebfbe7800/956fb91b-4885-4e88-90fb-3061936b51ca 00000001:00100000:2.0:1788271858.719574:0:6462:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ef8df183-a1b1-4e56-bce5-924a894c4a71 00000001:00080000:2.0:1788271858.719685:0:6462:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:2.0:1788271858.719694:0:6462:0:(genops.c:885:class_export_put()) final put ffff8f6d83211000/ef8df183-a1b1-4e56-bce5-924a894c4a71 00000020:00000080:1.0:1788271858.719929:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6ebfbe7800/956fb91b-4885-4e88-90fb-3061936b51ca for lustre-MDT0000 00000020:00000080:1.0:1788271858.719996:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6d83211000/ef8df183-a1b1-4e56-bce5-924a894c4a71 for lustre-MDT0000 00000020:00000080:1.0:1788271858.720039:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f6ebfbe1800 for lustre-MDT0000 00000020:00000080:1.0:1788271858.720044:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f6d83212000 for lustre-MDT0000 00000020:01000004:3.0:1788271858.721870:0:15221:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1788271858.741014:0:15221:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788271858.741076:0:15221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e80031200/0x99288105fd38e795 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e79c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271858.741092:0:15221:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e80031200/0x99288105fd38e795 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e79c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271858.741116:0:15221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e80031200/0x99288105fd38e795 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x99288105fd38e79c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271858.741123:0:15221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff8f6e80031200/0x99288105fd38e795 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x99288105fd38e79c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271858.741143:0:15221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788271858.741149:0:15221:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788271858.741177:0:15221:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788271858.741182:0:15221:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788271858.741187:0:15221:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788271858.741210:0:15221:0:(import.c:65:import_set_state_nolock()) ffff8f6eb3d38800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788271858.741300:0:8412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271858.741308:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6e80031200/0x99288105fd38e795 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x99288105fd38e79c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271858.741325:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e80031200 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:0.0:1788271858.741328:0:8412:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6e80031200/0x99288105fd38e795 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x99288105fd38e79c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271858.741336:0:8412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6e80031200/0x99288105fd38e795 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x99288105fd38e79c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788271858.741343:0:8412:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6e80031200/0x99288105fd38e795 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x99288105fd38e79c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271858.741349:0:8412:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788271858.741351:0:8412:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788271858.741353:0:8412:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788271858.741379:0:8412:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6e80031200/0x99288105fd38e795 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x99288105fd38e79c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271858.741386:0:8412:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788271858.741433:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590170752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788271858.741495:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271858.741601:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3605:1875138590170624:0@lo:39:umount.0 00000100:00100000:2.0:1788271858.741678:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271858.741750:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590170624 00000100:00100000:2.0:1788271858.741757:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590170624 00000100:00100000:2.0:1788271858.741801:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788271858.741810:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1875138590170624:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788271858.741841:0:12164:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e2f6 00000100:00080000:2.0:1788271858.741849:0:12164:0:(import.c:65:import_set_state_nolock()) ffff8f6e9aa49000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788271858.741902:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3605:x1875138590170624:12345-0@lo:39:umount.0 Request processed in 92us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271858.741910:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:2.0:1788271858.741919:0:12164:0:(genops.c:885:class_export_put()) final put ffff8f6e9aa4a000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:2.0:1788271858.741958:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6eb3d38800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788271858.741969:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3605:1875138590170624:0@lo:39:umount.0 00000020:00000080:2.0:1788271858.741990:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6e9aa4a000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788271858.742033:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f6e9aa49000 for lustre-MDT0000 00000100:00080000:2.0:1788271858.742227:0:15221:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788271858.742230:0:15221:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788271858.742234:0:15221:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788271858.742907:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6e80031200/0x99288105fd38e795 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x99288105fd38e79c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271858.742919:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6e80031200/0x99288105fd38e795 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x99288105fd38e79c expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271858.742933:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271858.742935:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271858.742937:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271858.742970:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271858.743477:0:15221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5800/0x99288105fd38e7a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e7aa expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271858.743488:0:15221:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5800/0x99288105fd38e7a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e7aa expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271858.743497:0:15221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5800/0x99288105fd38e7a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x99288105fd38e7aa expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271858.743504:0:15221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5800/0x99288105fd38e7a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x99288105fd38e7aa expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271858.743529:0:15221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788271858.743535:0:15221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21400/0x99288105fd38e699 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e6a0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271858.743557:0:15221:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21400/0x99288105fd38e699 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e6a0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271858.743563:0:15221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21400/0x99288105fd38e699 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x99288105fd38e6a0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271858.743570:0:15221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21400/0x99288105fd38e699 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x99288105fd38e6a0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271858.743584:0:15221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788271858.743589:0:15221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e9fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38ea04 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271858.743595:0:15221:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e9fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38ea04 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271858.743601:0:15221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e9fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x99288105fd38ea04 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271858.743607:0:15221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e9fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x99288105fd38ea04 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271858.743654:0:15221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788271858.743660:0:15221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e813a0c00/0x99288105fd38e255 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e25c expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271858.743763:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788271858.743769:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5800/0x99288105fd38e7a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x99288105fd38e7aa expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271858.743783:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4ed5800 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:0.0:1788271858.743787:0:6472:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5800/0x99288105fd38e7a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x99288105fd38e7aa expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271858.743795:0:6472:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5800/0x99288105fd38e7a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x99288105fd38e7aa expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788271858.743803:0:6472:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5800/0x99288105fd38e7a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x99288105fd38e7aa expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271858.743809:0:6472:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788271858.743811:0:6472:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1788271858.743838:0:6472:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5800/0x99288105fd38e7a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x99288105fd38e7aa expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271858.743844:0:6472:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788271858.743929:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590170752 00000100:00100000:1.0:1788271858.743937:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590170752 00000100:00100000:1.0:1788271858.743982:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788271858.743991:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83250000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3608:x1875138590170752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788271858.744010:0:6470:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271858.744024:0:6470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4e21800/0x99288105fd38e79c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x99288105fd38e795 expref: 24 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271858.744037:0:6470:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788271858.744098:0:15221:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e813a0c00/0x99288105fd38e255 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e25c expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271858.744113:0:15221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e813a0c00/0x99288105fd38e255 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x99288105fd38e25c expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271858.744119:0:15221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff8f6e813a0c00/0x99288105fd38e255 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x99288105fd38e25c expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271858.744132:0:15221:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1788271858.744136:0:15221:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788271858.744140:0:15221:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788271858.744170:0:15221:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788271858.744173:0:15221:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788271858.744177:0:15221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788271858.744183:0:15221:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000020:00080000:2.0:1788271858.744189:0:15221:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8f6d82340800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788271858.744194:0:15221:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8f6e91516800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788271858.744198:0:15221:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8f6eb3eb0000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788271858.744202:0:15221:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8f6eb414c800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1788271858.744208:0:15221:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8f6eb0cf8000) has exports, disconnecting them 00000020:00080000:2.0:1788271858.744212:0:15221:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8f6d82340800), last request at 1788271855 00000020:00000080:2.0:1788271858.744218:0:15221:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e606 00000100:00080000:2.0:1788271858.744232:0:15221:0:(import.c:65:import_set_state_nolock()) ffff8f6d82342800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788271858.744273:0:15221:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f6d82340800): rc 0 00000020:00000080:2.0:1788271858.744275:0:15221:0:(genops.c:885:class_export_put()) final put ffff8f6d82340800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788271858.744285:0:15221:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8f6e91516800), last request at 1788271855 00000020:00000080:2.0:1788271858.744288:0:15221:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e4e0 00000100:00080000:2.0:1788271858.744293:0:15221:0:(import.c:65:import_set_state_nolock()) ffff8f6eb4c7e000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788271858.744310:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6d82340800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788271858.744344:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f6d82342800 for lustre-MDT0000 00000020:00080000:2.0:1788271858.744360:0:15221:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f6e91516800): rc 0 00000020:00000080:2.0:1788271858.744363:0:15221:0:(genops.c:885:class_export_put()) final put ffff8f6e91516800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1788271858.744370:0:15221:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8f6eb3eb0000), last request at 1788271639 00000020:00000080:2.0:1788271858.744373:0:15221:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e3dd 00000100:00080000:2.0:1788271858.744377:0:15221:0:(import.c:65:import_set_state_nolock()) ffff8f6eb3eb7000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788271858.744383:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6e91516800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788271858.744406:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f6eb4c7e000 for lustre-MDT0000 00000020:00080000:2.0:1788271858.744416:0:15221:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f6eb3eb0000): rc 0 00000020:00000080:2.0:1788271858.744418:0:15221:0:(genops.c:885:class_export_put()) final put ffff8f6eb3eb0000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1788271858.744424:0:15221:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8f6eb414c800), last request at 1788271639 00000020:00000080:2.0:1788271858.744428:0:15221:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e3ac 00000100:00080000:2.0:1788271858.744431:0:15221:0:(import.c:65:import_set_state_nolock()) ffff8f6eb4188800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788271858.744438:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb3eb0000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788271858.744460:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f6eb3eb7000 for lustre-MDT0000 00000001:00000004:2.0:1788271858.744469:0:15221:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000020:00080000:2.0:1788271858.744543:0:15221:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f6eb414c800): rc 0 00000004:00000080:2.0:1788271858.744548:0:15221:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa349c156fae0 00000100:00080000:2.0:1788271858.744564:0:15221:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788271858.744566:0:15221:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00080000:2.0:1788271858.745559:0:15221:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788271858.745581:0:15221:0:(import.c:65:import_set_state_nolock()) ffff8f6eb4c7d800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788271858.745656:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3605:1875138590171008:0@lo:39:umount.0 00000100:00100000:2.0:1788271858.745806:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788271858.746011:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788271858.746019:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21400/0x99288105fd38e699 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x99288105fd38e6a0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271858.746029:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e21400 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:3.0:1788271858.746033:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21400/0x99288105fd38e699 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x99288105fd38e6a0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271858.746042:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21400/0x99288105fd38e699 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x99288105fd38e6a0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788271858.746048:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21400/0x99288105fd38e699 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x99288105fd38e6a0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271858.746071:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788271858.746074:0:6471:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788271858.746077:0:6471:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788271858.746103:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21400/0x99288105fd38e699 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x99288105fd38e6a0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271858.746110:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788271858.746126:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21400/0x99288105fd38e699 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x99288105fd38e6a0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271858.746132:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21400/0x99288105fd38e699 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x99288105fd38e6a0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271858.746143:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788271858.746147:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e9fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x99288105fd38ea04 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271858.746153:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4ed4400 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:3.0:1788271858.746156:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e9fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x99288105fd38ea04 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271858.746162:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e9fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x99288105fd38ea04 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788271858.746167:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e9fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x99288105fd38ea04 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271858.746172:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788271858.746173:0:6471:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788271858.746175:0:6471:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788271858.746194:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e9fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x99288105fd38ea04 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271858.746199:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788271858.746205:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e9fd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x99288105fd38ea04 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271858.746210:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4400/0x99288105fd38e9fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x99288105fd38ea04 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271858.746219:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788271858.746222:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6e813a0c00/0x99288105fd38e255 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x99288105fd38e25c expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271858.746227:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e813a0c00 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:3.0:1788271858.746230:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6e813a0c00/0x99288105fd38e255 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x99288105fd38e25c expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271858.746237:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6e813a0c00/0x99288105fd38e255 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x99288105fd38e25c expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788271858.746244:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6e813a0c00/0x99288105fd38e255 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x99288105fd38e25c expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271858.746249:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788271858.746251:0:6471:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788271858.746253:0:6471:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788271858.746264:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6e813a0c00/0x99288105fd38e255 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x99288105fd38e25c expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271858.746270:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788271858.746276:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6e813a0c00/0x99288105fd38e255 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x99288105fd38e25c expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271858.746289:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6e813a0c00/0x99288105fd38e255 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x99288105fd38e25c expref: -99 pid: 6460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271858.746298:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271858.746300:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271858.746302:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271858.746314:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590171136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788271858.746349:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271858.746383:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788271858.746388:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83252d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590171264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788271858.746408:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271858.746436:0:9486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590171136 00000100:00100000:3.0:1788271858.746442:0:9486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590171136 00000100:00100000:3.0:1788271858.746479:0:9486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590171264 00000100:00100000:3.0:1788271858.746483:0:9486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590171264 00000100:00100000:3.0:1788271858.746498:0:9486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788271858.746506:0:9486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4eab87b-0440-4f90-8c88-4ffaef16406f+25:3606:x1875138590171136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788271858.746517:0:9486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271858.746530:0:9486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6e92d32a00/0x99288105fd38e6a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x99288105fd38e699 expref: 25 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271858.746543:0:9486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271858.746571:0:9486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4eab87b-0440-4f90-8c88-4ffaef16406f+24:3606:x1875138590171136:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271858.746578:0:9486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788271858.746593:0:9486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788271858.746598:0:9486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:3606:x1875138590171264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788271858.746611:0:9486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271858.746650:0:9486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4079c00/0x99288105fd38ea04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x99288105fd38e9fd expref: 23 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271858.746658:0:9486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271858.746751:0:9486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:3606:x1875138590171264:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271858.746758:0:9486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788271858.746789:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83252d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590171264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788271858.746797:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590171136:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788271858.746916:0:15221:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788271858.746921:0:15221:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1788271858.746944:0:15221:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788271858.747014:0:15221:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788271858.747026:0:15221:0:(import.c:65:import_set_state_nolock()) ffff8f6ebcbd5800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788271858.747036:0:15221:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788271858.747038:0:15221:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967326 gen 3 00000004:00080000:2.0:1788271858.747044:0:15221:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788271858.747118:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3605:1875138590171520:0@lo:9:umount.0 00000100:00100000:2.0:1788271858.747146:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271858.747176:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590171520 00000100:00100000:2.0:1788271858.747180:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590171520 00000100:00100000:2.0:1788271858.747214:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788271858.747221:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3605:x1875138590171520:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788271858.747244:0:8396:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e596 00000100:00080000:2.0:1788271858.747253:0:8396:0:(import.c:65:import_set_state_nolock()) ffff8f6d81dc3000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788271858.747295:0:8396:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1788271858.747408:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3605:x1875138590171520:12345-0@lo:9:umount.0 Request processed in 188us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271858.747415:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1788271858.747445:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6ebcbd5800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788271858.747451:0:3605:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788271858.747452:0:3605:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788271858.747455:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3605:1875138590171520:0@lo:9:umount.0 00000100:00080000:2.0:1788271858.747471:0:15221:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788271858.747481:0:15221:0:(import.c:65:import_set_state_nolock()) ffff8f6eb4edf000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788271858.747496:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3605:1875138590171648:0@lo:9:umount.0 00000100:00100000:2.0:1788271858.747519:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271858.747547:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590171648 00000100:00100000:2.0:1788271858.747551:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590171648 00000100:00100000:2.0:1788271858.747585:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788271858.747591:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3605:x1875138590171648:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788271858.747603:0:8452:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e6ca 00000100:00080000:2.0:1788271858.747608:0:8452:0:(import.c:65:import_set_state_nolock()) ffff8f6d82347000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788271858.747653:0:8452:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967326 00010000:00010000:0.0:1788271858.747765:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5800/0x99288105fd38e7a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x99288105fd38e7aa expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271858.747776:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5800/0x99288105fd38e7a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x99288105fd38e7aa expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271858.747805:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83b3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590170880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788271858.747834:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271858.747860:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788271858.747865:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590171392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788271858.747885:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788271858.747906:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271858.747921:0:9486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590170880 00000100:00100000:0.0:1788271858.747925:0:9486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590170880 00000100:00100000:0.0:1788271858.747947:0:9486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590171392 00000100:00100000:0.0:1788271858.747950:0:9486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590171392 00000100:00100000:0.0:1788271858.747961:0:9486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788271858.747966:0:9486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4eab87b-0440-4f90-8c88-4ffaef16406f+23:3609:x1875138590170880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788271858.747974:0:9486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271858.747986:0:9486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4e20800/0x99288105fd38e7aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x99288105fd38e7a3 expref: 23 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271858.747996:0:9486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271858.748021:0:9486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4eab87b-0440-4f90-8c88-4ffaef16406f+22:3609:x1875138590170880:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271858.748027:0:9486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788271858.748039:0:9486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788271858.748044:0:9486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb359ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4eab87b-0440-4f90-8c88-4ffaef16406f+21:3609:x1875138590171392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788271858.748050:0:9486:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271858.748059:0:9486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6e80031a00/0x99288105fd38e25c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x99288105fd38e255 expref: 21 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271858.748068:0:9486:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271858.748086:0:9486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb359ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4eab87b-0440-4f90-8c88-4ffaef16406f+20:3609:x1875138590171392:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271858.748091:0:9486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788271858.748115:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83251500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590171392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788271858.748122:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83b3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590170880:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788271858.748137:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271858.748148:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271858.748150:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271858.748152:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271858.748263:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3605:x1875138590171648:12345-0@lo:9:umount.0 Request processed in 672us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271858.748270:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000020:00080000:2.0:1788271858.748315:0:15221:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8f6eb0cf8000) has no exports 00000100:00100000:1.0:1788271858.748702:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83250000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4eab87b-0440-4f90-8c88-4ffaef16406f+19:3608:x1875138590170752:12345-0@lo:103:ldlm_bl.0 Request processed in 4710us (7205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271858.748711:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788271858.748784:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590171008 00000100:00100000:1.0:1788271858.748789:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590171008 00000100:00100000:1.0:1788271858.748824:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788271858.748832:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3605:x1875138590171008:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788271858.748855:0:6489:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e44d 00000100:00080000:1.0:1788271858.748861:0:6489:0:(import.c:65:import_set_state_nolock()) ffff8f6eb3d38000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788271858.748878:0:6489:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1788271858.748979:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3605:x1875138590171008:12345-0@lo:39:umount.0 Request processed in 148us (3172us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788271858.748985:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:1.0:1788271858.749004:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788271858.749007:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788271858.749197:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590170752:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788271858.749222:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271858.749304:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788271858.749325:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6eb4edf000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788271858.749372:0:3605:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788271858.749438:0:3605:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788271858.749442:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3605:1875138590171648:0@lo:9:umount.0 00000100:00080000:0.0:1788271858.749459:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6eb4c7d800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788271858.749464:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3605:1875138590171008:0@lo:39:umount.0 00000020:00080000:3.0:1788271858.753068:0:15221:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8f6eb0cf8000) has no exports 00000020:00000080:3.0:1788271858.797968:0:15221:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e2b0 00000020:00000080:3.0:1788271858.797985:0:15221:0:(genops.c:885:class_export_put()) final put ffff8f6eb3d3e000/lustre-QMT0000_UUID 00000020:01000000:3.0:1788271858.798038:0:15221:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788271858.798104:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb3d3e000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788271858.798132:0:15221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788271858.798143:0:15221:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788271858.798147:0:15221:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8f6eb3cd3370) has no exports 00000020:00000080:2.0:1788271858.798515:0:15221:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e2a9 00000020:00000080:2.0:1788271858.798521:0:15221:0:(genops.c:885:class_export_put()) final put ffff8f6eb3ccc000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788271858.798584:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb3ccc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788271858.798974:0:15221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788271858.798983:0:15221:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788271858.798986:0:15221:0:(genops.c:885:class_export_put()) final put ffff8f6eb3cc8000/lustre-QMT0000_UUID 00000020:00000080:2.0:1788271858.798989:0:15221:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb3cc8000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788271858.798993:0:15221:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:0.0:1788271859.102159:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271859.230899:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788271859.230925:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590171776:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788271859.231000:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271859.231252:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590171776 00000100:00100000:1.0:1788271859.231259:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590171776 00000100:00100000:1.0:1788271859.231333:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788271859.231343:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590171776:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788271859.231371:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788271859.231429:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590171776:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271859.231436:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788271859.231536:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590171776:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788271859.231673:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788271860.125784:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271860.253970:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590171904:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788271860.254048:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271860.254340:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590171904 00000100:00100000:2.0:1788271860.254351:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590171904 00000100:00100000:2.0:1788271860.254403:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788271860.254411:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3606:x1875138590171904:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1788271860.254419:0:6488:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788271860.254471:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3606:x1875138590171904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (422us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788271860.254477:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:02020000:3.0:1788271860.254565:0:3606:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1788271860.260275:0:3606:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788271860.260285:0:3606:0:(import.c:65:import_set_state_nolock()) ffff8f6eb4a19800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788271860.260290:0:3606:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788271860.273145:0:3606:0:(import.c:65:import_set_state_nolock()) ffff8f6eb4a19800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788271860.273159:0:3606:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 200 00000100:00080000:3.0:1788271860.273171:0:3606:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8f6eb4a19800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788271860.273246:0:3606:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d83ad1c00 x1875138590172032/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788271860.273318:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3605:1875138590172032:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788271860.273397:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271860.274216:0:14136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590172032 00000100:00100000:1.0:1788271860.274227:0:14136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590172032 00000100:00100000:1.0:1788271860.274271:0:14136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788271860.274281:0:14136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83b3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3605:x1875138590172032:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1788271860.274301:0:14136:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788271860.283189:0:14136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83b3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3605:x1875138590172032:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 8895us (9778us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788271860.283220:0:14136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00080000:0.0:1788271860.283511:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6eb4a19800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788271860.283517:0:3605:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788271860.283522:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3605:1875138590172032:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788271860.765985:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3609:1875138590172416:0@lo:400:kworker.0 00000100:00100000:0.0:1788271860.766077:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271860.766104:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590172160:0@lo:400:kworker.0 00000100:00100000:0.0:1788271860.766141:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3609:1875138590172928:0@lo:400:kworker.0 00000100:00100000:2.0:1788271860.766149:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271860.766180:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590172672:0@lo:400:kworker.0 00000100:00100000:0.0:1788271860.766181:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271860.766211:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788271860.766217:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271860.766223:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875138590172288:0@lo:400:kworker.0 00000100:00100000:2.0:1788271860.766239:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590173184:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788271860.766272:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271860.766283:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271860.766297:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3609:1875138590172800:0@lo:400:kworker.0 00000100:00100000:2.0:1788271860.766314:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788271860.766324:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3607:1875138590172544:0@lo:400:kworker.0 00000100:00100000:0.0:1788271860.766327:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271860.766361:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271860.766367:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590172672 00000100:00100000:0.0:1788271860.766375:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590172672 00000100:00100000:2.0:1788271860.766383:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83391f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590173056:0@lo:400:kworker.0 00000100:00100000:2.0:1788271860.766406:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271860.766497:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590172416 00000100:00100000:1.0:1788271860.766502:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590172416 00000100:00100000:1.0:1788271860.766522:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590172928 00000100:00100000:1.0:1788271860.766524:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590172928 00000100:00100000:1.0:1788271860.766543:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590172288 00000100:00100000:1.0:1788271860.766546:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590172288 00000100:00100000:1.0:1788271860.766552:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590172800 00000100:00100000:1.0:1788271860.766554:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590172800 00000100:00100000:1.0:1788271860.766560:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590172544 00000100:00100000:1.0:1788271860.766563:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590172544 00000100:00100000:1.0:1788271860.766610:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1788271860.766649:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83390380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875138590172928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271860.766716:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83390380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875138590172928:12345-0@lo:400:kworker.0 Request processed in 97us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271860.766724:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1788271860.766822:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590173184 00000100:00100000:2.0:1788271860.766826:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590173184 00000100:00100000:2.0:1788271860.766854:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788271860.766861:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590173184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788271860.766884:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788271860.766916:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590173184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271860.766922:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788271860.767198:0:8398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590173056 00000100:00100000:0.0:1788271860.767203:0:8398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590173056 00000100:00100000:0.0:1788271860.767228:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788271860.767236:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590172672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271860.767272:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590172672:12345-0@lo:400:kworker.0 Request processed in 37us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271860.767278:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788271860.767291:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788271860.767298:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590173056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271860.767325:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590173056:12345-0@lo:400:kworker.0 Request processed in 28us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271860.767330:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788271860.767704:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1788271860.767715:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875138590172544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271860.767749:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875138590172544:12345-0@lo:400:kworker.0 Request processed in 38us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271860.767755:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1788271860.767770:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788271860.767773:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83393800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3609:x1875138590172416:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788271860.767778:0:9899:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788271860.767800:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83393800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3609:x1875138590172416:12345-0@lo:400:kworker.0 Request processed in 25us (1726us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788271860.767805:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788271860.767815:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788271860.767819:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83393100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3609:x1875138590172288:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788271860.767823:0:9899:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788271860.767846:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83393100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3609:x1875138590172288:12345-0@lo:400:kworker.0 Request processed in 26us (1574us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788271860.767852:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788271860.767861:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788271860.767864:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83391880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3609:x1875138590172800:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788271860.767869:0:9899:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788271860.767899:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83391880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3609:x1875138590172800:12345-0@lo:400:kworker.0 Request processed in 33us (1575us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788271860.767905:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:3.0:1788271860.768047:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788271860.768052:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788271860.768197:0:3609:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788271860.768203:0:3609:0:(import.c:65:import_set_state_nolock()) ffff8f6eb416b000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788271860.768206:0:3609:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00010000:00080000:3.0:1788271860.769255:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d81f43b80 x1875138590172544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271860.769270:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3607:1875138590172544:0@lo:400:kworker.0 00000100:00100000:3.0:1788271860.769283:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83391f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590173056:0@lo:400:kworker.0 00000100:00100000:3.0:1788271860.769319:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590172672:0@lo:400:kworker.0 00000100:00100000:3.0:1788271860.769335:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590173184:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788271860.771790:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590172160 00000100:00100000:3.0:1788271860.771803:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590172160 00000100:00100000:3.0:1788271860.771847:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1788271860.771857:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+19:3607:x1875138590172160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271860.771945:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4eab87b-0440-4f90-8c88-4ffaef16406f+19:3607:x1875138590172160:12345-0@lo:400:kworker.0 Request processed in 89us (5796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271860.771952:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1788271860.772005:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590172160:0@lo:400:kworker.0 00000001:00100000:3.0:1788271860.773880:0:8391:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788271860.773887:0:8391:0:(genops.c:885:class_export_put()) final put ffff8f6d81dc1800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788271860.773907:0:8391:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ef8df183-a1b1-4e56-bce5-924a894c4a71 00000020:00000080:3.0:1788271860.773910:0:8391:0:(genops.c:885:class_export_put()) final put ffff8f6d83922000/ef8df183-a1b1-4e56-bce5-924a894c4a71 00000020:00000080:2.0:1788271860.773988:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6d81dc1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788271860.774040:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6d83922000/ef8df183-a1b1-4e56-bce5-924a894c4a71 for lustre-OST0000 00000020:00000080:2.0:1788271860.774056:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f6d81dc3000 for lustre-OST0000 00000020:00000080:2.0:1788271860.774061:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f6d83920000 for lustre-OST0000 00000001:00100000:2.0:1788271860.774537:0:9475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788271860.774541:0:9475:0:(genops.c:885:class_export_put()) final put ffff8f6d82345000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788271860.774561:0:9475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ef8df183-a1b1-4e56-bce5-924a894c4a71 00000020:00000080:2.0:1788271860.774574:0:9475:0:(genops.c:885:class_export_put()) final put ffff8f6d838cb000/ef8df183-a1b1-4e56-bce5-924a894c4a71 00000020:00000080:3.0:1788271860.775850:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6d82345000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788271860.775907:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6d838cb000/ef8df183-a1b1-4e56-bce5-924a894c4a71 for lustre-OST0001 00000020:00000080:3.0:1788271860.775949:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f6d82347000 for lustre-OST0001 00000020:00000080:3.0:1788271860.775955:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f6d838cc800 for lustre-OST0001 00000001:00100000:2.0:1788271860.775968:0:7414:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788271860.775980:0:7414:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:2.0:1788271860.775983:0:7414:0:(genops.c:885:class_export_put()) final put ffff8f6eb4b88000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788271860.776003:0:7414:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 956fb91b-4885-4e88-90fb-3061936b51ca 00000001:00080000:2.0:1788271860.776008:0:7414:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:2.0:1788271860.776010:0:7414:0:(genops.c:885:class_export_put()) final put ffff8f6ebfc01000/956fb91b-4885-4e88-90fb-3061936b51ca 00000001:00100000:2.0:1788271860.776016:0:7414:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ef8df183-a1b1-4e56-bce5-924a894c4a71 00000001:00080000:2.0:1788271860.776019:0:7414:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:2.0:1788271860.776021:0:7414:0:(genops.c:885:class_export_put()) final put ffff8f6d83217800/ef8df183-a1b1-4e56-bce5-924a894c4a71 00000020:00000080:3.0:1788271860.778187:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb4b88000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1788271860.778260:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6ebfc01000/956fb91b-4885-4e88-90fb-3061936b51ca for lustre-MDT0001 00000020:00000080:3.0:1788271860.778287:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6d83217800/ef8df183-a1b1-4e56-bce5-924a894c4a71 for lustre-MDT0001 00000020:00000080:3.0:1788271860.778331:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f6eb3d38000 for lustre-MDT0001 00000020:00000080:3.0:1788271860.778336:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f6ebfc07800 for lustre-MDT0001 00000020:00000080:3.0:1788271860.778339:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f6d83216800 for lustre-MDT0001 00000100:00080000:0.0:1788271860.789538:0:3609:0:(import.c:65:import_set_state_nolock()) ffff8f6eb416b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788271860.789552:0:3609:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 200 00000100:00080000:0.0:1788271860.789562:0:3609:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8f6eb416b000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:0.0:1788271860.791169:0:3609:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d83390700 x1875138590173312/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788271860.791232:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875138590172288:0@lo:400:kworker.0 00000100:00080000:0.0:1788271860.791266:0:3609:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788271860.791271:0:3609:0:(import.c:65:import_set_state_nolock()) ffff8f6d82346000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788271860.791274:0:3609:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788271860.791279:0:3609:0:(import.c:65:import_set_state_nolock()) ffff8f6d82346000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788271860.791282:0:3609:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 241 00000100:00080000:0.0:1788271860.791287:0:3609:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f6d82346000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:0.0:1788271860.791305:0:3609:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d83390a80 x1875138590173440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788271860.791314:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3609:1875138590172800:0@lo:400:kworker.0 00000100:00080000:0.0:1788271860.791325:0:3609:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788271860.791328:0:3609:0:(import.c:65:import_set_state_nolock()) ffff8f6d81dd2000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788271860.791331:0:3609:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788271860.791333:0:3609:0:(import.c:65:import_set_state_nolock()) ffff8f6d81dd2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788271860.791336:0:3609:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 220 00000100:00080000:0.0:1788271860.791339:0:3609:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8f6d81dd2000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:0.0:1788271860.791347:0:3609:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d83392300 x1875138590173568/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788271860.791355:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3609:1875138590172416:0@lo:400:kworker.0 00010000:00080000:0.0:1788271860.791367:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d816cd880 x1875138590172928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271876 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271860.791388:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3609:1875138590172928:0@lo:400:kworker.0 00000100:00100000:1.0:1788271860.792349:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83390700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3605:1875138590173312:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788271860.792424:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271860.792465:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83390a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3605:1875138590173440:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788271860.792488:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271860.792507:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83392300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3605:1875138590173568:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788271860.792539:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271860.792590:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590173312 00000100:00100000:1.0:1788271860.792597:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590173312 00000100:00100000:1.0:1788271860.792652:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590173440 00000100:00100000:1.0:1788271860.792656:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590173440 00000100:00100000:1.0:1788271860.792669:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590173568 00000100:00100000:1.0:1788271860.792681:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590173568 00000100:00100000:1.0:1788271860.792696:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788271860.792702:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3605:x1875138590173312:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1788271860.792721:0:6483:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788271860.793034:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788271860.793040:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3605:x1875138590173440:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1788271860.793048:0:12164:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788271860.793093:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3605:x1875138590173440:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 51us (603us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788271860.793100:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788271860.793130:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788271860.793134:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3605:x1875138590173568:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1788271860.793141:0:12164:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788271860.793164:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3605:x1875138590173568:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 28us (624us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788271860.793170:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:0.0:1788271860.793974:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6d82346000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788271860.793982:0:3605:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788271860.793986:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83390a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3605:1875138590173440:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1788271860.793995:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6d81dd2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788271860.793998:0:3605:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788271860.794001:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83392300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3605:1875138590173568:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788271860.801269:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3605:x1875138590173312:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 8555us (8834us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788271860.801284:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:0.0:1788271860.801331:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6eb416b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788271860.801337:0:3605:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788271860.801341:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83390700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3605:1875138590173312:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:3.0:1788271861.149880:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271862.173902:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271863.197879:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788271863.583213:0:13766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788271864.221790:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271864.349952:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590173696:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788271864.350031:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271864.350315:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590173696 00000100:00100000:3.0:1788271864.350324:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590173696 00000100:00100000:3.0:1788271864.350442:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788271864.350452:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590173696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788271864.350481:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788271864.350558:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590173696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271864.350578:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:2.0:1788271864.350697:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788271864.350741:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590173696:0@lo:13:osp-pre-0-1.0 00000001:00100000:2.0:1788271864.864242:0:6462:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788271864.864256:0:6462:0:(genops.c:885:class_export_put()) final put ffff8f6eb414c800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788271864.864357:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb414c800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1788271864.864442:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f6eb4188800 for lustre-MDT0000 00010000:00010000:3.0:1788271865.247540:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788271865.885910:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788271865.885919:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788271865.885923:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f6eb4a19800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788271865.885943:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 421 00000100:00080000:0.0:1788271865.885950:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788271865.885960:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8f6eb4a19800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:0.0:1788271865.885992:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d83392300 x1875138590173952/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788271865.886015:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788271865.886038:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788271865.886040:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f6eb416b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788271865.886044:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 421 00000100:00080000:0.0:1788271865.886047:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788271865.886051:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8f6eb416b000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:0.0:1788271865.886064:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d83390a80 x1875138590174080/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788271865.886074:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788271865.886077:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788271865.886079:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f6d81dd2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788271865.886082:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 421 00000100:00080000:0.0:1788271865.886084:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788271865.886088:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8f6d81dd2000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:0.0:1788271865.886100:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d83392d80 x1875138590174208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788271865.886148:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788271865.886151:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788271865.886153:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f6d82346000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788271865.886156:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 421 00000100:00080000:0.0:1788271865.886159:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788271865.886163:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f6d82346000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:0.0:1788271865.886174:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d83393b80 x1875138590174592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788271865.886265:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83392300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3605:1875138590173952:0@lo:38:kworker.0 00000100:00100000:0.0:1788271865.886360:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271865.886672:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83390a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3605:1875138590174080:0@lo:38:kworker.0 00000100:00100000:0.0:1788271865.886709:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271865.886736:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83392d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3605:1875138590174208:0@lo:38:kworker.0 00000100:00100000:0.0:1788271865.886758:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271865.886776:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83393b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3605:1875138590174592:0@lo:38:kworker.0 00000100:00100000:0.0:1788271865.886799:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271865.886844:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83391c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3606:1875138590174336:0@lo:400:kworker.0 00000100:00100000:0.0:1788271865.886872:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271865.886897:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788271865.886903:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83392a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590174464:0@lo:400:kworker.0 00000100:00100000:0.0:1788271865.886990:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271865.887026:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590174080 00000100:00100000:0.0:1788271865.887035:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590174080 00000100:00100000:0.0:1788271865.887071:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590174208 00000100:00100000:0.0:1788271865.887075:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590174208 00000100:00100000:0.0:1788271865.887084:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590174592 00000100:00100000:0.0:1788271865.887086:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590174592 00000100:00100000:0.0:1788271865.887094:0:9899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590174336 00000100:00100000:0.0:1788271865.887097:0:9899:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590174336 00000100:00100000:0.0:1788271865.887134:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1788271865.887146:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1875138590174336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271865.887209:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1875138590174336:12345-0@lo:400:kworker.0 Request processed in 66us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271865.887217:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1788271865.887238:0:9899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788271865.887242:0:9899:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83392680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3605:x1875138590174080:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1788271865.887271:0:9899:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788271865.887323:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788271865.887335:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83391f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3605:x1875138590174208:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1788271865.887369:0:12164:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788271865.887465:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83391f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3605:x1875138590174208:12345-0@lo:38:kworker.0 Request processed in 129us (704us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788271865.887473:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788271865.887522:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788271865.887528:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3605:x1875138590174592:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1788271865.887536:0:12164:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788271865.887565:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3605:x1875138590174592:12345-0@lo:38:kworker.0 Request processed in 35us (764us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788271865.887572:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788271865.887596:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590173952 00000100:00100000:1.0:1788271865.887603:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590173952 00000100:00100000:3.0:1788271865.887608:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83390700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590173824:0@lo:400:kworker.0 00000100:00100000:3.0:1788271865.887684:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271865.887695:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788271865.887705:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83393480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3605:x1875138590173952:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1788271865.887717:0:6489:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788271865.887735:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83391180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590174848:0@lo:400:kworker.0 00000100:00100000:1.0:1788271865.887771:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83393480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3605:x1875138590173952:12345-0@lo:38:kworker.0 Request processed in 66us (1409us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788271865.887779:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788271865.887790:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271865.887827:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788271865.887837:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83391500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3609:1875138590174720:0@lo:400:kworker.0 00010000:00080000:1.0:1788271865.887896:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83391c00 x1875138590174336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271865.887913:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83391c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3606:1875138590174336:0@lo:400:kworker.0 00000100:00100000:2.0:1788271865.888149:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590174464 00000100:00100000:2.0:1788271865.888154:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590174464 00000100:00100000:2.0:1788271865.888192:0:12967:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590174848 00000100:00100000:2.0:1788271865.888195:0:12967:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590174848 00000100:00100000:2.0:1788271865.888221:0:12967:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788271865.888228:0:12967:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590174464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271865.890853:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271865.890939:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590173824 00000100:00100000:3.0:1788271865.890949:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590173824 00000100:00100000:3.0:1788271865.891010:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1788271865.891020:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+19:3609:x1875138590173824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271865.891097:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4eab87b-0440-4f90-8c88-4ffaef16406f+19:3609:x1875138590173824:12345-0@lo:400:kworker.0 Request processed in 78us (3413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271865.891116:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1788271865.891160:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788271865.891170:0:8398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590174848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271865.891205:0:8398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590174848:12345-0@lo:400:kworker.0 Request processed in 37us (3423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271865.891211:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788271865.891235:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788271865.891249:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590174976:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788271865.891282:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271865.891312:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590174976 00000100:00100000:3.0:1788271865.891316:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590174976 00000100:00100000:3.0:1788271865.891362:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788271865.891370:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590174976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788271865.891391:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788271865.891427:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590174976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271865.891434:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788271865.891474:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590174976:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788271865.891506:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590174720 00000100:00100000:3.0:1788271865.891510:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590174720 00000100:00100000:3.0:1788271865.891541:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1788271865.891548:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875138590174720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271865.891580:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3609:x1875138590174720:12345-0@lo:400:kworker.0 Request processed in 33us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271865.891586:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00010000:00080000:3.0:1788271865.891644:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83391500 x1875138590174720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271865.891655:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83391500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3609:1875138590174720:0@lo:400:kworker.0 00000100:00100000:3.0:1788271865.891667:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83390700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590173824:0@lo:400:kworker.0 00000100:00100000:3.0:1788271865.891677:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83391180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590174848:0@lo:400:kworker.0 00000100:00080000:3.0:1788271865.891736:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788271865.891741:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788271865.893158:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6eb4a19800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788271865.893172:0:3605:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788271865.893178:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83392300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3605:1875138590173952:0@lo:38:kworker.0 00000100:00080000:1.0:1788271865.893205:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6d81dd2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788271865.893209:0:3605:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788271865.893212:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83392d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3605:1875138590174208:0@lo:38:kworker.0 00000100:00080000:1.0:1788271865.893224:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6d82346000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788271865.893228:0:3605:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788271865.893232:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83393b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3605:1875138590174592:0@lo:38:kworker.0 00000100:00100000:2.0:1788271865.895903:0:12967:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590174464:12345-0@lo:400:kworker.0 Request processed in 7660us (8897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271865.895923:0:12967:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788271865.897190:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83392a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590174464:0@lo:400:kworker.0 00000100:00100000:0.0:1788271865.901018:0:9899:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83392680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3605:x1875138590174080:12345-0@lo:38:kworker.0 Request processed in 13762us (14295us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788271865.901038:0:9899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00080000:1.0:1788271865.901215:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6eb416b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788271865.901221:0:3605:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788271865.901226:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83390a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3605:1875138590174080:0@lo:38:kworker.0 00010000:00010000:0.0:1788271866.269953:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271867.295640:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271868.318082:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271869.342443:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271869.471966:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590175104:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788271869.472073:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271869.472138:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590175104 00000100:00100000:2.0:1788271869.472148:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590175104 00000100:00100000:2.0:1788271869.472246:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788271869.472259:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590175104:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788271869.472305:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788271869.472320:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788271869.472386:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590175104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 130us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271869.472403:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788271869.472651:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590175104:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788271870.365767:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271871.006609:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788271871.006657:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590175232:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788271871.006758:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788271871.007770:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788271871.007775:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788271871.007779:0:36:0:(import.c:65:import_set_state_nolock()) ffff8f6eb4a19800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788271871.007786:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 426 00000100:00080000:3.0:1788271871.007793:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788271871.007801:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8f6eb4a19800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788271871.007828:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d83b3b480 x1875138590175488/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788271871.007845:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788271871.007849:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788271871.007867:0:36:0:(import.c:65:import_set_state_nolock()) ffff8f6eb416b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788271871.007872:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 426 00000100:00080000:3.0:1788271871.007875:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788271871.007879:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8f6eb416b000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788271871.007906:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d816cd880 x1875138590175616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788271871.007916:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788271871.007920:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788271871.007922:0:36:0:(import.c:65:import_set_state_nolock()) ffff8f6d81dd2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788271871.007925:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 426 00000100:00080000:3.0:1788271871.007928:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788271871.007931:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8f6d81dd2000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788271871.007943:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d816cc380 x1875138590175744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788271871.007982:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788271871.007986:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788271871.007988:0:36:0:(import.c:65:import_set_state_nolock()) ffff8f6d82346000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788271871.007991:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 426 00000100:00080000:3.0:1788271871.007994:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788271871.007997:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f6d82346000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788271871.008008:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d81f43b80 x1875138590176128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788271871.008197:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3608:1875138590176256:0@lo:400:kworker.0 00000100:00100000:3.0:1788271871.008256:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271871.008298:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788271871.008305:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590175360:0@lo:400:kworker.0 00000100:00100000:3.0:1788271871.008338:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271871.008382:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3606:1875138590175872:0@lo:400:kworker.0 00000100:00100000:3.0:1788271871.008421:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271871.008487:0:8399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590175232 00000100:00100000:1.0:1788271871.008500:0:8399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590175232 00000100:00100000:3.0:1788271871.008539:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788271871.008548:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590176000:0@lo:400:kworker.0 00000100:00100000:1.0:1788271871.008573:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788271871.008580:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271871.008588:0:8399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590175232:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788271871.008616:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590176256 00000100:00100000:3.0:1788271871.008645:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590176256 00002000:00000024:1.0:1788271871.008649:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788271871.008680:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590175872 00000100:00100000:3.0:1788271871.008685:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590175872 00000100:00100000:1.0:1788271871.008702:0:8399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590175232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (1944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271871.008711:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788271871.008736:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3605:1875138590175488:0@lo:38:kworker.0 00000100:00100000:1.0:1788271871.008769:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271871.008791:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3605:1875138590175616:0@lo:38:kworker.0 00000100:00100000:1.0:1788271871.008816:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271871.008848:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590175616 00000100:00100000:1.0:1788271871.008849:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3605:1875138590175744:0@lo:38:kworker.0 00000100:00100000:3.0:1788271871.008854:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590175616 00000100:00100000:3.0:1788271871.008873:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1788271871.008880:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271871.008891:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3605:1875138590176128:0@lo:38:kworker.0 00000100:00100000:1.0:1788271871.008911:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271871.008923:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875138590176256:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788271871.008937:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788271871.008944:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788271871.008957:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590175488 00000100:00100000:1.0:1788271871.008961:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590175488 00000100:00100000:3.0:1788271871.008971:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875138590176256:12345-0@lo:400:kworker.0 Request processed in 52us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271871.008979:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1788271871.008988:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788271871.008995:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3605:x1875138590175488:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788271871.008996:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590175744 00000100:00100000:3.0:1788271871.009002:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590175744 00000100:00100000:3.0:1788271871.009014:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590176128 00010000:02000000:1.0:1788271871.009016:0:6489:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788271871.009017:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590176128 00000100:00100000:3.0:1788271871.009031:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1788271871.009039:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1875138590175872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271871.009070:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83252a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1875138590175872:12345-0@lo:400:kworker.0 Request processed in 33us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271871.009077:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1788271871.009097:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788271871.009102:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3605:x1875138590175616:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1788271871.009111:0:6483:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788271871.009142:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3605:x1875138590175616:12345-0@lo:38:kworker.0 Request processed in 39us (326us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788271871.009149:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788271871.009160:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788271871.009164:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3605:x1875138590175744:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1788271871.009171:0:6483:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788271871.009191:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3605:x1875138590175744:12345-0@lo:38:kworker.0 Request processed in 26us (312us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788271871.009198:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788271871.009208:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788271871.009212:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3605:x1875138590176128:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1788271871.009218:0:6483:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788271871.009237:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3605:x1875138590176128:12345-0@lo:38:kworker.0 Request processed in 24us (326us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788271871.009243:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788271871.009280:0:8396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590176000 00000100:00100000:3.0:1788271871.009284:0:8396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590176000 00000100:00100000:3.0:1788271871.009317:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788271871.009323:0:8396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590176000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271871.009356:0:8396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590176000:12345-0@lo:400:kworker.0 Request processed in 33us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271871.009362:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788271871.009433:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590176000:0@lo:400:kworker.0 00010000:00080000:3.0:1788271871.009448:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d816cf800 x1875138590175872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271871.009465:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3606:1875138590175872:0@lo:400:kworker.0 00010000:00080000:3.0:1788271871.009500:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83250000 x1875138590176256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271871.009510:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3608:1875138590176256:0@lo:400:kworker.0 00000100:00080000:3.0:1788271871.009667:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6eb416b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788271871.009673:0:3605:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788271871.009677:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3605:1875138590175616:0@lo:38:kworker.0 00000100:00080000:3.0:1788271871.009686:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6d81dd2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788271871.009689:0:3605:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788271871.009692:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3605:1875138590175744:0@lo:38:kworker.0 00000100:00080000:3.0:1788271871.009699:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6d82346000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788271871.009702:0:3605:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788271871.009705:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3605:1875138590176128:0@lo:38:kworker.0 00000100:00080000:3.0:1788271871.009730:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788271871.010963:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590175232:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788271871.011009:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590175360 00000100:00100000:2.0:1788271871.011015:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590175360 00000100:00100000:2.0:1788271871.011069:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1788271871.011080:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+19:3608:x1875138590175360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271871.011169:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4eab87b-0440-4f90-8c88-4ffaef16406f+19:3608:x1875138590175360:12345-0@lo:400:kworker.0 Request processed in 90us (2830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271871.011177:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1788271871.011242:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83b3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f4eab87b-0440-4f90-8c88-4ffaef16406f:3608:1875138590175360:0@lo:400:kworker.0 00000100:00100000:1.0:1788271871.023943:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3605:x1875138590175488:12345-0@lo:38:kworker.0 Request processed in 14938us (15163us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788271871.023958:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00080000:3.0:1788271871.024043:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6eb4a19800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788271871.024056:0:3605:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788271871.024063:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3605:1875138590175488:0@lo:38:kworker.0 00010000:00010000:0.0:1788271871.389783:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271872.414069:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:02000400:0.0:1788271873.053759:0:15221:0:(genops.c:1852:obd_exports_barrier()) lustre-MDT0000 is waiting for obd_unlinked_exports more than 8 seconds. The obd refcount = 3. Is it stuck? 00000020:01000000:0.0:1788271873.065082:0:15221:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f6d82175f00 - data ffff8f6ea674c798/ffff8f6eb4f3fc00 00000020:01000000:0.0:1788271873.065258:0:15221:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f6eb3df1960 - data ffff8f6e907ce360/ffff8f6ebc732000 00000001:00000004:0.0:1788271873.075045:0:15221:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00080000:3.0:1788271873.139144:0:15221:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788271873.140592:0:15221:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1788271873.140633:0:15221:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8f6d8313dc00 x1875138590171008/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788271868 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271873.140664:0:15221:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788271873.144554:0:15221:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788271873.144562:0:15221:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1788271873.144647:0:15221:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788271873.144650:0:15221:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788271873.153853:0:8450:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788271873.153860:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:2.0:1788271873.153871:0:8450:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788271873.154465:0:15221:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788271873.154471:0:15221:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967326 gen 4 00000004:00080000:3.0:1788271873.154490:0:15221:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788271873.154493:0:15221:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788271873.155035:0:9904:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788271873.155039:0:9904:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:2.0:1788271873.155048:0:9904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788271873.156351:0:15221:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e278 00000020:00000080:3.0:1788271873.156374:0:15221:0:(genops.c:885:class_export_put()) final put ffff8f6eb0cec800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788271873.156429:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb0cec800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788271873.158828:0:15221:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e28d 00000020:00000080:3.0:1788271873.158837:0:15221:0:(genops.c:885:class_export_put()) final put ffff8f6eb080e800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788271873.158856:0:15221:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788271873.158861:0:15221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788271873.158868:0:15221:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788271873.158872:0:15221:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8f6eb0cfb370) has no exports 00000020:00000080:2.0:1788271873.158892:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb080e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:3.0:1788271873.159020:0:15221:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788271873.159028:0:15221:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e6c3 00000020:00000080:3.0:1788271873.159032:0:15221:0:(genops.c:885:class_export_put()) final put ffff8f6d81dd0800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788271873.159044:0:15221:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788271873.159047:0:15221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788271873.159056:0:15221:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788271873.159059:0:15221:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff8f6eb4e93370) has no exports 00000020:00000080:3.0:1788271873.159064:0:15221:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e6bc 00000020:00000080:3.0:1788271873.159067:0:15221:0:(genops.c:885:class_export_put()) final put ffff8f6eb4ed9000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788271873.159132:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6d81dd0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788271873.159144:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb4ed9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788271873.160154:0:15221:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788271873.160160:0:15221:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788271873.160164:0:15221:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967326 gen 5 00000004:00080000:3.0:1788271873.160180:0:15221:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788271873.160183:0:15221:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788271873.160267:0:15221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788271873.160278:0:15221:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788271873.160285:0:15221:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e581 00000020:00000080:3.0:1788271873.160303:0:15221:0:(genops.c:885:class_export_put()) final put ffff8f6d81d6e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788271873.160403:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f6eb4edf000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788271873.160411:0:8:0:(genops.c:885:class_export_put()) final put ffff8f6ebfb72800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788271873.160414:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6ebfb72800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788271873.160426:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788271873.160985:0:15221:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788271873.160991:0:15221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788271873.160998:0:15221:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788271873.161001:0:15221:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8f6eb3cd19b8) has no exports 00000020:00000080:3.0:1788271873.161007:0:15221:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e57a 00000020:00000080:3.0:1788271873.161012:0:15221:0:(genops.c:885:class_export_put()) final put ffff8f6d81d69800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788271873.161258:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6d81d6e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788271873.161266:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6d81d69800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788271873.161479:0:15221:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788271873.161484:0:15221:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788271873.161487:0:15221:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1788271873.161491:0:15221:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788271873.161493:0:15221:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788271873.161563:0:15221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788271873.161571:0:15221:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788271873.161945:0:15221:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788271873.161952:0:15221:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e446 00000020:00000080:3.0:1788271873.161958:0:15221:0:(genops.c:885:class_export_put()) final put ffff8f6eb0c55800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788271873.163015:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f6ebcbd5800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788271873.163025:0:8:0:(genops.c:885:class_export_put()) final put ffff8f6d81d6e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788271873.163028:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6d81d6e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788271873.163034:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788271873.163226:0:15221:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788271873.163232:0:15221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788271873.163242:0:15221:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788271873.163246:0:15221:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8f6ea6bf3370) has no exports 00000020:00000080:3.0:1788271873.163254:0:15221:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e43f 00000020:00000080:3.0:1788271873.163259:0:15221:0:(genops.c:885:class_export_put()) final put ffff8f6eb4c7d000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788271873.164438:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb0c55800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788271873.164449:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb4c7d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788271873.191723:0:15221:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1788271873.191826:0:15221:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788271873.191832:0:15221:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1788271873.191840:0:15221:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788271873.192067:0:15221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788271873.192081:0:15221:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788271873.192104:0:15221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788271873.192107:0:15221:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788271873.192112:0:15221:0:(genops.c:885:class_export_put()) final put ffff8f6eb0cec000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788271873.192117:0:15221:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb0cec000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788271873.192128:0:15221:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788271873.192235:0:15221:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e294 00000020:00000080:2.0:1788271873.192242:0:15221:0:(genops.c:885:class_export_put()) final put ffff8f6eb0809800/lustre-MDD0000_UUID 00000020:01000000:2.0:1788271873.192248:0:15221:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788271873.192251:0:15221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788271873.192256:0:15221:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788271873.192259:0:15221:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8f6eb0cfcd28) has no exports 00000020:00000080:2.0:1788271873.192277:0:15221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788271873.192280:0:15221:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788271873.192284:0:15221:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e29b 00000020:00000080:2.0:1788271873.192296:0:15221:0:(genops.c:885:class_export_put()) final put ffff8f6eb080b000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788271873.192304:0:15221:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f6e91513000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788271873.192307:0:15221:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f6e91513000 3 00000020:01000004:2.0:1788271873.192310:0:15221:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f6e91513000 from lustre-MDT0000 00000020:00000080:2.0:1788271873.192326:0:15221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788271873.192329:0:15221:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788271873.192331:0:15221:0:(genops.c:885:class_export_put()) final put ffff8f6eb0ceb000/lustre-MDT0000_UUID 00000020:00000080:2.0:1788271873.192333:0:15221:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb0ceb000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788271873.192339:0:15221:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788271873.192379:0:15221:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1788271873.192383:0:15221:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788271873.192386:0:15221:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788271873.192388:0:15221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788271873.192391:0:15221:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788271873.192396:0:15221:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8f6e87086000 f4eab87b-0440-4f90-8c88-4ffaef16406f 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788271873.192401:0:15221:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8f6ea6bf4d28) has exports, disconnecting them 00000020:00080000:2.0:1788271873.192405:0:15221:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8f6e87086000), last request at 1788271621 00000020:00000080:2.0:1788271873.192419:0:15221:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e239 00000020:00010000:2.0:1788271873.192422:0:15221:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8f6e87086000: total 2 00000100:00080000:2.0:1788271873.192426:0:15221:0:(import.c:65:import_set_state_nolock()) ffff8f6e87084000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788271873.192442:0:15221:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f6e87086000): rc 0 00000020:00080000:2.0:1788271873.192445:0:15221:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8f6ea6bf4d28) has no exports 00000100:00100000:2.0:1788271873.192493:0:6478:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8f6ea68c3200:6478] 2 exiting: rc = 0 00000100:00100000:2.0:1788271873.192591:0:6476:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8f6e82bc5a00:6476] 0 exiting: rc = 1 00000020:00010000:2.0:1788271873.192646:0:6471:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8f6e87086000: total 2 00010000:00010000:2.0:1788271873.192680:0:6471:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f6e87086000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788271873.192707:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4ed5600/0x99288105fd38e9da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x99288105fd38e9d3 expref: 14 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271873.192722:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6ec21de600/0x99288105fd38e780 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x99288105fd38e779 expref: 13 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788271873.192820:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f6eb4c7d800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788271873.192829:0:8:0:(genops.c:885:class_export_put()) final put ffff8f6eb414a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788271873.192832:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb414a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788271873.192839:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788271873.192910:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb0809800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788271873.192914:0:8:0:(genops.c:885:class_export_put()) final put ffff8f6eb0ce9000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788271873.192916:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb0ce9000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788271873.192921:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788271873.192944:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb080b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1788271873.194699:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6e92d33200/0x99288105fd38e335 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x99288105fd38e32e expref: 12 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271873.194724:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4078600/0x99288105fd38e78e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x99288105fd38e787 expref: 11 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271873.194735:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6e92d32000/0x99288105fd38e343 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x99288105fd38e33c expref: 10 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271873.194748:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4ed5c00/0x99288105fd38e9e8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x99288105fd38e9e1 expref: 9 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271873.194758:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4ed4600/0x99288105fd38e9f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x99288105fd38e9ef expref: 8 pid: 6478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271873.194770:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4ed4000/0x99288105fd38e756 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x99288105fd38e74f expref: 7 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271873.194779:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4e20000/0x99288105fd38e7b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x99288105fd38e7b1 expref: 6 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271873.194860:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4e20400/0x99288105fd38e748 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x99288105fd38e741 expref: 5 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271873.194872:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6e92d32800/0x99288105fd38e65a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x99288105fd38e653 expref: 4 pid: 6476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271873.194884:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6ec21dfc00/0x99288105fd38e764 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x99288105fd38e75d expref: 3 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271873.194909:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4ed5000/0x99288105fd38e772 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x99288105fd38e76b expref: 2 pid: 6477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271873.194920:0:6471:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f6e87086000, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1788271873.194952:0:6471:0:(genops.c:885:class_export_put()) final put ffff8f6e87086000/f4eab87b-0440-4f90-8c88-4ffaef16406f 00010000:00010000:2.0:1788271873.195373:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271873.195377:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271873.195379:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271873.195452:0:6477:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8f6e86015e00:6477] 1 exiting: rc = 0 00000100:00100000:2.0:1788271873.195550:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195558:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195563:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195569:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195574:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195584:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195589:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195594:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195599:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195608:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195649:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195657:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195663:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195671:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195679:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195687:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195697:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195704:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195711:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195720:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195727:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195734:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195741:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195758:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195766:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195775:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195781:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195804:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195814:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195822:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195829:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195835:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195841:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195847:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195852:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195861:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195871:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195880:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195888:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195898:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195906:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195911:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195921:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195929:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195934:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195939:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195945:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195951:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195956:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195961:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195968:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195972:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.195977:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.196099:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.196105:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.196109:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.196115:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.196120:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.196130:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.196135:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.196139:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.196144:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.196149:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271873.196155:0:15221:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788271873.197206:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6e87086000/f4eab87b-0440-4f90-8c88-4ffaef16406f for MGS 00000020:00000080:1.0:1788271873.197309:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f6e87084000 for MGS 00000020:01000000:2.0:1788271873.197392:0:15221:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f6d82dd98a0 - data ffff8f6ea67700d8/ffff8f6d83158800 00000020:01000000:2.0:1788271873.197490:0:15221:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f6e82c3f960 - data ffff8f6ea6540798/ffff8f6e85bf4400 00000020:00000080:2.0:1788271873.198100:0:15221:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e21d 00000020:00000080:2.0:1788271873.198109:0:15221:0:(genops.c:885:class_export_put()) final put ffff8f6e91515800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788271873.198163:0:15221:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f6e91513000 from MGS, refs=2 00000020:01000004:2.0:1788271873.198167:0:15221:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f6e91513000 2 00000020:01000004:2.0:1788271873.198170:0:15221:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f6e91513000 from MGS 00000020:00000080:2.0:1788271873.198190:0:15221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788271873.198195:0:15221:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788271873.198198:0:15221:0:(genops.c:885:class_export_put()) final put ffff8f6e91512800/MGS 00000020:00000080:2.0:1788271873.198199:0:15221:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6e91512800/MGS for MGS 00000020:01000000:2.0:1788271873.198204:0:15221:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788271873.198262:0:15221:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788271873.198266:0:15221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788271873.198270:0:15221:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788271873.198276:0:15221:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8f6eb3d3a800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788271873.198281:0:15221:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8f6ea6bf19b8) has exports, disconnecting them 00000020:00080000:2.0:1788271873.198285:0:15221:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8f6eb3d3a800), last request at 1788271621 00000020:00000080:2.0:1788271873.198290:0:15221:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e2e8 00000020:00080000:2.0:1788271873.198300:0:15221:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f6eb3d3a800): rc 0 00000020:00000080:2.0:1788271873.198304:0:15221:0:(genops.c:885:class_export_put()) final put ffff8f6eb3d3a800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788271873.198328:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6e91515800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788271873.199248:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb3d3a800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788271873.219229:0:15221:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788271873.219237:0:15221:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788271873.219241:0:15221:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788271873.219248:0:15221:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788271873.219489:0:15221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788271873.219497:0:15221:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788271873.219504:0:15221:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f6e91513000 1 00000020:00000080:2.0:1788271873.219511:0:15221:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e20f 00000020:00000080:2.0:1788271873.219519:0:15221:0:(genops.c:885:class_export_put()) final put ffff8f6e91517000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788271873.219552:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f6eb3d38800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788271873.219561:0:36:0:(genops.c:885:class_export_put()) final put ffff8f6eb3d3f800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788271873.219564:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb3d3f800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788271873.219575:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:2.0:1788271873.219824:0:15221:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788271873.219829:0:15221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788271873.219833:0:15221:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788271873.219837:0:15221:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8f6ea6bf0000) has no exports 00000020:00000080:1.0:1788271873.222208:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6e91517000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788271873.272207:0:15221:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788271873.272221:0:15221:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788271873.272226:0:15221:0:(genops.c:885:class_export_put()) final put ffff8f6e91511000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788271873.272231:0:15221:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6e91511000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788271873.272236:0:15221:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788271873.272348:0:15221:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8f6e91517800 00000020:02000400:3.0:1788271873.272427:0:15221:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788271873.511765:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788271873.834532:0:13766:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788271874.528717:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271874.589969:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788271874.589994:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590176384:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788271874.590060:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271874.590194:0:10739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590176384 00000100:00100000:1.0:1788271874.590202:0:10739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590176384 00000100:00100000:1.0:1788271874.590269:0:10739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788271874.590280:0:10739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590176384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788271874.590311:0:10739:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788271874.590367:0:10739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590176384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271874.590374:0:10739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:2.0:1788271874.590437:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788271874.590583:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590176384:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788271875.549924:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788271876.127896:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788271876.127903:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788271876.127907:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f6eb4a19800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788271876.127917:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 432 00000100:00080000:1.0:1788271876.127922:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788271876.127928:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8f6eb4a19800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788271876.127951:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6ebfc76680 x1875138590176640/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788271876.127967:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788271876.127970:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788271876.127972:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f6eb416b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788271876.127976:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 432 00000100:00080000:1.0:1788271876.127987:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788271876.127991:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8f6eb416b000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788271876.128004:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6ebfc77480 x1875138590176768/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788271876.128013:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788271876.128016:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788271876.128017:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f6d81dd2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788271876.128020:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 432 00000100:00080000:1.0:1788271876.128023:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788271876.128025:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8f6d81dd2000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788271876.128034:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6ebfc74700 x1875138590176896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788271876.128066:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788271876.128069:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788271876.128070:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f6d82346000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788271876.128074:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 432 00000100:00080000:1.0:1788271876.128076:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788271876.128078:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f6d82346000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788271876.128088:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6ebfc75500 x1875138590177280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788271876.128142:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfc75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3607:1875138590177024:0@lo:400:kworker.0 00000100:00100000:1.0:1788271876.128203:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271876.128254:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788271876.128260:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfc77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590176512:0@lo:400:kworker.0 00000400:00000100:1.0:1788271876.128290:0:3607:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875138590176512 offset 0 length 224: 4 00000100:00100000:1.0:1788271876.128319:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83392a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590177536:0@lo:400:kworker.0 00000100:00100000:1.0:1788271876.128345:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271876.128375:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfc76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3605:1875138590176640:0@lo:38:kworker.0 00000100:00100000:1.0:1788271876.128404:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271876.128421:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfc77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3605:1875138590176768:0@lo:38:kworker.0 00000100:00100000:1.0:1788271876.128440:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271876.128455:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfc74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3605:1875138590176896:0@lo:38:kworker.0 00000100:00100000:1.0:1788271876.128474:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271876.128489:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfc75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3605:1875138590177280:0@lo:38:kworker.0 00000100:00100000:1.0:1788271876.128505:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271876.128533:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfc74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590177152:0@lo:400:kworker.0 00000100:00100000:2.0:1788271876.130185:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590177664:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788271876.131940:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271876.132012:0:8400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590177664 00000100:00100000:2.0:1788271876.132020:0:8400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590177664 00000100:00100000:2.0:1788271876.132079:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788271876.132089:0:8400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590177664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788271876.132120:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788271876.132167:0:8400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590177664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271876.132174:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:2.0:1788271876.132194:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788271876.132234:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590177664:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788271876.132287:0:14136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590176640 00000100:00100000:2.0:1788271876.132292:0:14136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590176640 00000100:00100000:2.0:1788271876.132323:0:14136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788271876.132329:0:14136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e873a3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3605:x1875138590176640:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788271876.132346:0:14136:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788271876.132385:0:14136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e873a3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3605:x1875138590176640:12345-0@lo:38:kworker.0 Request processed in 55us (3980us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788271876.132401:0:14136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788271876.133691:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271876.133737:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788271876.133823:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83390a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3608:1875138590177408:0@lo:400:kworker.0 00000100:00100000:1.0:1788271876.133866:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271876.133908:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590177024 00000100:00100000:1.0:1788271876.133913:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590177024 00000100:00100000:1.0:1788271876.133954:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590176768 00000100:00100000:1.0:1788271876.133957:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590176768 00000100:00100000:1.0:1788271876.133967:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590176896 00000100:00100000:1.0:1788271876.133969:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590176896 00000100:00100000:1.0:1788271876.133977:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590177280 00000100:00100000:1.0:1788271876.133979:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590177280 00000100:00100000:1.0:1788271876.133986:0:12164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590177408 00000100:00100000:1.0:1788271876.133988:0:12164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590177408 00000100:00100000:1.0:1788271876.134004:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788271876.134020:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83393b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875138590177024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271876.134069:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83393b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3607:x1875138590177024:12345-0@lo:400:kworker.0 Request processed in 50us (5865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271876.134076:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788271876.134093:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1788271876.134099:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83391c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875138590177408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271876.134130:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83391c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3608:x1875138590177408:12345-0@lo:400:kworker.0 Request processed in 32us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271876.134136:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1788271876.134148:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788271876.134152:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83392300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3605:x1875138590176768:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788271876.134169:0:12164:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788271876.134197:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83392300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3605:x1875138590176768:12345-0@lo:38:kworker.0 Request processed in 44us (5755us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788271876.134203:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788271876.134216:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788271876.134220:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83391180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3605:x1875138590176896:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788271876.134228:0:12164:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788271876.134253:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83391180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3605:x1875138590176896:12345-0@lo:38:kworker.0 Request processed in 32us (5778us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788271876.134259:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788271876.134269:0:12164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788271876.134273:0:12164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83390700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3605:x1875138590177280:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788271876.134281:0:12164:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788271876.134326:0:12164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83390700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3605:x1875138590177280:12345-0@lo:38:kworker.0 Request processed in 52us (5819us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788271876.134333:0:12164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788271876.134360:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590177536 00000100:00100000:1.0:1788271876.134364:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590177536 00000100:00100000:1.0:1788271876.134388:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590177152 00000100:00100000:1.0:1788271876.134390:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590177152 00000100:00100000:1.0:1788271876.134409:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788271876.134415:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83392d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590177536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271876.134449:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83392d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590177536:12345-0@lo:400:kworker.0 Request processed in 34us (6103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271876.134456:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788271876.134467:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788271876.134473:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83391500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590177152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271876.134500:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83391500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590177152:12345-0@lo:400:kworker.0 Request processed in 28us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271876.134507:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:1.0:1788271876.134524:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788271876.134528:0:6479:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788271876.136943:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6eb4a19800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788271876.136957:0:3605:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788271876.136963:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfc76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3605:1875138590176640:0@lo:38:kworker.0 00000100:00080000:1.0:1788271876.136993:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6eb416b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788271876.136997:0:3605:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788271876.137001:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfc77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3605:1875138590176768:0@lo:38:kworker.0 00000100:00080000:1.0:1788271876.137013:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6d81dd2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788271876.137027:0:3605:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788271876.137030:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfc74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3605:1875138590176896:0@lo:38:kworker.0 00000100:00080000:1.0:1788271876.137044:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6d82346000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788271876.137047:0:3605:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788271876.137050:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfc75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3605:1875138590177280:0@lo:38:kworker.0 00000100:00100000:1.0:1788271876.137322:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83392a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590177536:0@lo:400:kworker.0 00010000:00080000:1.0:1788271876.137340:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8f6ebfc75c00 x1875138590177024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271876.137352:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfc75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3607:1875138590177024:0@lo:400:kworker.0 00010000:00080000:1.0:1788271876.137384:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8f6d83390a80 x1875138590177408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271892 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271876.137394:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83390a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3608:1875138590177408:0@lo:400:kworker.0 00000100:00100000:1.0:1788271876.137406:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfc74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590177152:0@lo:400:kworker.0 00010000:00010000:2.0:1788271876.574019:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788271876.728517:0:15423:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1788271876.743141:0:15423:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1788271876.743194:0:15423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4800/0x99288105fd38e779 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e780 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.743209:0:15423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4800/0x99288105fd38e779 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e780 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.743217:0:15423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4800/0x99288105fd38e779 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x99288105fd38e780 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.743224:0:15423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4800/0x99288105fd38e779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x99288105fd38e780 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.743248:0:15423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788271876.743253:0:15423:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788271876.743277:0:15423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788271876.743282:0:15423:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788271876.743288:0:15423:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788271876.743293:0:15423:0:(import.c:65:import_set_state_nolock()) ffff8f6eb416b000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788271876.743309:0:15423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788271876.743311:0:15423:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788271876.743314:0:15423:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788271876.744342:0:15423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20c00/0x99288105fd38e787 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e78e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.744355:0:15423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20c00/0x99288105fd38e787 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e78e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.744378:0:15423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20c00/0x99288105fd38e787 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x99288105fd38e78e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.744385:0:15423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20c00/0x99288105fd38e787 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x99288105fd38e78e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.744402:0:15423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788271876.744407:0:15423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21a00/0x99288105fd38e653 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e65a expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.744413:0:15423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21a00/0x99288105fd38e653 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e65a expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.744418:0:15423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21a00/0x99288105fd38e653 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x99288105fd38e65a expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.744423:0:15423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21a00/0x99288105fd38e653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x99288105fd38e65a expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.744434:0:15423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788271876.744440:0:15423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079200/0x99288105fd38e9ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e9f6 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.744446:0:15423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079200/0x99288105fd38e9ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e9f6 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.744452:0:15423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079200/0x99288105fd38e9ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x99288105fd38e9f6 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.744469:0:15423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079200/0x99288105fd38e9ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x99288105fd38e9f6 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.744484:0:15423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1788271876.744498:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788271876.744504:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4800/0x99288105fd38e779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x99288105fd38e780 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.744510:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4ed4800 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:2.0:1788271876.744514:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4800/0x99288105fd38e779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x99288105fd38e780 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.744523:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4800/0x99288105fd38e779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x99288105fd38e780 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788271876.744532:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4800/0x99288105fd38e779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x99288105fd38e780 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271876.744538:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788271876.744541:0:6471:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788271876.744543:0:6471:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788271876.744576:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4800/0x99288105fd38e779 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x99288105fd38e780 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.744582:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788271876.744602:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4800/0x99288105fd38e779 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x99288105fd38e780 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.744608:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4800/0x99288105fd38e779 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x99288105fd38e780 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.744657:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788271876.744661:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20c00/0x99288105fd38e787 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x99288105fd38e78e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.744667:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e20c00 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:2.0:1788271876.744669:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20c00/0x99288105fd38e787 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x99288105fd38e78e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.744676:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20c00/0x99288105fd38e787 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x99288105fd38e78e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788271876.744682:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20c00/0x99288105fd38e787 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x99288105fd38e78e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271876.744687:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788271876.744689:0:6471:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:2.0:1788271876.744701:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20c00/0x99288105fd38e787 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x99288105fd38e78e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.744707:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788271876.744713:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20c00/0x99288105fd38e787 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x99288105fd38e78e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.744719:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e20c00/0x99288105fd38e787 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x99288105fd38e78e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.744728:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788271876.744730:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21a00/0x99288105fd38e653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x99288105fd38e65a expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.744747:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e21a00 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:2.0:1788271876.744750:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21a00/0x99288105fd38e653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x99288105fd38e65a expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.744756:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21a00/0x99288105fd38e653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x99288105fd38e65a expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788271876.744762:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21a00/0x99288105fd38e653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x99288105fd38e65a expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271876.744767:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788271876.744769:0:6471:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788271876.744771:0:6471:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788271876.744783:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21a00/0x99288105fd38e653 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x99288105fd38e65a expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.744789:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788271876.744805:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21a00/0x99288105fd38e653 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x99288105fd38e65a expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.744813:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6eb4e21a00/0x99288105fd38e653 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x99288105fd38e65a expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.744826:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271876.744829:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079200/0x99288105fd38e9ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x99288105fd38e9f6 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.744834:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4079200 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:2.0:1788271876.744836:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079200/0x99288105fd38e9ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x99288105fd38e9f6 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.744851:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079200/0x99288105fd38e9ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x99288105fd38e9f6 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788271876.744856:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079200/0x99288105fd38e9ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x99288105fd38e9f6 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271876.744861:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788271876.744863:0:6471:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788271876.744865:0:6471:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788271876.744878:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079200/0x99288105fd38e9ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x99288105fd38e9f6 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.744884:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788271876.744890:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079200/0x99288105fd38e9ef lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x99288105fd38e9f6 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.744895:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079200/0x99288105fd38e9ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x99288105fd38e9f6 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.744903:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271876.744905:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271876.744906:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271876.744925:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590177920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788271876.744989:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271876.745038:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788271876.745045:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590177792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788271876.745066:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788271876.745095:0:15423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e80031800/0x99288105fd38e33c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e343 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.745113:0:15423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e80031800/0x99288105fd38e33c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e343 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.745120:0:15423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e80031800/0x99288105fd38e33c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x99288105fd38e343 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.745126:0:15423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff8f6e80031800/0x99288105fd38e33c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x99288105fd38e343 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.745137:0:15423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788271876.745141:0:15423:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:2.0:1788271876.745143:0:15423:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:2.0:1788271876.745169:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271876.745172:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6e80031800/0x99288105fd38e33c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x99288105fd38e343 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.745178:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e80031800 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:2.0:1788271876.745180:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6e80031800/0x99288105fd38e33c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x99288105fd38e343 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.745186:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6e80031800/0x99288105fd38e33c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x99288105fd38e343 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788271876.745192:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6e80031800/0x99288105fd38e33c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x99288105fd38e343 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271876.745197:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788271876.745199:0:6471:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788271876.745201:0:6471:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788271876.745218:0:6471:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6e80031800/0x99288105fd38e33c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x99288105fd38e343 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.745224:0:6471:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788271876.745232:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6e80031800/0x99288105fd38e33c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x99288105fd38e343 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.745239:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6e80031800/0x99288105fd38e33c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x99288105fd38e343 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271876.745251:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271876.745253:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271876.745255:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271876.745262:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788271876.745269:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590178304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788271876.745291:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1788271876.745332:0:15423:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1788271876.745336:0:15423:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1788271876.745340:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788271876.745345:0:15423:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788271876.745350:0:15423:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8f6d81d68000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788271876.745355:0:15423:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8f6eb4c7e800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788271876.745360:0:15423:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff8f6eb41719b8) has exports, disconnecting them 00000020:00080000:2.0:1788271876.745363:0:15423:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8f6d81d68000), last request at 1788271876 00000020:00000080:2.0:1788271876.745370:0:15423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e61b 00000100:00080000:2.0:1788271876.745383:0:15423:0:(import.c:65:import_set_state_nolock()) ffff8f6d81d6a000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788271876.745412:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788271876.745422:0:15423:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f6d81d68000): rc 0 00000020:00000080:2.0:1788271876.745424:0:15423:0:(genops.c:885:class_export_put()) final put ffff8f6d81d68000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1788271876.745439:0:15423:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8f6eb4c7e800), last request at 1788271876 00000020:00000080:2.0:1788271876.745447:0:15423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e4f5 00000100:00080000:2.0:1788271876.745452:0:15423:0:(import.c:65:import_set_state_nolock()) ffff8f6eb4c7a800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788271876.745463:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788271876.745469:0:15423:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f6eb4c7e800): rc 0 00000020:00000080:2.0:1788271876.745471:0:15423:0:(genops.c:885:class_export_put()) final put ffff8f6eb4c7e800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1788271876.745478:0:15423:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa349c185bae0 00000100:00080000:2.0:1788271876.745494:0:15423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788271876.745501:0:15423:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8f6d8313fb80 x1875138590171904/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788271876 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271876.745510:0:15423:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00010000:00010000:0.0:1788271876.746501:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271876.746510:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271876.746515:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271876.746533:0:9485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590177920 00000100:00100000:0.0:1788271876.746551:0:9485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590177920 00000100:00100000:0.0:1788271876.746593:0:9485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590177792 00000100:00100000:0.0:1788271876.746596:0:9485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590177792 00000100:00100000:0.0:1788271876.746611:0:9485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590178304 00000100:00100000:0.0:1788271876.746614:0:9485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590178304 00000100:00100000:0.0:1788271876.746850:0:9485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788271876.746858:0:9485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3609:x1875138590177920:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788271876.746866:0:9485:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788271876 with bad export cookie 11036212749594583609 00000020:00000080:3.0:1788271876.749744:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6d81d68000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1788271876.749842:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb4c7e800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1788271876.749865:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f6d81d6a000 for lustre-MDT0001 00000020:00000080:3.0:1788271876.749870:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f6eb4c7a800 for lustre-MDT0001 00000100:00100000:3.0:1788271876.749899:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590178048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788271876.749966:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271876.750003:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590171904:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788271876.750027:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788271876.750033:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590178176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788271876.750054:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788271876.750356:0:15423:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788271876.750362:0:15423:0:(import.c:65:import_set_state_nolock()) ffff8f6eb4a19800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:1.0:1788271876.750760:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590178048 00000100:00100000:1.0:1788271876.750770:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590178048 00000100:00100000:1.0:1788271876.750797:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590178176 00000100:00100000:1.0:1788271876.750800:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590178176 00000100:00080000:2.0:1788271876.751179:0:15423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788271876.751184:0:15423:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:2.0:1788271876.751204:0:15423:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788271876.751264:0:15423:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788271876.751285:0:15423:0:(import.c:65:import_set_state_nolock()) ffff8f6eb63e7000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788271876.751309:0:15423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788271876.751311:0:15423:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:2.0:1788271876.751321:0:15423:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788271876.751388:0:15423:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788271876.751397:0:15423:0:(import.c:65:import_set_state_nolock()) ffff8f6d830f3800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788271876.751419:0:15423:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8f6eb41719b8) has no exports 00000100:00100000:1.0:1788271876.751911:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788271876.751922:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3609:x1875138590177792:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788271876.751929:0:6470:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788271876 with bad export cookie 11036212749594583609 00000100:00100000:1.0:1788271876.752003:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3609:x1875138590177792:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (6936us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788271876.752011:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788271876.752040:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788271876.752044:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3609:x1875138590178304:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788271876.752048:0:6470:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788271876 with bad export cookie 11036212749594583609 00000100:00100000:1.0:1788271876.752074:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3609:x1875138590178304:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (6782us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788271876.752079:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788271876.752089:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788271876.752092:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83250000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3606:x1875138590178048:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788271876.752096:0:6470:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788271876 with bad export cookie 11036212749594583609 00000100:00100000:1.0:1788271876.752123:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83250000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3606:x1875138590178048:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (2158us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788271876.752129:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788271876.752141:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788271876.752145:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83253b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3606:x1875138590178176:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788271876.752149:0:6470:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788271876 with bad export cookie 11036212749594583609 00000100:00100000:1.0:1788271876.752171:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83253b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3606:x1875138590178176:12345-0@lo:103:ldlm_bl.0 Request processed in 25us (2116us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788271876.752177:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788271876.752200:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3605:1875138590178432:0@lo:9:umount.0 00000100:00100000:1.0:1788271876.752235:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271876.752255:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3605:1875138590178560:0@lo:9:umount.0 00000100:00100000:1.0:1788271876.752274:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271876.752313:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590178432 00000100:00100000:1.0:1788271876.752319:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590178432 00000100:00100000:1.0:1788271876.752349:0:8397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590178560 00000100:00100000:1.0:1788271876.752353:0:8397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590178560 00000100:00100000:1.0:1788271876.752380:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788271876.752386:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83390a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3605:x1875138590178432:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788271876.752407:0:8397:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e542 00000100:00080000:1.0:1788271876.752415:0:8397:0:(import.c:65:import_set_state_nolock()) ffff8f6eb63e5000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788271876.752452:0:8397:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1788271876.752574:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83390a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3605:x1875138590178432:12345-0@lo:9:umount.0 Request processed in 188us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271876.752580:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788271876.752592:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788271876.752598:0:8397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83392a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3605:x1875138590178560:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788271876.752609:0:8397:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e684 00000100:00080000:1.0:1788271876.752615:0:8397:0:(import.c:65:import_set_state_nolock()) ffff8f6d81dd1000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788271876.752673:0:8397:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:1.0:1788271876.752745:0:8397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83392a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3605:x1875138590178560:12345-0@lo:9:umount.0 Request processed in 146us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271876.752751:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00010000:1.0:1788271876.752771:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788271876.752796:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6eb63e7000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788271876.752805:0:3605:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788271876.752806:0:3605:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788271876.752810:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3605:1875138590178432:0@lo:9:umount.0 00000100:00080000:1.0:1788271876.752954:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6d830f3800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788271876.752963:0:3605:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788271876.752965:0:3605:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788271876.752968:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3605:1875138590178560:0@lo:9:umount.0 00010000:00010000:1.0:1788271876.753011:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788271876.754978:0:3609:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.103@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788271876.754985:0:3609:0:(import.c:65:import_set_state_nolock()) ffff8f6e85918800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788271876.754990:0:3609:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.103@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:0.0:1788271876.760173:0:9485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3609:x1875138590177920:12345-0@lo:103:ldlm_bl.0 Request processed in 13308us (15177us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788271876.760186:0:9485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788271876.761686:0:3606:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.103@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788271876.778777:0:3609:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.103@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788271876.778783:0:3609:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788271876.778878:0:3609:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f6ebfc77b80 x1875138590176512/t0(0) o400->MGC192.168.201.103@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788271892 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271876.778967:0:3609:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f6d8313ce00 x1875138590177920/t0(0) o103->MGC192.168.201.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788271892 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271876.778976:0:3609:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f6d8313f480 x1875138590177792/t0(0) o103->MGC192.168.201.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788271892 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271876.778984:0:3609:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f6d8313e300 x1875138590178304/t0(0) o103->MGC192.168.201.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788271892 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271876.778991:0:3609:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f6d8313c700 x1875138590178048/t0(0) o103->MGC192.168.201.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788271892 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271876.778999:0:3609:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f6d8313ca80 x1875138590178176/t0(0) o103->MGC192.168.201.103@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788271892 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788271876.779040:0:3609:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788271876.779043:0:3609:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788271876.779045:0:3609:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788271876.779100:0:3606:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8f6e85918800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1788271876.779125:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590178048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788271876.779152:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f4eab87b-0440-4f90-8c88-4ffaef16406f:3606:1875138590178176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788271876.779220:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfc77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f4eab87b-0440-4f90-8c88-4ffaef16406f:3607:1875138590176512:0@lo:400:kworker.0 00000100:00080000:2.0:1788271876.779375:0:3609:0:(import.c:65:import_set_state_nolock()) ffff8f6e85918800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788271876.779381:0:3609:0:(import.c:510:import_select_connection()) MGC192.168.201.103@tcp: connect to NID 0@lo last attempt 182 00000100:00080000:2.0:1788271876.779388:0:3609:0:(import.c:624:import_select_connection()) MGC192.168.201.103@tcp: import ffff8f6e85918800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788271876.779415:0:3609:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d8406c380 x1875138590178688/t0(0) o250->MGC192.168.201.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788271876.779462:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f4eab87b-0440-4f90-8c88-4ffaef16406f:3605:1875138590178688:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:1.0:1788271876.779508:0:3605:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875138590178688 offset 0 length 520: 4 00000100:00100000:2.0:1788271876.779663:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590177792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788271876.779670:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590177920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788271876.779686:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f4eab87b-0440-4f90-8c88-4ffaef16406f:3609:1875138590178304:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1788271876.786393:0:15423:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8f6eb41719b8) has no exports 00000020:01000000:0.0:1788271876.840132:0:15423:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f6d82175840 - data ffff8f6ea6708870/ffff8f6eb4f3e000 00000020:01000000:0.0:1788271876.840293:0:15423:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f6e84c9ec00 - data ffff8f6ea65c5948/ffff8f6eb4ce3400 00000001:00000004:1.0:1788271876.858878:0:15423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:0.0:1788271876.904089:0:15423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788271876.904099:0:15423:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1788271876.904107:0:15423:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788271876.910870:0:15423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788271876.910879:0:15423:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:0.0:1788271876.910901:0:15423:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788271876.910903:0:15423:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788271876.911223:0:8444:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788271876.911229:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:3.0:1788271876.911240:0:8444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1788271876.912018:0:15423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788271876.912022:0:15423:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:0.0:1788271876.912038:0:15423:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788271876.912040:0:15423:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788271876.912286:0:9897:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788271876.912290:0:9897:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:2.0:1788271876.912308:0:9897:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1788271876.915808:0:15423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e35f 00000020:00000080:0.0:1788271876.915820:0:15423:0:(genops.c:885:class_export_put()) final put ffff8f6eb416b800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788271876.916984:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb416b800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788271876.918107:0:15423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e374 00000020:00000080:2.0:1788271876.918119:0:15423:0:(genops.c:885:class_export_put()) final put ffff8f6eb4188000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788271876.918136:0:15423:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1788271876.918141:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788271876.918149:0:15423:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788271876.918153:0:15423:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8f6eb4174d28) has no exports 00000004:01000000:2.0:1788271876.918338:0:15423:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788271876.918347:0:15423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e67d 00000020:00000080:2.0:1788271876.918352:0:15423:0:(genops.c:885:class_export_put()) final put ffff8f6d82dab000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788271876.918356:0:15423:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788271876.918359:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788271876.918365:0:15423:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788271876.918368:0:15423:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff8f6d82353370) has no exports 00000020:00000080:2.0:1788271876.918373:0:15423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e676 00000020:00000080:2.0:1788271876.918377:0:15423:0:(genops.c:885:class_export_put()) final put ffff8f6d830f2000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788271876.918709:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb4188000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:3.0:1788271876.918718:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6d82dab000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788271876.918734:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6d830f2000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788271876.919094:0:15423:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788271876.919099:0:15423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788271876.919103:0:15423:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1788271876.919109:0:15423:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788271876.919111:0:15423:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788271876.919164:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788271876.919172:0:15423:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788271876.919178:0:15423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e53b 00000020:00000080:3.0:1788271876.919184:0:15423:0:(genops.c:885:class_export_put()) final put ffff8f6eb4eda000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788271876.919188:0:15423:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788271876.919192:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788271876.919195:0:15423:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788271876.919198:0:15423:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8f6ebc9919b8) has no exports 00000020:00000080:3.0:1788271876.919203:0:15423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e534 00000020:00000080:3.0:1788271876.919205:0:15423:0:(genops.c:885:class_export_put()) final put ffff8f6eb63e1000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788271876.919428:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f6d830f3800 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788271876.919436:0:8:0:(genops.c:885:class_export_put()) final put ffff8f6d82dad800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788271876.919438:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6d82dad800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1788271876.919443:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788271876.919523:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb4eda000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788271876.919528:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb63e1000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788271876.920039:0:15423:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788271876.920044:0:15423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788271876.920047:0:15423:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1788271876.920052:0:15423:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788271876.920054:0:15423:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788271876.920099:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788271876.920106:0:15423:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1788271876.920118:0:15423:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788271876.920124:0:15423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e397 00000020:00000080:3.0:1788271876.920130:0:15423:0:(genops.c:885:class_export_put()) final put ffff8f6eb4b8a000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788271876.920135:0:15423:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1788271876.920139:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788271876.920142:0:15423:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788271876.920144:0:15423:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8f6e85becd28) has no exports 00000020:00000080:3.0:1788271876.920148:0:15423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e390 00000020:00000080:3.0:1788271876.920151:0:15423:0:(genops.c:885:class_export_put()) final put ffff8f6eb4a1e800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788271876.920372:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f6eb63e7000 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788271876.920379:0:8:0:(genops.c:885:class_export_put()) final put ffff8f6d81dd4800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788271876.920381:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6d81dd4800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1788271876.920386:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788271876.920428:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb4b8a000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1788271876.920432:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb4a1e800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788271876.922973:0:15423:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1788271876.922981:0:15423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788271876.922986:0:15423:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1788271876.922993:0:15423:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788271876.923040:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788271876.923050:0:15423:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788271876.923073:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788271876.923076:0:15423:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788271876.923081:0:15423:0:(genops.c:885:class_export_put()) final put ffff8f6eb416c800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788271876.923086:0:15423:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb416c800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1788271876.923092:0:15423:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788271876.923252:0:15423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e37b 00000020:00000080:2.0:1788271876.923259:0:15423:0:(genops.c:885:class_export_put()) final put ffff8f6eb418f000/lustre-MDD0001_UUID 00000020:01000000:2.0:1788271876.923264:0:15423:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1788271876.923269:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788271876.923273:0:15423:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788271876.923289:0:15423:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8f6eb4173370) has no exports 00000020:00000080:2.0:1788271876.923328:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788271876.923333:0:15423:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1788271876.923338:0:15423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e382 00000020:00000080:2.0:1788271876.923342:0:15423:0:(genops.c:885:class_export_put()) final put ffff8f6eb418a000/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1788271876.923350:0:15423:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f6eb0cef800 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1788271876.923353:0:15423:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f6eb0cef800 2 00000020:01000004:2.0:1788271876.923357:0:15423:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f6eb0cef800 from lustre-MDT0001 00000020:00000080:2.0:1788271876.923374:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788271876.923377:0:15423:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1788271876.923379:0:15423:0:(genops.c:885:class_export_put()) final put ffff8f6eb416a000/lustre-MDT0001_UUID 00000020:00000080:2.0:1788271876.923382:0:15423:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb416a000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1788271876.923390:0:15423:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1788271876.923418:0:15423:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1788271876.923421:0:15423:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1788271876.923424:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788271876.923427:0:15423:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788271876.923434:0:15423:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8f6eb416f000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788271876.923439:0:15423:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff8f6eb4170000) has exports, disconnecting them 00000020:00080000:2.0:1788271876.923443:0:15423:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8f6eb416f000), last request at 1788271639 00000020:00000080:2.0:1788271876.923446:0:15423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e3d6 00000020:00080000:2.0:1788271876.923457:0:15423:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f6eb416f000): rc 0 00000020:00000080:2.0:1788271876.923460:0:15423:0:(genops.c:885:class_export_put()) final put ffff8f6eb416f000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1788271876.924199:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f6eb4a19800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1788271876.924209:0:8:0:(genops.c:885:class_export_put()) final put ffff8f6e8591d000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788271876.924211:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6e8591d000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1788271876.924219:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788271876.924346:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb418f000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1788271876.924350:0:8:0:(genops.c:885:class_export_put()) final put ffff8f6eb416a800/lustre-MDD0001_UUID 00000020:00000080:0.0:1788271876.924352:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb416a800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1788271876.924356:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1788271876.924521:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb418a000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788271876.924525:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb416f000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1788271876.953086:0:15423:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1788271876.953094:0:15423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788271876.953099:0:15423:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788271876.953106:0:15423:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788271876.953332:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788271876.953342:0:15423:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1788271876.953359:0:15423:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f6eb0cef800 1 00000020:00000080:3.0:1788271876.953366:0:15423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e312 00000020:00000080:3.0:1788271876.953376:0:15423:0:(genops.c:885:class_export_put()) final put ffff8f6eb3eb2000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788271876.953399:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f6eb416b000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1788271876.953408:0:8:0:(genops.c:885:class_export_put()) final put ffff8f6eb4189800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1788271876.953411:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb4189800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1788271876.953423:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000000:3.0:1788271876.954073:0:15423:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1788271876.954079:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788271876.954085:0:15423:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788271876.954090:0:15423:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8f6eb0cf99b8) has no exports 00000020:00000080:0.0:1788271876.956541:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb3eb2000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788271876.998975:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788271876.998988:0:15423:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1788271876.998993:0:15423:0:(genops.c:885:class_export_put()) final put ffff8f6eb0ceb800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788271876.998998:0:15423:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb0ceb800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1788271876.999013:0:15423:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1788271877.000889:0:15423:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8f6eb0cef000 00000020:01000000:0.0:1788271877.000917:0:15423:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788271877.000924:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788271877.000930:0:15423:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788271877.000934:0:15423:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8f6e85be8000) has no exports 00000100:00100000:1.0:1788271877.001091:0:12164:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8f6d83254200:12164] 4 exiting: rc = 0 00000100:00100000:1.0:1788271877.001220:0:6485:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8f6e85e5c800:6485] 2 exiting: rc = 0 00000100:00100000:1.0:1788271877.001291:0:9899:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8f6eb4fc2a00:9899] 3 exiting: rc = 0 00000100:00100000:2.0:1788271877.001429:0:6484:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8f6eb3582000:6484] 1 exiting: rc = 0 00000100:00100000:2.0:1788271877.001499:0:6483:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8f6eb3583e00:6483] 0 exiting: rc = 1 00000100:00100000:0.0:1788271877.002031:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002040:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002046:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002052:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002057:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002064:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002069:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002074:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002080:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002084:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002090:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002097:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002102:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002107:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002113:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002119:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002125:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002130:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002136:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002141:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002146:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002151:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002156:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002161:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002166:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002171:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002176:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002182:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002188:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002207:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002213:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002219:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002225:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002230:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002234:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002240:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002245:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002250:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002255:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002260:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002265:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002269:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002274:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002281:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002286:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002292:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002310:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002316:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002322:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002327:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002332:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002338:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002342:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002348:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002354:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002359:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002366:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002371:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002377:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002383:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002393:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002398:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002405:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.002411:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271877.005313:0:6486:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8f6e82bc5000:6486] 0 exiting: rc = 1 00000100:00100000:0.0:1788271877.005498:0:6487:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8f6e839ac200:6487] 1 exiting: rc = 0 00000100:00100000:1.0:1788271877.005742:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005751:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005758:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005764:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005770:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005776:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005781:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005785:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005789:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005793:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005797:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005801:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005805:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005809:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005814:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005819:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005824:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005828:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005834:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005839:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005844:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005850:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005855:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005860:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005864:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005867:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005882:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005886:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005889:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005892:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005896:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005899:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005903:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005905:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005909:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005912:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005914:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005918:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005921:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005924:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005927:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005930:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005933:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005935:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005938:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005941:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005945:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005947:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005950:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005953:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005956:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005959:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005962:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005965:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005969:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005972:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005975:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005978:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005981:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005983:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005986:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005993:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.005998:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.006010:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.006517:0:6489:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8f6eb36e5200:6489] 1 exiting: rc = 0 00000100:00100000:2.0:1788271877.006914:0:14136:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8f6d82099a00:14136] 2 exiting: rc = 0 00000100:00100000:3.0:1788271877.007422:0:6488:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8f6eb36e4200:6488] 0 exiting: rc = 1 00000100:00100000:0.0:1788271877.007600:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007606:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007611:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007639:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007647:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007652:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007658:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007664:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007675:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007682:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007687:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007693:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007699:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007705:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007710:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007717:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007724:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007731:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007736:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007740:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007755:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007759:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007763:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007767:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007771:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007775:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007779:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007782:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007786:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007790:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007794:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007797:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007810:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007825:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007829:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007835:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007841:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007847:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007853:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007859:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007865:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007870:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007875:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007879:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007893:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007898:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007902:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007906:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007910:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007914:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007918:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007923:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007927:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007931:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007934:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007938:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007952:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007956:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007960:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007963:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007968:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007972:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007976:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.007980:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271877.014072:0:6491:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8f6e9ab59a00:6491] 1 exiting: rc = 0 00000100:00100000:0.0:1788271877.014242:0:6490:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8f6e9ab58000:6490] 0 exiting: rc = 1 00000100:00100000:1.0:1788271877.014432:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014439:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014445:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014450:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014455:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014459:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014464:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014469:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014475:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014480:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014485:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014490:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014494:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014499:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014504:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014508:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014513:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014517:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014522:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014527:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014531:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014536:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014540:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014605:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014611:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014615:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014699:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014704:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014708:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014712:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014716:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014720:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014736:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014741:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014746:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014751:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014755:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014760:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014765:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014771:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014776:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014781:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014787:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014792:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014796:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014802:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014807:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014812:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014818:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014823:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014828:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014832:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014837:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014842:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014847:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014852:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014857:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014861:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014866:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014871:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014876:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014881:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014886:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.014890:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271877.015398:0:6493:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8f6e9ab59400:6493] 1 exiting: rc = 0 00000100:00100000:2.0:1788271877.015506:0:6492:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8f6e9ab59c00:6492] 0 exiting: rc = 1 00000100:00100000:0.0:1788271877.015987:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.015993:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.015998:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016013:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016018:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016023:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016028:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016033:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016038:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016044:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016048:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016054:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016059:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016064:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016068:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016073:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016077:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016081:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016086:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016091:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016095:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016100:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016105:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016109:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016114:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016120:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016125:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016130:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016134:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016139:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016145:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016150:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016155:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016160:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016165:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016171:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016175:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016180:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016193:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016198:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016203:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016208:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016214:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016218:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016224:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016228:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016233:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016239:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016244:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016248:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016254:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016259:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016264:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016268:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016274:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016278:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016284:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016289:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016304:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016310:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016315:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016320:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016325:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.016330:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788271877.017214:0:6494:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8f6e9ab58400:6494] 0 exiting: rc = 1 00000100:00100000:3.0:1788271877.017343:0:6495:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8f6e9ab58a00:6495] 1 exiting: rc = 0 00000100:00100000:0.0:1788271877.017434:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017441:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017446:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017451:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017456:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017461:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017467:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017472:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017477:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017493:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017498:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017504:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017511:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017517:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017523:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017529:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017535:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017539:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017815:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017823:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017827:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017832:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017837:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017841:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017847:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017853:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017858:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017863:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017869:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017874:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017879:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017885:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017889:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017895:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017900:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017906:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017911:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017916:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017921:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017926:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017931:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017936:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017941:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017946:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017960:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017965:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017971:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017976:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017982:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017987:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017993:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.017998:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.018002:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.018007:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.018012:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.018017:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.018022:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.018027:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.018032:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.018037:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.018042:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.018047:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.018053:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.018058:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271877.019038:0:6496:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8f6e901b8e00:6496] 0 exiting: rc = 1 00000100:00100000:0.0:1788271877.019293:0:6498:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8f6e901b9400:6498] 2 exiting: rc = 0 00000100:00100000:1.0:1788271877.019508:0:6497:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8f6e901b8c00:6497] 1 exiting: rc = 0 00000100:00100000:0.0:1788271877.020011:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020027:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020045:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020051:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020057:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020063:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020068:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020074:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020079:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020085:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020091:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020097:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020102:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020107:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020123:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020129:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020134:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020140:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020146:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020151:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020156:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020161:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020166:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020173:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020178:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020183:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020202:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020209:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020214:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020219:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020224:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020229:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020233:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020239:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020244:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020250:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020255:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020260:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020265:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020270:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020275:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020280:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020286:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020292:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020310:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020315:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020321:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020325:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020330:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020344:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020363:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020370:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020376:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020382:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020388:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020393:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020399:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020404:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020410:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020416:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020421:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020426:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020433:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271877.020446:0:15423:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788271877.025156:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788271877.025175:0:15423:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788271877.025179:0:15423:0:(genops.c:885:class_export_put()) final put ffff8f6e8591a800/MDS_uuid 00000020:00000080:1.0:1788271877.025183:0:15423:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6e8591a800/MDS_uuid for MDS 00000020:01000000:1.0:1788271877.025189:0:15423:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788271877.025321:0:15423:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1788271877.597749:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271878.621737:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271879.645831:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788271880.542838:0:15624:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1788271880.567795:0:15624:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788271880.567862:0:15624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5200/0x99288105fd38e75d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e764 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271880.567891:0:15624:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5200/0x99288105fd38e75d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e764 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271880.567898:0:15624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5200/0x99288105fd38e75d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x99288105fd38e764 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271880.567904:0:15624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5200/0x99288105fd38e75d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x99288105fd38e764 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271880.567924:0:15624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788271880.567930:0:15624:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788271880.567954:0:15624:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788271880.567959:0:15624:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788271880.567965:0:15624:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788271880.567971:0:15624:0:(import.c:65:import_set_state_nolock()) ffff8f6d81dd2000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788271880.567976:0:15624:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788271880.567978:0:15624:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788271880.567981:0:15624:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788271880.569071:0:15624:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788271880.569076:0:15624:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788271880.569082:0:15624:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788271880.569109:0:15624:0:(import.c:65:import_set_state_nolock()) ffff8f6d81d6b800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788271880.569207:0:8413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271880.569215:0:8413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5200/0x99288105fd38e75d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x99288105fd38e764 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271880.569225:0:8413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4ed5200 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:1.0:1788271880.569228:0:8413:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5200/0x99288105fd38e75d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x99288105fd38e764 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271880.569248:0:8413:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5200/0x99288105fd38e75d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x99288105fd38e764 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788271880.569255:0:8413:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5200/0x99288105fd38e75d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x99288105fd38e764 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271880.569271:0:8413:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788271880.569274:0:8413:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788271880.569277:0:8413:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788271880.569290:0:8413:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f6e85918800 00010000:00010000:1.0:1788271880.569294:0:8413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5200/0x99288105fd38e75d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x99288105fd38e764 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271880.569301:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5200/0x99288105fd38e75d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x99288105fd38e764 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271880.569315:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271880.569317:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271880.569330:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271880.569463:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3605:1875138590178816:0@lo:39:umount.0 00000400:00000100:3.0:1788271880.569519:0:3605:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875138590178816 offset 0 length 224: 4 00010000:00010000:0.0:1788271880.669744:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788271881.246456:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) f4eab87b-0440-4f90-8c88-4ffaef16406f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788271881.246463:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) f4eab87b-0440-4f90-8c88-4ffaef16406f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788271881.246465:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788271881.246469:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788271881.246472:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f6d82346000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788271881.246480:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 437 00000100:00080000:1.0:1788271881.246485:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788271881.246491:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f6d82346000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788271881.246532:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d83390380 x1875138590178944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788271881.246606:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788271881.246634:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83393800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3608:1875138590179072:0@lo:400:kworker.0 00000400:00000100:1.0:1788271881.246679:0:3608:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875138590179072 offset 0 length 224: 4 00000100:00100000:0.0:1788271881.246930:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83390380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3605:1875138590178944:0@lo:38:kworker.0 00000400:00000100:0.0:1788271881.246990:0:3605:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875138590178944 offset 0 length 520: 4 00010000:00010000:0.0:1788271881.695676:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271882.719783:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788271882.789159:0:9475:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788271882.789169:0:9475:0:(genops.c:885:class_export_put()) final put ffff8f6d81dd7000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788271882.789259:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6d81dd7000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788271882.789308:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f6d81dd1000 for lustre-OST0001 00000001:00100000:3.0:1788271882.796384:0:8391:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788271882.796394:0:8391:0:(genops.c:885:class_export_put()) final put ffff8f6eb63e4000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788271882.796526:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb63e4000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788271882.796591:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f6eb63e5000 for lustre-OST0000 00010000:00010000:1.0:1788271883.742147:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271884.765793:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271885.789785:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788271886.365825:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) f4eab87b-0440-4f90-8c88-4ffaef16406f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788271886.365836:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) f4eab87b-0440-4f90-8c88-4ffaef16406f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788271886.365839:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788271886.365862:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788271886.366043:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3606:1875138590179200:0@lo:400:kworker.0 00000400:00000100:3.0:1788271886.366100:0:3606:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875138590179200 offset 0 length 224: 4 00000100:00100000:3.0:1788271886.368862:0:3605:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788271876/real 1788271876] req@ffff8f6d8406c380 x1875138590178688/t0(0) o250->MGC192.168.201.103@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788271886 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271886.368892:0:3605:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f6d8406c380 x1875138590178688/t0(0) o250->MGC192.168.201.103@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788271886 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788271886.368918:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6e85918800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788271886.368992:0:3605:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788271886.368996:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f4eab87b-0440-4f90-8c88-4ffaef16406f:3605:1875138590178688:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:1.0:1788271886.369216:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) f4eab87b-0440-4f90-8c88-4ffaef16406f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788271886.369221:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788271886.369224:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f6e85918800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788271886.369229:0:38:0:(import.c:510:import_select_connection()) MGC192.168.201.103@tcp: connect to NID 0@lo last attempt 437 00000100:00080000:1.0:1788271886.369235:0:38:0:(import.c:589:import_select_connection()) MGC192.168.201.103@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788271886.369240:0:38:0:(import.c:624:import_select_connection()) MGC192.168.201.103@tcp: import ffff8f6e85918800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788271886.369270:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d83393100 x1875138590179328/t0(0) o250->MGC192.168.201.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788271886.369313:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788271886.369316:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788271886.370766:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83393100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f4eab87b-0440-4f90-8c88-4ffaef16406f:3605:1875138590179328:0@lo:250:kworker.0 00000400:00000100:3.0:1788271886.370832:0:3605:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875138590179328 offset 0 length 520: 4 00010000:00010000:1.0:1788271886.815508:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271887.839773:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271888.865441:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271889.885810:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271890.462034:0:3605:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788271880/real 1788271880] req@ffff8f6d8406e300 x1875138590178816/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788271890 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271890.462080:0:3605:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f6d8406e300 x1875138590178816/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788271890 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788271890.462101:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6d81d6b800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788271890.462116:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3605:1875138590178816:0@lo:39:umount.0 00000100:00080000:2.0:1788271890.463721:0:15624:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788271890.463728:0:15624:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788271890.463734:0:15624:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788271890.465682:0:15624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6ec21de200/0x99288105fd38e76b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e772 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271890.465702:0:15624:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6ec21de200/0x99288105fd38e76b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e772 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271890.465711:0:15624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6ec21de200/0x99288105fd38e76b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x99288105fd38e772 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271890.465719:0:15624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff8f6ec21de200/0x99288105fd38e76b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x99288105fd38e772 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271890.465814:0:15624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788271890.465823:0:15624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e9e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e9e8 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271890.465831:0:15624:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e9e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e9e8 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271890.465837:0:15624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e9e1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x99288105fd38e9e8 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271890.465842:0:15624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e9e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x99288105fd38e9e8 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271890.467598:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788271890.467611:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6ec21de200/0x99288105fd38e76b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x99288105fd38e772 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271890.467634:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6ec21de200 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:1.0:1788271890.467638:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6ec21de200/0x99288105fd38e76b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x99288105fd38e772 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271890.467647:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6ec21de200/0x99288105fd38e76b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x99288105fd38e772 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788271890.467655:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6ec21de200/0x99288105fd38e76b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x99288105fd38e772 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271890.467661:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788271890.467663:0:6471:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:1.0:1788271890.467676:0:6471:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f6e85918800 00010000:00010000:1.0:1788271890.467679:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6ec21de200/0x99288105fd38e76b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x99288105fd38e772 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271890.467685:0:6471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6ec21de200/0x99288105fd38e76b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x99288105fd38e772 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271890.467703:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271890.467722:0:6471:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e9e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x99288105fd38e9e8 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271890.467727:0:6471:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4078e00 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:1.0:1788271890.467730:0:6471:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e9e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x99288105fd38e9e8 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271890.467737:0:6471:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e9e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x99288105fd38e9e8 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788271890.467744:0:6471:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e9e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x99288105fd38e9e8 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271890.467749:0:6471:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788271890.467751:0:6471:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788271890.467755:0:6471:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f6e85918800 00010000:00010000:1.0:1788271890.467758:0:6471:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e9e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x99288105fd38e9e8 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271890.467764:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271890.467766:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271890.467768:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271890.467864:0:15624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788271890.467877:0:15624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078e00/0x99288105fd38e9e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x99288105fd38e9e8 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271890.467887:0:15624:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1788271890.467892:0:15624:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:2.0:1788271890.467894:0:15624:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788271890.467930:0:15624:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788271890.467934:0:15624:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788271890.467940:0:15624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788271890.467946:0:15624:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788271890.467950:0:15624:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8f6eb3cd0000) has no exports 00000020:00080000:2.0:1788271890.467973:0:15624:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8f6eb3cd0000) has no exports 00000020:01000000:2.0:1788271890.472329:0:15624:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f6d82fe7c00 - data ffff8f6ea674b5e8/ffff8f6eb4fdd800 00000020:01000000:2.0:1788271890.472753:0:15624:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f6d81e69360 - data ffff8f6ea669e288/ffff8f6e87094000 00010000:00010000:1.0:1788271890.481994:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788271890.495808:0:15624:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788271890.511513:0:15624:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e4af 00000020:00000080:2.0:1788271890.511526:0:15624:0:(genops.c:885:class_export_put()) final put ffff8f6eb3d3b800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788271890.511544:0:15624:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f6eb4b8b800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788271890.511548:0:15624:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f6eb4b8b800 2 00000020:01000004:2.0:1788271890.511551:0:15624:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f6eb4b8b800 from lustre-OST0000 00000020:00000080:2.0:1788271890.511579:0:15624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788271890.511587:0:15624:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788271890.511590:0:15624:0:(genops.c:885:class_export_put()) final put ffff8f6eb4eda800/lustre-OST0000_UUID 00000020:00000080:2.0:1788271890.511592:0:15624:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb4eda800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788271890.511598:0:15624:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788271890.511659:0:15624:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788271890.511662:0:15624:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788271890.511665:0:15624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788271890.511669:0:15624:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788271890.511675:0:15624:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8f6d81dd3800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788271890.511680:0:15624:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8f6ebc994d28) has exports, disconnecting them 00000020:00080000:2.0:1788271890.511690:0:15624:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8f6d81dd3800), last request at 1788271659 00000020:00000080:2.0:1788271890.511694:0:15624:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e4d9 00000020:00080000:2.0:1788271890.511702:0:15624:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f6d81dd3800): rc 0 00000020:00000080:2.0:1788271890.511706:0:15624:0:(genops.c:885:class_export_put()) final put ffff8f6d81dd3800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788271890.512205:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb3d3b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788271890.512216:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6d81dd3800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788271890.514718:0:15624:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788271890.514725:0:15624:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788271890.514733:0:15624:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788271890.514740:0:15624:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788271890.514900:0:15624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788271890.514907:0:15624:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1788271890.514912:0:15624:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788271890.514917:0:15624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788271890.514929:0:15624:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788271890.514935:0:15624:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8f6d81d68800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788271890.514941:0:15624:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff8f6eb3cd4d28) has exports, disconnecting them 00000020:00080000:1.0:1788271890.514945:0:15624:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8f6d81d68800), last request at 1788271659 00000020:00000080:1.0:1788271890.514949:0:15624:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e4ee 00000020:00080000:1.0:1788271890.514962:0:15624:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f6d81d68800): rc 0 00000020:00000080:1.0:1788271890.514967:0:15624:0:(genops.c:885:class_export_put()) final put ffff8f6d81d68800/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788271890.515588:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f6d81dd2000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788271890.515597:0:38:0:(genops.c:885:class_export_put()) final put ffff8f6ebcbd3000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788271890.515600:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6ebcbd3000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788271890.515606:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1788271890.515693:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6d81d68800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1788271890.526720:0:15624:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788271890.526730:0:15624:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788271890.526734:0:15624:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788271890.526743:0:15624:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788271890.526773:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f6d81d6b800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788271890.526976:0:15624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788271890.526985:0:15624:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1788271890.526991:0:15624:0:(genops.c:885:class_export_put()) final put ffff8f6d81d6c800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1788271890.526997:0:15624:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6d81d6c800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1788271890.527004:0:15624:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1788271890.527090:0:15624:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f6eb4b8b800 1 00000020:00000080:2.0:1788271890.527100:0:15624:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e477 00000020:00000080:2.0:1788271890.527106:0:15624:0:(genops.c:885:class_export_put()) final put ffff8f6eb4a1e000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788271890.527114:0:15624:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788271890.527122:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb4a1e000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788271890.527131:0:15624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788271890.527135:0:15624:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788271890.527139:0:15624:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8f6e85be99b8) has no exports 00000020:00000080:0.0:1788271890.608444:0:15624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788271890.608455:0:15624:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788271890.608460:0:15624:0:(genops.c:885:class_export_put()) final put ffff8f6eb4b88800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788271890.608470:0:15624:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb4b88800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788271890.608479:0:15624:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788271890.608587:0:15624:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8f6eb4b8f000 00000020:02000400:0.0:1788271890.608649:0:15624:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788271890.909822:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788271891.496196:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) f4eab87b-0440-4f90-8c88-4ffaef16406f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788271891.496220:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) f4eab87b-0440-4f90-8c88-4ffaef16406f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788271891.496223:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788271891.496226:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788271891.496345:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3607:1875138590179456:0@lo:400:kworker.0 00000400:00000100:0.0:1788271891.496404:0:3607:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875138590179456 offset 0 length 224: 4 00010000:00010000:0.0:1788271891.933768:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271892.962793:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271893.982362:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788271894.152551:0:15826:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1788271894.172796:0:15826:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788271894.172883:0:15826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078000/0x99288105fd38e741 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e748 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271894.172898:0:15826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078000/0x99288105fd38e741 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e748 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271894.172905:0:15826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078000/0x99288105fd38e741 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x99288105fd38e748 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271894.172912:0:15826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078000/0x99288105fd38e741 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x99288105fd38e748 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271894.172937:0:15826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788271894.172943:0:15826:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788271894.172974:0:15826:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788271894.172986:0:15826:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f6d83390380 x1875138590178944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788271906 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271894.173018:0:15826:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788271894.173026:0:15826:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788271894.173032:0:15826:0:(import.c:65:import_set_state_nolock()) ffff8f6d82346000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788271894.173049:0:15826:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788271894.173054:0:15826:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f6d83390380 x1875138590178944/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788271906 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271894.173062:0:15826:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788271894.173065:0:15826:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:1.0:1788271894.173156:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83390380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3605:1875138590178944:0@lo:38:kworker.0 00010000:00010000:2.0:1788271894.173261:0:8412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271894.173269:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078000/0x99288105fd38e741 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x99288105fd38e748 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271894.173276:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4078000 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:2.0:1788271894.173281:0:8412:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078000/0x99288105fd38e741 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x99288105fd38e748 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271894.173290:0:8412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078000/0x99288105fd38e741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x99288105fd38e748 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788271894.173297:0:8412:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078000/0x99288105fd38e741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x99288105fd38e748 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271894.173302:0:8412:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788271894.173305:0:8412:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788271894.173308:0:8412:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788271894.173321:0:8412:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f6e85918800 00010000:00010000:2.0:1788271894.173324:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078000/0x99288105fd38e741 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x99288105fd38e748 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271894.173331:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6eb4078000/0x99288105fd38e741 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x99288105fd38e748 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271894.173341:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271894.173343:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271894.173351:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788271894.174253:0:15826:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788271894.174264:0:15826:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f6d83393800 x1875138590179072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271897 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271894.174285:0:15826:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f6d8406f800 x1875138590179200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271902 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271894.174402:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83393800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3608:1875138590179072:0@lo:400:kworker.0 00000100:00100000:0.0:1788271894.174427:0:15826:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f6d8406dc00 x1875138590179456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271907 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271894.174450:0:15826:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788271894.174455:0:15826:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788271894.179739:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3606:1875138590179200:0@lo:400:kworker.0 00000100:00100000:3.0:1788271894.179862:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3607:1875138590179456:0@lo:400:kworker.0 00000100:00080000:0.0:1788271894.180079:0:15826:0:(import.c:65:import_set_state_nolock()) ffff8f6eb4edc000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788271894.180152:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d832bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3605:1875138590179584:0@lo:39:umount.0 00000400:00000100:2.0:1788271894.180204:0:3605:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875138590179584 offset 0 length 224: 4 00010000:00010000:0.0:1788271895.005786:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271896.029853:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788271896.606562:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) f4eab87b-0440-4f90-8c88-4ffaef16406f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788271896.606572:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) f4eab87b-0440-4f90-8c88-4ffaef16406f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788271897.053845:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271898.077900:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271899.102055:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271900.128406:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271901.150278:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271901.345804:0:3605:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788271886/real 1788271886] req@ffff8f6d83393100 x1875138590179328/t0(0) o250->MGC192.168.201.103@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788271901 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271901.345838:0:3605:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f6d83393100 x1875138590179328/t0(0) o250->MGC192.168.201.103@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788271901 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788271901.345858:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6e85918800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788271901.345897:0:3605:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788271901.345901:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83393100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f4eab87b-0440-4f90-8c88-4ffaef16406f:3605:1875138590179328:0@lo:250:kworker.0 00000100:00080000:3.0:1788271901.346197:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) f4eab87b-0440-4f90-8c88-4ffaef16406f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788271901.346202:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788271901.346205:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f6e85918800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788271901.346210:0:38:0:(import.c:510:import_select_connection()) MGC192.168.201.103@tcp: connect to NID 0@lo last attempt 447 00000100:00080000:3.0:1788271901.346215:0:38:0:(import.c:589:import_select_connection()) MGC192.168.201.103@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788271901.346221:0:38:0:(import.c:624:import_select_connection()) MGC192.168.201.103@tcp: import ffff8f6e85918800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788271901.346251:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d83253800 x1875138590179712/t0(0) o250->MGC192.168.201.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788271901.346307:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f4eab87b-0440-4f90-8c88-4ffaef16406f:3605:1875138590179712:0@lo:250:kworker.0 00000400:00000100:2.0:1788271901.346348:0:3605:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875138590179712 offset 0 length 520: 4 00010000:00010000:2.0:1788271902.175120:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271903.197750:0:6472:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271904.222056:0:6471:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271904.415490:0:3605:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788271894/real 1788271894] req@ffff8f6d832bed80 x1875138590179584/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788271904 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271904.415524:0:3605:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f6d832bed80 x1875138590179584/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788271904 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788271904.415544:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6eb4edc000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788271904.415570:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d832bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3605:1875138590179584:0@lo:39:umount.0 00000100:00080000:0.0:1788271904.415674:0:15826:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788271904.415679:0:15826:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788271904.415684:0:15826:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788271904.416612:0:15826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfe00/0x99288105fd38e74f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e756 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271904.416671:0:15826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfe00/0x99288105fd38e74f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e756 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271904.416692:0:15826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfe00/0x99288105fd38e74f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x99288105fd38e756 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271904.416700:0:15826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfe00/0x99288105fd38e74f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x99288105fd38e756 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271904.416795:0:15826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788271904.416804:0:15826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e813a1400/0x99288105fd38e9d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38e9da expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271904.416811:0:15826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e813a1400/0x99288105fd38e9d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38e9da expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271904.416826:0:15826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e813a1400/0x99288105fd38e9d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x99288105fd38e9da expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271904.416833:0:15826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.103@tcp lock: ffff8f6e813a1400/0x99288105fd38e9d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x99288105fd38e9da expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271904.421195:0:8413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788271904.421212:0:8413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfe00/0x99288105fd38e74f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x99288105fd38e756 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271904.421226:0:8413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6ec21dfe00 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:1.0:1788271904.421231:0:8413:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfe00/0x99288105fd38e74f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x99288105fd38e756 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271904.421242:0:8413:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfe00/0x99288105fd38e74f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x99288105fd38e756 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788271904.421249:0:8413:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfe00/0x99288105fd38e74f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x99288105fd38e756 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271904.421277:0:8413:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788271904.421280:0:8413:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1788271904.421295:0:8413:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f6e85918800 00010000:00010000:1.0:1788271904.421298:0:8413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfe00/0x99288105fd38e74f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x99288105fd38e756 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271904.421305:0:8413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6ec21dfe00/0x99288105fd38e74f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x99288105fd38e756 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271904.421326:0:8413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271904.421335:0:8413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6e813a1400/0x99288105fd38e9d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x99288105fd38e9da expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271904.421341:0:8413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e813a1400 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:1.0:1788271904.421343:0:8413:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6e813a1400/0x99288105fd38e9d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x99288105fd38e9da expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271904.421353:0:8413:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6e813a1400/0x99288105fd38e9d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x99288105fd38e9da expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788271904.421359:0:8413:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6e813a1400/0x99288105fd38e9d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x99288105fd38e9da expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271904.421365:0:8413:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788271904.421367:0:8413:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788271904.421371:0:8413:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f6e85918800 00010000:00010000:1.0:1788271904.421378:0:8413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6e813a1400/0x99288105fd38e9d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x99288105fd38e9da expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271904.421394:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271904.421396:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271904.421398:0:8413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271904.421765:0:15826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788271904.421774:0:15826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6e813a1400/0x99288105fd38e9d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x99288105fd38e9da expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271904.421791:0:15826:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1788271904.421812:0:15826:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1788271904.421825:0:15826:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788271904.421862:0:15826:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788271904.421867:0:15826:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788271904.421878:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788271904.421890:0:15826:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788271904.421894:0:15826:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8f6d82354d28) has no exports 00000020:00080000:0.0:1788271904.421920:0:15826:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8f6d82354d28) has no exports 00010000:00010000:2.0:1788271904.423753:0:8412:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788271904.427696:0:15826:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f6d82fe73c0 - data ffff8f6ea674e1b0/ffff8f6d82ef9000 00000020:01000000:0.0:1788271904.427858:0:15826:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f6d82fe75a0 - data ffff8f6ea6764870/ffff8f6d83008400 00100000:10000000:0.0:1788271904.435567:0:15826:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788271904.451368:0:15826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e5d5 00000020:00000080:3.0:1788271904.451381:0:15826:0:(genops.c:885:class_export_put()) final put ffff8f6d82343800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788271904.451397:0:15826:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f6d820cc800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788271904.451401:0:15826:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f6d820cc800 2 00000020:01000004:3.0:1788271904.451404:0:15826:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f6d820cc800 from lustre-OST0001 00000020:00000080:0.0:1788271904.451406:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6d82343800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788271904.451431:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788271904.451440:0:15826:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788271904.451442:0:15826:0:(genops.c:885:class_export_put()) final put ffff8f6d82341800/lustre-OST0001_UUID 00000020:00000080:3.0:1788271904.451445:0:15826:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6d82341800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788271904.451458:0:15826:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788271904.451597:0:15826:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import f4eab87b-0440-4f90-8c88-4ffaef16406f->MGS 00010000:00010000:3.0:1788271904.451613:0:15826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6e80031000/0x99288105fd38e32e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x99288105fd38e335 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788271904.451686:0:15826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6e80031000/0x99288105fd38e32e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x99288105fd38e335 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271904.451694:0:15826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788271904.451700:0:15826:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788271904.451704:0:15826:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788271904.451725:0:15826:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f6e85918800 00010000:00010000:3.0:1788271904.451729:0:15826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6e80031000/0x99288105fd38e32e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x99288105fd38e335 expref: -99 pid: 7412 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271904.451745:0:15826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e7b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x99288105fd38e7b8 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788271904.451752:0:15826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e7b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x99288105fd38e7b8 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271904.451758:0:15826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788271904.451760:0:15826:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788271904.451762:0:15826:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788271904.451770:0:15826:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f6e85918800 00010000:00010000:3.0:1788271904.451773:0:15826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6eb4079600/0x99288105fd38e7b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x99288105fd38e7b8 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788271904.451788:0:15826:0:(import.c:65:import_set_state_nolock()) ffff8f6e85918800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788271904.451792:0:15826:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788271904.451795:0:15826:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788271904.451801:0:15826:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788271904.451806:0:15826:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788271904.451825:0:15826:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f6d83253800 x1875138590179712/t0(0) o250->MGC192.168.201.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788271921 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788271904.451882:0:15826:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788271904.451886:0:15826:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000100:00100000:2.0:1788271904.452126:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f4eab87b-0440-4f90-8c88-4ffaef16406f:3605:1875138590179712:0@lo:250:kworker.0 10000000:01000000:3.0:1788271904.452362:0:15826:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788271904.452370:0:15826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e22b 00000020:00000080:3.0:1788271904.452375:0:15826:0:(genops.c:885:class_export_put()) final put ffff8f6e8591b800/f4eab87b-0440-4f90-8c88-4ffaef16406f 00000020:01000000:3.0:1788271904.453149:0:15826:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.103@tcp (flags='') 00000020:00000080:3.0:1788271904.453158:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788271904.453165:0:15826:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.103@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788271904.453169:0:15826:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8f6e85beb370) has no exports 10000000:01000000:2.0:1788271904.453740:0:6480:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1788271904.453858:0:15826:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.103@tcp: client import never connected 00000100:00080000:3.0:1788271904.453863:0:15826:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788271904.453866:0:15826:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788271904.453869:0:15826:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788271904.453873:0:15826:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788271904.457502:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6e8591b800/f4eab87b-0440-4f90-8c88-4ffaef16406f for MGC192.168.201.103@tcp 00000020:00000080:3.0:1788271904.458875:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788271904.458888:0:15826:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.103@tcp (uuid f4eab87b-0440-4f90-8c88-4ffaef16406f) 00000020:01000000:3.0:1788271904.458898:0:15826:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788271904.458907:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788271904.458912:0:15826:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788271904.458920:0:15826:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8f6d82342000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788271904.458927:0:15826:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff8f6d823519b8) has exports, disconnecting them 00000020:00080000:3.0:1788271904.458932:0:15826:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8f6d82342000), last request at 1788271680 00000020:00000080:3.0:1788271904.458938:0:15826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e5ff 00000020:00080000:3.0:1788271904.458954:0:15826:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f6d82342000): rc 0 00000020:00000080:3.0:1788271904.458958:0:15826:0:(genops.c:885:class_export_put()) final put ffff8f6d82342000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788271904.461466:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f6e85918800 for MGC192.168.201.103@tcp 00000020:00000080:0.0:1788271904.461482:0:38:0:(genops.c:885:class_export_put()) final put ffff8f6e8591a000/f4eab87b-0440-4f90-8c88-4ffaef16406f 00000020:00000080:0.0:1788271904.461486:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6e8591a000/f4eab87b-0440-4f90-8c88-4ffaef16406f for MGC192.168.201.103@tcp 00000020:01000000:0.0:1788271904.461494:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.103@tcp (f4eab87b-0440-4f90-8c88-4ffaef16406f) 00000020:00000080:2.0:1788271904.462143:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6d82342000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788271904.465631:0:15826:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788271904.465640:0:15826:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788271904.465644:0:15826:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788271904.465652:0:15826:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788271904.465885:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788271904.465893:0:15826:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1788271904.465900:0:15826:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788271904.465906:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788271904.465911:0:15826:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788271904.465918:0:15826:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8f6d81d6c000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788271904.465925:0:15826:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff8f6d82f0cd28) has exports, disconnecting them 00000020:00080000:2.0:1788271904.465929:0:15826:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8f6d81d6c000), last request at 1788271680 00000020:00000080:2.0:1788271904.465933:0:15826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e614 00000020:00080000:2.0:1788271904.465950:0:15826:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f6d81d6c000): rc 0 00000020:00000080:2.0:1788271904.465955:0:15826:0:(genops.c:885:class_export_put()) final put ffff8f6d81d6c000/lustre-MDT0001-lwp-OST0001 00000020:00000080:0.0:1788271904.466638:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f6d82346000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788271904.466647:0:38:0:(genops.c:885:class_export_put()) final put ffff8f6d82dac800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1788271904.466650:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6d82dac800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1788271904.466656:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1788271904.466714:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6d81d6c000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1788271904.473253:0:15826:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788271904.473262:0:15826:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788271904.473266:0:15826:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788271904.473273:0:15826:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788271904.473302:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f6eb4edc000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1788271904.473350:0:6472:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788271904.473484:0:6471:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1788271904.473542:0:8413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:0.0:1788271904.497720:0:8412:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:0.0:1788271904.497947:0:10303:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8f6d83272c00:10303] 2 exiting: rc = 0 00000100:00100000:2.0:1788271904.498793:0:6466:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8f6eb3583400:6466] 0 exiting: rc = 1 00000100:00100000:2.0:1788271904.498905:0:6467:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8f6eb3582800:6467] 1 exiting: rc = 0 00000100:00100000:0.0:1788271904.501099:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.503439:0:9485:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8f6eb4d90a00:9485] 3 exiting: rc = 0 00000100:00100000:1.0:1788271904.505125:0:6468:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8f6eb3582a00:6468] 0 exiting: rc = 1 00000100:00100000:1.0:1788271904.505367:0:9486:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff8f6d8169ae00:9486] 4 exiting: rc = 0 00000100:00100000:1.0:1788271904.505441:0:6469:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8f6eb3582400:6469] 1 exiting: rc = 0 00000100:00100000:1.0:1788271904.505492:0:6470:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8f6e87178000:6470] 2 exiting: rc = 0 00000100:00100000:0.0:1788271904.505578:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505592:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505601:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505608:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505614:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505633:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505642:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505652:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505663:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505669:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505674:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505680:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505686:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505691:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505697:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505703:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505709:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505715:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505721:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505728:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505733:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505738:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505742:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505747:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505752:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505757:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505761:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505766:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505770:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505775:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505780:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505784:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505788:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505793:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505809:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505825:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505831:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505836:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505842:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505847:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505851:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505856:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505861:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505866:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505871:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505876:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505880:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505884:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505889:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505893:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505898:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505903:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505908:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505912:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505917:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505922:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505927:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505930:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505934:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505939:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505943:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505947:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505951:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.505955:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788271904.507221:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788271904.507231:0:15826:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1788271904.507237:0:15826:0:(genops.c:885:class_export_put()) final put ffff8f6d81d69000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1788271904.507241:0:15826:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6d81d69000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1788271904.507248:0:15826:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1788271904.507311:0:15826:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f6d820cc800 1 00000020:00000080:0.0:1788271904.507318:0:15826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x99288105fd38e5a4 00000020:00000080:0.0:1788271904.507325:0:15826:0:(genops.c:885:class_export_put()) final put ffff8f6ebfb77800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1788271904.507337:0:15826:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1788271904.507348:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6ebfb77800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788271904.507360:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788271904.507364:0:15826:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788271904.507368:0:15826:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff8f6ebc993370) has no exports 00000020:00000080:0.0:1788271904.602158:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788271904.602173:0:15826:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788271904.602180:0:15826:0:(genops.c:885:class_export_put()) final put ffff8f6d820cb800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788271904.602184:0:15826:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6d820cb800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788271904.602197:0:15826:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788271904.602542:0:15826:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8f6d820ca000 00000020:01000000:0.0:1788271904.602562:0:15826:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788271904.602566:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788271904.602570:0:15826:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788271904.602574:0:15826:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8f6ebc990000) has no exports 00000020:00000080:0.0:1788271904.602597:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788271904.602602:0:15826:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788271904.602605:0:15826:0:(genops.c:885:class_export_put()) final put ffff8f6eb4a1a800/OSS_uuid 00000020:00000080:0.0:1788271904.602607:0:15826:0:(genops.c:844:class_export_destroy()) destroying export ffff8f6eb4a1a800/OSS_uuid for OSS 00000020:01000000:0.0:1788271904.602611:0:15826:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1788271904.602680:0:6479:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788271904.602737:0:8398:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8f6eb0c64800:8398] 2 exiting: rc = 0 00000100:00100000:0.0:1788271904.605961:0:8452:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8f6d82068c00:8452] 3 exiting: rc = 0 00000100:00100000:2.0:1788271904.606746:0:8397:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8f6eb0c65800:8397] 1 exiting: rc = 0 00000100:00100000:2.0:1788271904.606835:0:12967:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff8f6d830d4c00:12967] 4 exiting: rc = 0 00000100:00100000:0.0:1788271904.607964:0:8396:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8f6eb3dd6a00:8396] 0 exiting: rc = 1 00000100:00100000:2.0:1788271904.608110:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608120:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608127:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608133:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608139:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608155:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608163:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608168:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608188:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608195:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608200:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608206:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608212:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608217:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608223:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608228:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608248:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608255:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608267:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608274:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608279:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608284:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608289:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608295:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608300:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608306:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608311:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608316:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608322:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608326:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608331:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608336:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608341:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608346:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608350:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608355:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608360:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608365:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608371:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608376:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608381:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608386:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608391:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608403:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608409:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608414:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608419:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608424:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608430:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608435:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608439:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608445:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608450:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608455:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608460:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608465:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608471:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608476:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608481:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608487:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608492:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608498:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608503:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.608522:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.615491:0:10739:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8f6d830d4800:10739] 2 exiting: rc = 0 00000100:00100000:2.0:1788271904.620610:0:8399:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8f6e82a80400:8399] 0 exiting: rc = 1 00000100:00100000:3.0:1788271904.630016:0:8400:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8f6eb3cba600:8400] 1 exiting: rc = 0 00000100:00100000:0.0:1788271904.632559:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632574:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632581:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632586:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632592:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632613:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632633:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632651:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632657:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632663:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632668:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632673:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632679:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632685:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632691:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632697:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632703:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632708:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632713:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632719:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632724:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632740:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632745:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632750:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632755:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632761:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632766:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632772:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632778:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632783:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632789:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632794:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632799:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632804:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632809:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632824:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632829:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632833:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632837:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632842:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632855:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632860:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632866:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632872:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632877:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632882:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632887:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632899:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632905:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632910:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632916:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632921:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632926:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632931:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632936:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632941:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632947:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632953:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632958:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632963:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632967:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632972:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632983:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.632990:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.634824:0:8402:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8f6eb4d56400:8402] 1 exiting: rc = 0 00000100:00100000:3.0:1788271904.635040:0:8401:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8f6eb4d34600:8401] 0 exiting: rc = 1 00000100:00100000:3.0:1788271904.635403:0:8403:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8f6e87179400:8403] 2 exiting: rc = 0 00000100:00100000:0.0:1788271904.639232:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639243:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639249:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639254:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639260:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639265:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639284:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639291:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639297:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639304:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639321:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639327:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639332:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639339:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639344:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639349:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639355:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639361:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639366:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639373:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639379:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639384:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639391:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639408:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639414:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639419:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639424:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639430:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639435:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639442:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639448:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639454:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639460:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639466:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639472:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639477:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639483:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639489:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639495:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639501:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639508:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639514:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639520:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639527:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639532:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639546:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639552:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639572:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639579:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639584:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639589:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639595:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639601:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639606:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.639612:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.641467:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.641488:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.641511:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.641520:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.641526:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.641532:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.641539:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.641545:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788271904.641552:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.659089:0:8404:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8f6eb4d57800:8404] 0 exiting: rc = 1 00000100:00100000:0.0:1788271904.659510:0:8405:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8f6eb4d57600:8405] 1 exiting: rc = 0 00000100:00100000:3.0:1788271904.660832:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.660842:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.660847:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.660854:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.660860:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.660865:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.660871:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.660876:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.660882:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.660887:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.660893:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.660898:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.660904:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.660909:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.660914:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.660919:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.660925:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.660930:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.660935:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.660941:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.660946:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.660951:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.660967:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.660973:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.660978:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.660983:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.660989:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.660994:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.661000:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.661005:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.661010:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.661016:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.661021:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.661027:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.661050:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.661055:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.661071:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.661076:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.661082:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.661087:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.661093:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.661099:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.661103:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.661108:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.661114:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.661127:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.661135:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.661140:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.661144:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.661150:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.661154:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.661160:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.661165:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.661170:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.661175:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.661180:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.661198:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.661206:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.661214:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.661222:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.661229:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.661235:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.661241:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.661246:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788271904.662081:0:8407:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8f6ebc92c200:8407] 1 exiting: rc = 0 00000100:00100000:0.0:1788271904.662432:0:8406:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8f6eb0c67600:8406] 0 exiting: rc = 1 00000100:00100000:3.0:1788271904.662526:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.662562:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.662568:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.662574:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.662581:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.662595:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.662601:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.662608:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.662613:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.662799:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.662808:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.662824:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.662831:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.662852:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.662859:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.662865:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.662872:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.662878:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.662884:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.662890:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.662895:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.662900:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.663477:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.663486:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.663495:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.663524:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.663535:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.663545:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.663552:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.663558:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.663564:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.663569:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.663576:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.663582:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.663588:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.663595:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.663600:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.663807:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.663829:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.663836:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.663850:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.663857:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.663863:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.663869:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.663875:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.663880:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.663886:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.663892:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.663898:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.663921:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.663929:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.663944:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.663952:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.664518:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.664524:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.664530:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.664537:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.664542:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.664548:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.664554:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.664560:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.664566:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.664572:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788271904.664587:0:15826:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788271904.681923:0:15826:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788271922.949259:0:16591:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg103-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788271932.900024:0:17190:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788271932.900030:0:17190:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788271932.900032:0:17190:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788271932.900140:0:17190:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f6e851db000 00000020:01000004:1.0:1788271932.900157:0:17190:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788271932.900165:0:17190:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788271932.900178:0:17190:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8f6eb4e90000) 00000020:00000080:1.0:1788271932.900190:0:17190:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788271932.960171:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788271932.962917:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788271932.964017:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788271932.967212:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788271932.967454:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788271932.967766:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788271932.967962:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788271932.968153:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788271932.968901:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788271932.970204:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788271932.970610:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788271932.970926:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788271932.971146:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788271932.971452:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788271932.971698:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788271932.971906:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788271932.972124:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788271932.972416:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788271932.972838:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788271932.974214:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788271932.974690:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788271932.974891:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788271932.975086:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788271932.975272:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788271932.975471:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788271932.976034:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788271932.976254:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788271932.976660:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788271932.976893:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788271932.977077:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788271932.977411:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788271932.979695:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788271932.980488:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788271932.982970:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788271932.983432:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788271932.984088:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788271932.984803:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788271932.985043:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788271932.985375:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788271932.985747:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788271932.985926:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788271932.986342:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788271932.986851:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788271932.987064:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788271932.988401:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788271932.992065:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788271932.992648:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788271932.995169:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1788271932.995968:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1788271932.996213:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1788271932.996811:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1788271932.997007:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1788271932.997194:0:17190:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:2.0:1788271933.000056:0:17190:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788271933.000329:0:17190:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788271933.000346:0:17190:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788271933.000358:0:17190:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x99288105fd38f7e8 00000020:01000004:2.0:1788271933.000366:0:17190:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788271933.000371:0:17190:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788271933.000375:0:17190:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f6e851db000 from MGS 00000020:01000004:2.0:1788271933.000379:0:17190:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788271933.000388:0:17190:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8f6eb41719b8) 00000020:00000080:2.0:1788271933.000398:0:17190:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788271933.000455:0:17190:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f6e851db000 from MGS, refs=2 00080000:01000000:2.0:1788271933.000459:0:17190:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788271933.000464:0:17190:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x99288105fd38f7f6 00000100:00100000:2.0:1788271933.000559:0:17190:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788271933.000725:0:17190:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788271933.000731:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788271933.007448:0:17190:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788271933.007469:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788271933.009019:0:17190:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788271933.009192:0:17190:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788271933.009197:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788271933.010085:0:17190:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788271933.010092:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788271933.019408:0:17190:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788271933.019420:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788271933.020787:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271933.020792:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271933.020794:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271933.021130:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271933.021133:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271933.021135:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271933.022011:0:17190:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788271933.041818:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788271933.042901:0:17190:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1788271933.048488:0:17203:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788271933.048702:0:17190:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788271933.048754:0:17190:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788271933.049749:0:17190:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788271933.050050:0:17190:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788271933.050197:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788271933.050203:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788271933.054906:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788271933.054925:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788271933.055466:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788271933.055474:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788271933.058597:0:17190:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788271933.058638:0:17190:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.103@tcp' 00000020:01000004:2.0:1788271933.058640:0:17190:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788271933.058671:0:17190:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.103@tcp (typ=mgc) 00000020:00000080:2.0:1788271933.058684:0:17190:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.103@tcp (ffff8f6eb4174d28) 00000020:00000080:2.0:1788271933.058700:0:17190:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788271933.058780:0:17190:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f6d8332c800@MGC192.168.201.103@tcp: add connection 192.168.201.103@tcp at head 00010000:00010000:2.0:1788271933.058943:0:17190:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.103@tcp-0 is initialized 00000040:01000000:2.0:1788271933.058949:0:17190:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.103@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788271933.059382:0:17207:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788271933.074680:0:17208:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788271933.075401:0:17190:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.103@tcp (uuid 08d4e6e3-b587-4543-a287-4a9ae9a31c24) 00000020:00000080:0.0:1788271933.075426:0:17190:0:(genops.c:1385:class_connect()) connect: client 08d4e6e3-b587-4543-a287-4a9ae9a31c24, cookie 0x99288105fd38f804 00000100:00080000:0.0:1788271933.075438:0:17190:0:(import.c:510:import_select_connection()) MGC192.168.201.103@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788271933.075445:0:17190:0:(import.c:624:import_select_connection()) MGC192.168.201.103@tcp: import ffff8f6d8332c800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:0.0:1788271933.075474:0:17190:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d832bf100 x1875138590179840/t0(0) o250->MGC192.168.201.103@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788271933.075506:0:17190:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 08d4e6e3-b587-4543-a287-4a9ae9a31c24->MGS 00000100:00100000:3.0:1788271933.075679:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d832bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3605:1875138590179840:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788271933.075740:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:0.0:1788271933.075839:0:17190:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788271933.075845:0:17190:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788271933.075866:0:17190:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8f6d82f0cd28) 00000020:00000080:0.0:1788271933.075880:0:17190:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788271933.076686:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590179840 00000100:00100000:3.0:1788271933.076695:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590179840 00000100:00100000:3.0:1788271933.076729:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788271933.076736:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3605:x1875138590179840:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788271933.076758:0:17205:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 08d4e6e3-b587-4543-a287-4a9ae9a31c24@0@lo t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:3.0:1788271933.076780:0:17205:0:(genops.c:1385:class_connect()) connect: client 08d4e6e3-b587-4543-a287-4a9ae9a31c24, cookie 0x99288105fd38f812 00000100:00080000:3.0:1788271933.076899:0:17205:0:(import.c:65:import_set_state_nolock()) ffff8f6d838c8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788271933.076968:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+5:3605:x1875138590179840:12345-0@lo:250:mount.lustre.0 Request processed in 231us (1227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271933.076976:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788271933.077026:0:3605:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.103@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788271933.077034:0:3605:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.103@tcp: connect to target with instance 0 00000100:00080000:3.0:1788271933.077040:0:3605:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.103@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788271933.077044:0:3605:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788271933.077046:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6d8332c800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788271933.077049:0:3605:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788271933.077056:0:3605:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788271933.077061:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d832bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3605:1875138590179840:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788271933.098981:0:17190:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788271933.099162:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788271933.099170:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788271933.104760:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788271933.104773:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788271933.106806:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788271933.106817:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788271933.107472:0:17190:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788271933.107937:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788271933.107943:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788271933.109498:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788271933.109510:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788271933.153289:0:17190:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788271933.153557:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788271933.153693:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788271933.154604:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788271933.158302:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788271933.159480:0:17190:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788271933.163215:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788271933.163224:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788271933.164026:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788271933.164034:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788271933.164543:0:17190:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788271933.164954:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788271933.164960:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788271933.165395:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788271933.165403:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788271933.166075:0:17190:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788271933.166209:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788271933.166214:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788271933.167322:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788271933.167331:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788271933.187925:0:17190:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788271933.188140:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788271933.188147:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788271933.191337:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788271933.191431:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788271933.192558:0:17190:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788271933.192737:0:17190:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788271933.194147:0:17190:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788271933.194175:0:17190:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788271933.194181:0:17190:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.103@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788271933.194280:0:17190:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.103@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788271933.194331:0:17190:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.103@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788271933.194336:0:17190:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788271933.194338:0:17190:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788271933.194339:0:17190:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788271933.194341:0:17190:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788271933.194342:0:17190:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788271933.194343:0:17190:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788271933.194344:0:17190:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788271933.194346:0:17190:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788271933.194348:0:17190:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788271933.194349:0:17190:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788271933.194352:0:17190:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788271933.194354:0:17190:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788271933.194355:0:17190:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788271933.194356:0:17190:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788271933.194357:0:17190:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788271933.194358:0:17190:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788271933.194359:0:17190:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788271933.194360:0:17190:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788271933.194361:0:17190:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788271933.194362:0:17190:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788271933.194363:0:17190:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788271933.194388:0:17190:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788271933.194407:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17190:1875138590179968:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788271933.194473:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271933.194686:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590179968 00000100:00100000:1.0:1788271933.194693:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590179968 00000100:00100000:2.0:1788271933.194796:0:17190:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8325a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271933.194995:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788271933.195005:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc816450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+5:17190:x1875138590179968:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788271933.195048:0:17206:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788271933.195052:0:17206:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788271933.195055:0:17206:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788271933.195375:0:17227:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788271933.195832:0:17206:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1788271933.197694:0:17228:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788271933.197702:0:17228:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1788271933.197705:0:17228:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788271933.197707:0:17228:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788271933.197908:0:17228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1788271933.198118:0:17206:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788271933.198132:0:17206:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788271933.201426:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc816450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+5:17190:x1875138590179968:12345-0@lo:253:mount.lustre.0 Request processed in 6415us (6945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271933.201455:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788271933.202169:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17190:1875138590179968:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788271933.202183:0:17190:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788271933.202187:0:17190:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788271933.202188:0:17190:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788271933.202190:0:17190:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788271933.202191:0:17190:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788271933.202192:0:17190:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788271933.202193:0:17190:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788271933.202194:0:17190:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788271933.202195:0:17190:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788271933.202197:0:17190:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788271933.202199:0:17190:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788271933.202220:0:17190:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f6e851db000 from lustre-MDT0000 10000000:01000000:2.0:1788271933.202249:0:17190:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788271933.202252:0:17190:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788271933.202256:0:17190:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8f6eb4174d28 10000000:01000000:2.0:1788271933.202261:0:17190:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788271933.202268:0:17190:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f6eb4174d28 from 1 10000000:01000000:2.0:1788271933.202271:0:17190:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788271933.202304:0:17190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6400/0x99288105fd38f819 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271933.202324:0:17190:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6400/0x99288105fd38f819 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271933.202334:0:17190:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6400/0x99288105fd38f819 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271933.202355:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17190:1875138590180096:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788271933.202449:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271933.202496:0:17190:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8325a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788271933.203715:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590180096 00000100:00100000:3.0:1788271933.203725:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590180096 00000100:00100000:3.0:1788271933.203772:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788271933.203781:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc815450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+5:17190:x1875138590180096:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788271933.203794:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271933.203811:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6d830c5800/0x99288105fd38f820 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38f819 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271933.203834:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6d830c5800/0x99288105fd38f820 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38f819 expref: 6 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271933.203844:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6d830c5800/0x99288105fd38f820 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38f819 expref: 6 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271933.203854:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c5800, rc 0) 00000100:00100000:3.0:1788271933.203898:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc815450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+6:17190:x1875138590180096:12345-0@lo:101:mount.lustre.0 Request processed in 118us (1449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271933.203904:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788271933.204465:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17190:1875138590180096:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788271933.204482:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6400/0x99288105fd38f819 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f820 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271933.204491:0:17190:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6400/0x99288105fd38f819 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38f820 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271933.204560:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17190:1875138590180224:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788271933.204785:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271933.204859:0:17190:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8325a180 going to sleep for 11 seconds 00000100:00100000:0.0:1788271933.209047:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590180224 00000100:00100000:0.0:1788271933.209061:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590180224 00000100:00100000:0.0:1788271933.209129:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788271933.209139:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+6:17190:x1875138590180224:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788271933.209441:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+6:17190:x1875138590180224:12345-0@lo:501:mount.lustre.0 Request processed in 303us (4654us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788271933.209448:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788271933.213810:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17190:1875138590180224:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788271933.213886:0:17190:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788271933.213959:0:17190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6400/0x99288105fd38f819 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f820 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271933.213969:0:17190:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6400/0x99288105fd38f819 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f820 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271933.213978:0:17190:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f6e851db000 10000000:01000000:2.0:1788271933.213986:0:17190:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788271933.213991:0:17190:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8f6e851db000 10000000:01000000:2.0:1788271933.213995:0:17190:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788271933.213998:0:17190:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8f6e851db000 from 1 10000000:01000000:2.0:1788271933.214001:0:17190:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788271933.214033:0:17190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7200/0x99288105fd38f827 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271933.214040:0:17190:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7200/0x99288105fd38f827 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271933.214063:0:17190:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7200/0x99288105fd38f827 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271933.214081:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17190:1875138590180352:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788271933.214141:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271933.214184:0:17190:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8325a180 going to sleep for 11 seconds 00000100:00100000:1.0:1788271933.214293:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590180352 00000100:00100000:1.0:1788271933.214300:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590180352 00000100:00100000:1.0:1788271933.214355:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788271933.214364:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc815850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+6:17190:x1875138590180352:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788271933.214377:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271933.214391:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4ed5600/0x99288105fd38f82e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38f827 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271933.214412:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4ed5600/0x99288105fd38f82e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38f827 expref: 7 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271933.214421:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4ed5600/0x99288105fd38f82e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38f827 expref: 7 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271933.214429:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4ed5600, rc 0) 00000100:00100000:1.0:1788271933.214470:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc815850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+7:17190:x1875138590180352:12345-0@lo:101:mount.lustre.0 Request processed in 107us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271933.214476:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788271933.214545:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17190:1875138590180352:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788271933.214556:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7200/0x99288105fd38f827 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f82e expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271933.214574:0:17190:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7200/0x99288105fd38f827 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38f82e expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271933.214586:0:17190:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788271933.214869:0:17190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7200/0x99288105fd38f827 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f82e expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271933.214885:0:17190:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7200/0x99288105fd38f827 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f82e expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271933.214891:0:17190:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788271933.214940:0:17190:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788271933.214946:0:17190:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8f6e851db000 10000000:01000000:2.0:1788271933.214948:0:17190:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788271933.214951:0:17190:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788271933.214953:0:17190:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788271933.214970:0:17190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7a00/0x99288105fd38f835 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271933.214977:0:17190:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7a00/0x99288105fd38f835 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271933.214984:0:17190:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7a00/0x99288105fd38f835 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271933.214996:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17190:1875138590180480:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788271933.215022:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271933.215047:0:17190:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8325a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271933.215093:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590180480 00000100:00100000:3.0:1788271933.215097:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590180480 00000100:00100000:3.0:1788271933.215128:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788271933.215135:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+7:17190:x1875138590180480:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788271933.215143:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271933.215152:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6d830c5a00/0x99288105fd38f83c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38f835 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271933.215166:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6d830c5a00/0x99288105fd38f83c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38f835 expref: 8 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271933.215173:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6d830c5a00/0x99288105fd38f83c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38f835 expref: 8 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271933.215178:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c5a00, rc 0) 00000100:00100000:3.0:1788271933.215216:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+8:17190:x1875138590180480:12345-0@lo:101:mount.lustre.0 Request processed in 82us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271933.215222:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788271933.215767:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17190:1875138590180480:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788271933.215779:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7a00/0x99288105fd38f835 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f83c expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271933.215788:0:17190:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7a00/0x99288105fd38f835 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38f83c expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271933.215849:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17190:1875138590180608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788271933.215874:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271933.215893:0:17190:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8325a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271933.218489:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590180608 00000100:00100000:3.0:1788271933.218502:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590180608 00000100:00100000:3.0:1788271933.218581:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788271933.218593:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+8:17190:x1875138590180608:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788271933.218818:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+9:17190:x1875138590180608:12345-0@lo:501:mount.lustre.0 Request processed in 227us (2942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271933.218839:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788271933.219041:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17190:1875138590180608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788271933.219086:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17190:1875138590180736:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788271933.219130:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271933.219161:0:17190:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8325a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271933.219200:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590180736 00000100:00100000:1.0:1788271933.219205:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590180736 00000100:00100000:1.0:1788271933.219225:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788271933.219230:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc815c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+9:17190:x1875138590180736:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788271933.220077:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc815c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+9:17190:x1875138590180736:12345-0@lo:503:mount.lustre.0 Request processed in 843us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271933.220086:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788271933.220163:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17190:1875138590180736:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788271933.221522:0:17229:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17229:1875138590180864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788271933.221590:0:17229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271933.221652:0:17229:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d8325af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788271933.221713:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590180864 00000100:00100000:1.0:1788271933.221719:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590180864 00000100:00100000:1.0:1788271933.221761:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788271933.221770:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+9:17229:x1875138590180864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271933.222381:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+9:17229:x1875138590180864:12345-0@lo:502:llog_process_th.0 Request processed in 610us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271933.222389:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788271933.222530:0:17229:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17229:1875138590180864:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788271933.222554:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788271933.222575:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271933.222577:0:17229:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788271933.222584:0:17229:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788271933.222586:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788271933.222600:0:17229:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8f6eb4170000) 00000020:00000080:2.0:1788271933.222616:0:17229:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788271933.222648:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788271933.222727:0:17229:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788271933.222734:0:17229:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x99288105fd38f84a 00000020:00000080:2.0:1788271933.222931:0:17229:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788271933.222936:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788271933.222939:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271933.222947:0:17229:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788271933.222950:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788271933.222954:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271933.222955:0:17229:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788271933.222958:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788271933.222965:0:17229:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8f6eb4173370) 00000020:00000080:2.0:1788271933.222974:0:17229:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788271933.222978:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788271933.222980:0:17229:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788271933.222983:0:17229:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788271933.222989:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788271933.223036:0:17229:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f6e851db000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788271933.223050:0:17229:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8f6eb0cf99b8) 00000020:00000080:2.0:1788271933.223057:0:17229:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788271933.223109:0:17229:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788271933.223114:0:17229:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x99288105fd38f85f 00000020:00000080:2.0:1788271933.223206:0:17229:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788271933.223212:0:17229:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788271933.223216:0:17229:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x99288105fd38f866 00080000:01000000:2.0:1788271933.223220:0:17229:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788271933.223224:0:17229:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x99288105fd38f86d 00010000:00010000:2.0:1788271933.302262:0:17229:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788271933.303301:0:17229:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967529 00000001:00080000:2.0:1788271933.303933:0:17229:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788271933.304437:0:17229:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8f6eb0cfcd28) 00000020:00000080:2.0:1788271933.304455:0:17229:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788271933.304530:0:17229:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788271933.304538:0:17229:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x99288105fd38f87b 00000020:00000080:1.0:1788271933.316770:0:17229:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788271933.323792:0:17229:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x99288105fd38f882 00000020:00000080:0.0:1788271933.324233:0:17229:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788271933.324245:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788271933.324251:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271933.324253:0:17229:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788271933.324256:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788271933.324265:0:17229:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1788271933.324267:0:17229:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788271933.324269:0:17229:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788271933.324271:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788271933.324274:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271933.324276:0:17229:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788271933.324278:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788271933.324283:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271933.324284:0:17229:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788271933.324289:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788271933.324340:0:17229:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788271933.324358:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788271933.324362:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271933.324363:0:17229:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788271933.324365:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788271933.324368:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271933.324369:0:17229:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1788271933.324372:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788271933.324377:0:17229:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.103@tcp to nid 0x20000c0a8c967 (192.168.201.103@tcp) 00000020:00000080:0.0:1788271933.324402:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788271933.324417:0:17229:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8f6d82f099b8) 00000020:00000080:0.0:1788271933.324430:0:17229:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788271933.324434:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788271933.324480:0:17229:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1788271933.324485:0:17229:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788271933.324489:0:17229:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x99288105fd38f890 00010000:00080000:0.0:1788271933.324516:0:17229:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f6e859ce800@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.103@tcp at head 00010000:00010000:0.0:1788271933.326075:0:17229:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1788271933.327520:0:17229:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788271933.327532:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788271933.327572:0:17229:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788271933.327590:0:17229:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x99288105fd38f897 00000100:00080000:1.0:1788271933.327599:0:17229:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788271933.327605:0:17229:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8f6e859ce800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788271933.327674:0:17229:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d83390380 x1875138590180992/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788271933.327692:0:17229:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1788271933.327740:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788271933.327744:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271933.327746:0:17229:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788271933.327748:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788271933.327751:0:17229:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1788271933.327753:0:17229:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788271933.327754:0:17229:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788271933.327760:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788271933.327763:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271933.327764:0:17229:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788271933.327766:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788271933.327771:0:17229:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788271933.327774:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271933.327775:0:17229:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788271933.327777:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788271933.327781:0:17229:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.103@tcp to nid 0x20000c0a8c967 (192.168.201.103@tcp) 00000020:01000000:1.0:1788271933.327802:0:17229:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788271933.327805:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788271933.327816:0:17229:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8f6eb4e94d28) 00000020:00000080:1.0:1788271933.327826:0:17229:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788271933.327830:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788271933.327885:0:17229:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788271933.327890:0:17229:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788271933.327895:0:17229:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x99288105fd38f8a5 00010000:00080000:1.0:1788271933.327918:0:17229:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f6e859c8800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.103@tcp at head 00010000:00010000:1.0:1788271933.328093:0:17229:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:3.0:1788271933.328514:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83390380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3605:1875138590180992:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788271933.328595:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271933.328944:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590180992 00000100:00100000:1.0:1788271933.328952:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590180992 00000100:00100000:1.0:1788271933.328981:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788271933.328989:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3605:x1875138590180992:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1788271933.329006:0:17216:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:0.0:1788271933.332746:0:17229:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788271933.333614:0:17229:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788271933.335091:0:17229:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788271933.335261:0:17229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788271933.341532:0:17229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788271933.347700:0:17235:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788271933.347708:0:17235:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:1.0:1788271933.350493:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3605:x1875138590180992:12345-0@lo:38:llog_process_th.0 Request processed in 21498us (21892us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788271933.350504:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788271933.350584:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6e859ce800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788271933.350589:0:3605:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788271933.350592:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83390380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3605:1875138590180992:0@lo:38:llog_process_th.0 00000020:00000080:0.0:1788271933.352328:0:17229:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788271933.352343:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788271933.352382:0:17229:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788271933.352398:0:17229:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x99288105fd38f8ac 00000100:00080000:0.0:1788271933.352405:0:17229:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788271933.352409:0:17229:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f6e859c8800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:0.0:1788271933.352437:0:17229:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d832bca80 x1875138590181120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788271933.352490:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d832bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3605:1875138590181120:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788271933.352529:0:3605:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875138590181120 offset 0 length 520: 4 00000100:00080000:0.0:1788271933.352574:0:17229:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788271933.352635:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788271933.352639:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271933.352640:0:17229:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788271933.352642:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788271933.352644:0:17229:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1788271933.352646:0:17229:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788271933.352647:0:17229:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788271933.352648:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788271933.352649:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271933.352650:0:17229:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788271933.352651:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788271933.352654:0:17229:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788271933.352656:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271933.352657:0:17229:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788271933.352658:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788271933.352661:0:17229:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.103@tcp to nid 0x20000c0a8c967 (192.168.201.103@tcp) 00000020:01000000:0.0:1788271933.352675:0:17229:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788271933.352677:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788271933.352695:0:17229:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8f6d82f0b370) 00000020:00000080:0.0:1788271933.352703:0:17229:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1788271933.352706:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788271933.352745:0:17229:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788271933.352749:0:17229:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:0.0:1788271933.352752:0:17229:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x99288105fd38f8ba 00010000:00080000:0.0:1788271933.352771:0:17229:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f6e8ac65000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.103@tcp at head 00010000:00010000:0.0:1788271933.352929:0:17229:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1788271933.352979:0:17229:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788271933.352993:0:17229:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788271933.354613:0:17229:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788271933.359183:0:17229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1788271933.359348:0:17229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788271933.359795:0:17237:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788271933.359799:0:17237:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788271933.360366:0:17229:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788271933.360376:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788271933.360408:0:17229:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788271933.360426:0:17229:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x99288105fd38f8c1 00000100:00080000:0.0:1788271933.360436:0:17229:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788271933.360442:0:17229:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f6e8ac65000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:0.0:1788271933.360474:0:17229:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d832bdf80 x1875138590181248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788271933.360501:0:17229:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788271933.360555:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788271933.360568:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271933.360570:0:17229:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788271933.360573:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788271933.360577:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271933.360578:0:17229:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788271933.360581:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788271933.360583:0:17229:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788271933.360585:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788271933.360592:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271933.360594:0:17229:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788271933.360596:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788271933.360599:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271933.360600:0:17229:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788271933.360603:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788271933.360658:0:17229:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d832bd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17229:1875138590181376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788271933.360732:0:17229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271933.360766:0:17229:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4041240 going to sleep for 11 seconds 00000100:00100000:3.0:1788271933.360994:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d832bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3605:1875138590181248:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788271933.361024:0:3605:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875138590181248 offset 0 length 520: 4 00000100:00100000:1.0:1788271933.361159:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590181376 00000100:00100000:1.0:1788271933.361166:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590181376 00000100:00100000:1.0:1788271933.361242:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788271933.361257:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+9:17229:x1875138590181376:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788271933.361388:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+9:17229:x1875138590181376:12345-0@lo:502:llog_process_th.0 Request processed in 132us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271933.361396:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788271933.361471:0:17229:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d832bd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17229:1875138590181376:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788271933.361496:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788271933.361501:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271933.361503:0:17229:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788271933.361506:0:17229:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1788271933.361733:0:17190:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1788271933.361753:0:17190:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788271933.361773:0:17190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7a00/0x99288105fd38f835 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f83c expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271933.361784:0:17190:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7a00/0x99288105fd38f835 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f83c expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271933.361792:0:17190:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f6e851db000 from 1 10000000:01000000:3.0:1788271933.361795:0:17190:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788271933.361832:0:17190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5c00/0x99288105fd38f8c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271933.361841:0:17190:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5c00/0x99288105fd38f8c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271933.361850:0:17190:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5c00/0x99288105fd38f8c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271933.361874:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83251180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17190:1875138590181504:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788271933.361910:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271933.362132:0:17190:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84ccac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788271933.362198:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590181504 00000100:00100000:2.0:1788271933.362204:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590181504 00000100:00100000:2.0:1788271933.362228:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788271933.362242:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+9:17190:x1875138590181504:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788271933.362255:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271933.362269:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6d833f7c00/0x99288105fd38f8cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38f8c8 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271933.362288:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6d833f7c00/0x99288105fd38f8cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38f8c8 expref: 10 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271933.362297:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6d833f7c00/0x99288105fd38f8cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38f8c8 expref: 10 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271933.362305:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d833f7c00, rc 0) 00000100:00100000:2.0:1788271933.362351:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+10:17190:x1875138590181504:12345-0@lo:101:mount.lustre.0 Request processed in 110us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271933.362357:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788271933.362460:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83251180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17190:1875138590181504:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788271933.362473:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5c00/0x99288105fd38f8c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f8cf expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271933.362482:0:17190:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5c00/0x99288105fd38f8c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38f8cf expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271933.363147:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83251180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17190:1875138590181632:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788271933.363187:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271933.363211:0:17190:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84ccac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788271933.363284:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590181632 00000100:00100000:1.0:1788271933.363289:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590181632 00000100:00100000:1.0:1788271933.363341:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788271933.363349:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e83ea2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+10:17190:x1875138590181632:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788271933.363363:0:17205:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788271933.363369:0:17205:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788271933.363733:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e83ea2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+10:17190:x1875138590181632:12345-0@lo:256:mount.lustre.0 Request processed in 384us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271933.363740:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788271933.363806:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83251180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17190:1875138590181632:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788271933.364409:0:17190:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788271933.364432:0:17190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5c00/0x99288105fd38f8c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f8cf expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271933.364442:0:17190:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5c00/0x99288105fd38f8c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f8cf expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271933.364450:0:17190:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f6e851db000 from 1 10000000:01000000:3.0:1788271933.364453:0:17190:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788271933.364475:0:17190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5e00/0x99288105fd38f8d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271933.364521:0:17190:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5e00/0x99288105fd38f8d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271933.364531:0:17190:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5e00/0x99288105fd38f8d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271933.364545:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83251180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17190:1875138590181760:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788271933.364665:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271933.364689:0:17190:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84ccac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788271933.364766:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590181760 00000100:00100000:2.0:1788271933.364771:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590181760 00000100:00100000:2.0:1788271933.364797:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788271933.364804:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+10:17190:x1875138590181760:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788271933.364813:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271933.364892:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6d833f7600/0x99288105fd38f8dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38f8d6 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271933.364911:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6d833f7600/0x99288105fd38f8dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38f8d6 expref: 11 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271933.364920:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6d833f7600/0x99288105fd38f8dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38f8d6 expref: 11 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271933.364939:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d833f7600, rc 0) 00000100:00100000:2.0:1788271933.364984:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+11:17190:x1875138590181760:12345-0@lo:101:mount.lustre.0 Request processed in 180us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271933.364990:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788271933.365300:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83251180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17190:1875138590181760:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788271933.365381:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5e00/0x99288105fd38f8d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f8dd expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271933.365391:0:17190:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5e00/0x99288105fd38f8d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38f8dd expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271933.365445:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83251180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17190:1875138590181888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788271933.365471:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271933.365614:0:17190:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84ccac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788271933.365801:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590181888 00000100:00100000:0.0:1788271933.365806:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590181888 00000100:00100000:2.0:1788271933.365967:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788271933.366059:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+11:17190:x1875138590181888:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788271933.366187:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+11:17190:x1875138590181888:12345-0@lo:501:mount.lustre.0 Request processed in 213us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271933.366194:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788271933.366283:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83251180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17190:1875138590181888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788271933.366325:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17190:1875138590182016:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788271933.366365:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271933.366420:0:17190:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e887c8300 going to sleep for 11 seconds 00000100:00100000:0.0:1788271933.366470:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590182016 00000100:00100000:0.0:1788271933.366474:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590182016 00000100:00100000:0.0:1788271933.366491:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788271933.366497:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+11:17190:x1875138590182016:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788271933.366663:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+11:17190:x1875138590182016:12345-0@lo:503:mount.lustre.0 Request processed in 165us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271933.366670:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788271933.366746:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17190:1875138590182016:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788271933.367176:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83250380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17239:1875138590182144:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271933.367209:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271933.367239:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84cca540 going to sleep for 11 seconds 00000100:00100000:0.0:1788271933.367283:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590182144 00000100:00100000:0.0:1788271933.367288:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590182144 00000100:00100000:0.0:1788271933.367322:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788271933.367329:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+11:17239:x1875138590182144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788271933.367756:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+11:17239:x1875138590182144:12345-0@lo:502:llog_process_th.0 Request processed in 426us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271933.367771:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788271933.367853:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83250380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17239:1875138590182144:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788271933.367877:0:17239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788271933.367887:0:17239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271933.367889:0:17239:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788271933.367896:0:17239:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f6e851db000 00000020:00000080:2.0:1788271933.367898:0:17239:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788271933.367905:0:17239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788271933.367908:0:17239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271933.367909:0:17239:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788271933.367911:0:17239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788271933.367914:0:17239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271933.367915:0:17239:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788271933.367918:0:17239:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f6e851db000 00000020:00000080:2.0:1788271933.367921:0:17239:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788271933.367983:0:17239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788271933.367986:0:17239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271933.367993:0:17239:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788271933.367996:0:17239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788271933.367999:0:17239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271933.368000:0:17239:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788271933.368003:0:17239:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f6e851db000 00000020:00000080:2.0:1788271933.368005:0:17239:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788271933.368025:0:17239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788271933.368028:0:17239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271933.368029:0:17239:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788271933.368032:0:17239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788271933.368034:0:17239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271933.368035:0:17239:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788271933.368039:0:17239:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f6e851db000 00000020:00000080:2.0:1788271933.368041:0:17239:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788271933.368072:0:17239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17239:1875138590182272:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788271933.368106:0:17239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271933.368126:0:17239:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e887c8300 going to sleep for 11 seconds 00000100:00100000:3.0:1788271933.368659:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590182272 00000100:00100000:3.0:1788271933.368665:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590182272 00000100:00100000:3.0:1788271933.368692:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788271933.368699:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+11:17239:x1875138590182272:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271933.368789:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+11:17239:x1875138590182272:12345-0@lo:502:llog_process_th.0 Request processed in 90us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271933.368796:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788271933.369707:0:17239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17239:1875138590182272:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788271933.369731:0:17239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788271933.369736:0:17239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271933.369738:0:17239:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788271933.369741:0:17239:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788271933.369896:0:17190:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788271933.369913:0:17190:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788271933.369930:0:17190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5e00/0x99288105fd38f8d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f8dd expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271933.369938:0:17190:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5e00/0x99288105fd38f8d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f8dd expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271933.369973:0:17190:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788271933.369975:0:17190:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f6e851db000 10000000:01000000:3.0:1788271933.369977:0:17190:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f6e851db000 10000000:01000000:3.0:1788271933.369980:0:17190:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788271933.369983:0:17190:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f6e851db000 from 1 10000000:01000000:3.0:1788271933.369985:0:17190:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788271933.370005:0:17190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4a00/0x99288105fd38f8e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271933.370011:0:17190:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4a00/0x99288105fd38f8e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271933.370017:0:17190:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4a00/0x99288105fd38f8e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271933.370035:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17190:1875138590182400:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788271933.370061:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271933.370081:0:17190:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84cca240 going to sleep for 11 seconds 00000100:00100000:3.0:1788271933.370092:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590182400 00000100:00100000:3.0:1788271933.370095:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590182400 00000100:00100000:3.0:1788271933.370113:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788271933.370119:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87096c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+11:17190:x1875138590182400:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788271933.370129:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271933.370141:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6d830c5200/0x99288105fd38f8eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38f8e4 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271933.370160:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6d830c5200/0x99288105fd38f8eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38f8e4 expref: 12 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271933.370170:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6d830c5200/0x99288105fd38f8eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38f8e4 expref: 12 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271933.370178:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c5200, rc 0) 00000100:00100000:3.0:1788271933.370207:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87096c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+12:17190:x1875138590182400:12345-0@lo:101:mount.lustre.0 Request processed in 87us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271933.370213:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788271933.370242:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17190:1875138590182400:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788271933.370254:0:17190:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4a00/0x99288105fd38f8e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f8eb expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271933.370262:0:17190:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4a00/0x99288105fd38f8e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38f8eb expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271933.370321:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17190:1875138590182528:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788271933.370345:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271933.370356:0:17190:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84cca240 going to sleep for 11 seconds 00000100:00100000:3.0:1788271933.370367:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590182528 00000100:00100000:3.0:1788271933.370370:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590182528 00000100:00100000:3.0:1788271933.370383:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788271933.370386:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+12:17190:x1875138590182528:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788271933.370453:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+12:17190:x1875138590182528:12345-0@lo:501:mount.lustre.0 Request processed in 66us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271933.370458:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788271933.370477:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17190:1875138590182528:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788271933.370493:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17190:1875138590182656:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788271933.370523:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271933.370535:0:17190:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84cca240 going to sleep for 11 seconds 00000100:00100000:3.0:1788271933.370548:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590182656 00000100:00100000:3.0:1788271933.370551:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590182656 00000100:00100000:3.0:1788271933.370662:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788271933.370670:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+12:17190:x1875138590182656:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788271933.370747:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+12:17190:x1875138590182656:12345-0@lo:503:mount.lustre.0 Request processed in 78us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271933.370753:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788271933.370790:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17190:1875138590182656:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788271933.386040:0:17240:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17240:1875138590182784:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271933.386123:0:17240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271933.386162:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590182784 00000100:00100000:3.0:1788271933.386168:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590182784 00000100:00100000:3.0:1788271933.386209:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788271933.386218:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+12:17240:x1875138590182784:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271933.386342:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+12:17240:x1875138590182784:12345-0@lo:502:llog_process_th.0 Request processed in 125us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271933.386351:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788271933.386402:0:17240:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84cca240 going to sleep for 11 seconds 00000100:00100000:3.0:1788271933.386423:0:17240:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17240:1875138590182784:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788271933.386488:0:17240:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788271933.386503:0:17240:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8f6d82354d28) 00000020:00000080:3.0:1788271933.386522:0:17240:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1788271933.387738:0:17240:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f6e851db000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788271933.387746:0:17240:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f6e851db000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788271933.387748:0:17240:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f6e851db000 4 00010000:00080000:3.0:1788271933.387776:0:17240:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f6eb4b8c800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.103@tcp at head 00010000:00010000:3.0:1788271933.389890:0:17240:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1788271933.390043:0:17240:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788271933.390074:0:17240:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788271933.390083:0:17240:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x99288105fd38f8f9 00000100:00080000:3.0:1788271933.390091:0:17240:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788271933.390095:0:17240:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8f6eb4b8c800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788271933.390127:0:17240:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d83253100 x1875138590182912/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788271933.390162:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3605:1875138590182912:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788271933.390234:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788271933.390289:0:17240:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788271933.390503:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590182912 00000100:00100000:1.0:1788271933.390511:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590182912 00000100:00100000:1.0:1788271933.390545:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788271933.390553:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3605:x1875138590182912:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788271933.390690:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3605:x1875138590182912:12345-0@lo:38:llog_process_th.0 Request processed in 136us (454us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788271933.390697:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788271933.390809:0:3605:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788271933.390818:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6eb4b8c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788271933.390822:0:3605:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788271933.390825:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3605:1875138590182912:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788271933.393239:0:17240:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83252d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17240:1875138590183040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271933.393320:0:17240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271933.393355:0:17240:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84cca600 going to sleep for 11 seconds 00000100:00100000:3.0:1788271933.393373:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590183040 00000100:00100000:3.0:1788271933.393378:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590183040 00000100:00100000:3.0:1788271933.393412:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788271933.393420:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87094050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+12:17240:x1875138590183040:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271933.393532:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87094050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+12:17240:x1875138590183040:12345-0@lo:502:llog_process_th.0 Request processed in 111us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271933.393539:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788271933.394702:0:17240:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83252d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17240:1875138590183040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271933.394755:0:17240:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83252d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17240:1875138590183168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271933.394798:0:17240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271933.396090:0:17240:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84c8f900 going to sleep for 11 seconds 00000100:00100000:3.0:1788271933.396190:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590183168 00000100:00100000:3.0:1788271933.396198:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590183168 00000100:00100000:3.0:1788271933.396243:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788271933.396252:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87094450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+12:17240:x1875138590183168:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788271933.396384:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87094450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+12:17240:x1875138590183168:12345-0@lo:502:llog_process_th.0 Request processed in 133us (1586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271933.396392:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788271933.396439:0:17240:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83252d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17240:1875138590183168:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788271933.396472:0:17240:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788271933.396918:0:17190:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788271933.396937:0:17190:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788271933.396952:0:17190:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4a00/0x99288105fd38f8e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f8eb expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271933.396963:0:17190:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4a00/0x99288105fd38f8e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f8eb expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788271933.397006:0:17190:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788271933.397008:0:17190:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788271933.397009:0:17190:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788271933.397010:0:17190:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788271933.397010:0:17190:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788271933.397011:0:17190:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788271933.397013:0:17190:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788271933.397014:0:17190:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788271933.397015:0:17190:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788271933.397016:0:17190:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788271933.397019:0:17190:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788271933.397020:0:17190:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788271933.397021:0:17190:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788271933.397022:0:17190:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788271933.397022:0:17190:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788271933.397023:0:17190:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788271933.397023:0:17190:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788271933.397024:0:17190:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788271933.397025:0:17190:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788271933.397026:0:17190:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788271933.397026:0:17190:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788271933.397041:0:17190:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788271933.397052:0:17190:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83252d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17190:1875138590183296:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788271933.397079:0:17190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271933.397097:0:17190:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84c8f900 going to sleep for 11 seconds 00000100:00100000:3.0:1788271933.397107:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590183296 00000100:00100000:3.0:1788271933.397115:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590183296 00000100:00100000:3.0:1788271933.397140:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788271933.397146:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+12:17190:x1875138590183296:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788271933.397165:0:17206:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788271933.397175:0:17206:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788271933.399572:0:17206:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788271933.399588:0:17206:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788271933.399758:0:17227:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788271933.399764:0:17227:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788271933.399787:0:17227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f6e8511de00/0x99288105fd38f900 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271933.399804:0:17227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6d833f7c00/0x99288105fd38f8cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38f8c8 expref: 12 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271933.399812:0:17227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f6e8511de00/0x99288105fd38f900 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271933.400107:0:17227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6d833f7c00/0x99288105fd38f8cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38f8c8 expref: 12 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271933.400124:0:17227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f6d833f7c00/0x99288105fd38f8cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38f8c8 expref: 12 pid: 17206 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271933.400139:0:17227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d832bd880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1875138590183424:0@lo:104: 00000100:00100000:0.0:1788271933.400202:0:17227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271933.400241:0:17227:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84eb2540 going to sleep for 11 seconds 00000100:00100000:0.0:1788271933.400278:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590183424 00000100:00100000:0.0:1788271933.400286:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590183424 00000100:00100000:0.0:1788271933.400385:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788271933.400396:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+3:17227:x1875138590183424:12345-0@lo:104: 00010000:00010000:0.0:1788271933.400411:0:17194:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5c00/0x99288105fd38f8c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38f8cf expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271933.400478:0:17194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788271933.400489:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+3:17227:x1875138590183424:12345-0@lo:104: Request processed in 95us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271933.400496:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788271933.400610:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+12:17190:x1875138590183296:12345-0@lo:253:mount.lustre.0 Request processed in 3463us (3528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271933.400634:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788271933.400649:0:17190:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83252d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17190:1875138590183296:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788271933.400662:0:17190:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788271933.400665:0:17190:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788271933.400667:0:17190:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788271933.400669:0:17190:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788271933.400670:0:17190:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788271933.400671:0:17190:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788271933.400672:0:17190:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788271933.400674:0:17190:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788271933.400675:0:17190:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788271933.400677:0:17190:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788271933.400679:0:17190:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788271933.400693:0:17190:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1788271933.400757:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271933.400764:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5c00/0x99288105fd38f8c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38f8cf expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271933.400781:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c5c00 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:2.0:1788271933.400784:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5c00/0x99288105fd38f8c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38f8cf expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271933.400792:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5c00/0x99288105fd38f8c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38f8cf expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788271933.400799:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5c00/0x99288105fd38f8c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38f8cf expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271933.400803:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788271933.400950:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5c00/0x99288105fd38f8c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38f8cf expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271933.400959:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788271933.400978:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5c00/0x99288105fd38f8c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38f8cf expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271933.400985:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5c00/0x99288105fd38f8c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38f8cf expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271933.400999:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271933.401001:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271933.401003:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271933.401033:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3608:1875138590183552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788271933.401065:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271933.401244:0:17227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d832bd880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1875138590183424:0@lo:104: 00010000:00010000:0.0:1788271933.401259:0:17227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f6e8511de00/0x99288105fd38f900 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271933.401324:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590183552 00000100:00100000:1.0:1788271933.401329:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590183552 00010000:00010000:1.0:1788271933.401347:0:17196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6d833f7c00/0x99288105fd38f8cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38f8c8 expref: 12 pid: 17206 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271933.401409:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788271933.401417:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+12:3608:x1875138590183552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788271933.401429:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271933.401435:0:17196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6d833f7c00/0x99288105fd38f8cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38f8c8 expref: 12 pid: 17206 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271933.401445:0:17196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6d833f7c00/0x99288105fd38f8cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38f8c8 expref: 12 pid: 17206 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271933.401458:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6d833f7c00/0x99288105fd38f8cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38f8c8 expref: 12 pid: 17206 timeout: 594 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271933.401472:0:17196:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f6e8511de00/0x99288105fd38f900 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271933.401480:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6e8511de00/0x99288105fd38f900 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788271933.401493:0:17196:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001729825s 00010000:00010000:1.0:1788271933.401498:0:17196:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f6e8511de00/0x99288105fd38f900 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271933.401505:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f6e8511de00/0x99288105fd38f900 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271933.401512:0:17196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f6e8511de00/0x99288105fd38f900 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271933.401519:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f6e8511de00/0x99288105fd38f900 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271933.401532:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511de00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:1.0:1788271933.401537:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f6e8511de00/0x99288105fd38f900 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271933.401544:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f6e8511de00/0x99288105fd38f900 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271933.401568:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f6e8511de00/0x99288105fd38f900 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271933.401579:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271933.401616:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+11:3608:x1875138590183552:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271933.401690:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788271933.401921:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3608:1875138590183552:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788271933.402060:0:17227:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f6e8511de00/0x99288105fd38f900 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271933.402068:0:17227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f6e8511de00/0x99288105fd38f900 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271933.402073:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6e8511de00/0x99288105fd38f900 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788271933.415014:0:17190:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788271933.415214:0:17190:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788271933.415276:0:17250:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788271933.415279:0:17250:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1788271933.415447:0:17251:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788271933.415635:0:17190:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:3.0:1788271933.415951:0:17252:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8f6d83252d80 x1875138590183680/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271933.415961:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc98dc00 going to sleep for 0 seconds 00000040:00080000:3.0:1788271933.416087:0:17251:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1788271933.417991:0:17190:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788271933.418018:0:17190:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788271933.418388:0:17190:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788271933.418393:0:17190:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788271933.418417:0:17190:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788271933.419171:0:17251:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788271933.419221:0:17251:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:1.0:1788271933.420490:0:17190:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788271933.421062:0:17190:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788271933.421095:0:17190:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1788271933.423025:0:17190:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:0.0:1788271933.429284:0:17190:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788271933.433715:0:17190:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788271933.433755:0:17190:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa349c1cab988 00100000:10000000:0.0:1788271933.433763:0:17190:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788271933.434068:0:17190:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788271933.434083:0:17190:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.103@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788271933.434101:0:17190:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1788271933.434122:0:17190:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788271933.436471:0:17190:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788271933.437901:0:17190:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788271934.046693:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271934.429700:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc98dc00 going to sleep for 0 seconds 10000000:01000000:2.0:1788271934.431944:0:17208:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788271934.431956:0:17208:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f6e851db000 from 7 10000000:01000000:2.0:1788271934.431961:0:17208:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788271934.431998:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6a00/0x99288105fd38f907 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271934.432007:0:17208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6a00/0x99288105fd38f907 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271934.432015:0:17208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6a00/0x99288105fd38f907 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271934.432033:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590183808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788271934.432088:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271934.432131:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e887c8480 going to sleep for 11 seconds 00000100:00100000:1.0:1788271934.432215:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590183808 00000100:00100000:1.0:1788271934.432222:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590183808 00000100:00100000:1.0:1788271934.432276:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788271934.432285:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+11:17208:x1875138590183808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788271934.432313:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271934.432326:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4ed4a00/0x99288105fd38f90e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38f907 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271934.432349:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4ed4a00/0x99288105fd38f90e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38f907 expref: 12 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271934.432359:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4ed4a00/0x99288105fd38f90e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38f907 expref: 12 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271934.432367:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4ed4a00, rc 0) 00000100:00100000:1.0:1788271934.432405:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+12:17208:x1875138590183808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271934.432409:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788271934.432566:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590183808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788271934.432577:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6a00/0x99288105fd38f907 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f90e expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271934.432583:0:17208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6a00/0x99288105fd38f907 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38f90e expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271934.432632:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590183936:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788271934.432653:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271934.432671:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e887c8480 going to sleep for 11 seconds 00000100:00100000:1.0:1788271934.432711:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590183936 00000100:00100000:1.0:1788271934.432714:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590183936 00000100:00100000:1.0:1788271934.432738:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788271934.432742:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87095050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+12:17208:x1875138590183936:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788271934.432752:0:17206:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788271934.432765:0:17206:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788271934.432767:0:17206:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788271934.432817:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87095050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+12:17208:x1875138590183936:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 74us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271934.432821:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788271934.433174:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590183936:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788271934.433216:0:17208:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788271934.433223:0:17208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6a00/0x99288105fd38f907 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f90e expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271934.433241:0:17208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6a00/0x99288105fd38f907 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f90e expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788271934.433890:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788271935.070035:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271935.458842:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc98dc00 going to sleep for 0 seconds 00000040:00080000:1.0:1788271935.460903:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788271936.093757:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271936.478191:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc98dc00 going to sleep for 0 seconds 00010000:00010000:2.0:1788271937.117759:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788271937.333770:0:17496:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg103-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788271937.502999:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc98dc00 going to sleep for 0 seconds 00010000:00010000:3.0:1788271938.148161:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788271938.356180:0:17548:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788271938.356421:0:17548:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788271938.526795:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc98dc00 going to sleep for 0 seconds 00000100:00080000:1.0:1788271938.591197:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788271938.591206:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788271938.591210:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f6e859ce800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788271938.591227:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 494 00000100:00100000:0.0:1788271938.591390:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788271938.591407:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83391880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3608:1875138590184064:0@lo:400:kworker.0 00000100:00100000:0.0:1788271938.591496:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271938.591564:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590184064 00000100:00100000:0.0:1788271938.591571:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590184064 00000100:00100000:0.0:1788271938.591638:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788271938.591647:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e8528c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+12:3608:x1875138590184064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271938.591692:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e8528c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+12:3608:x1875138590184064:12345-0@lo:400:kworker.0 Request processed in 46us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271938.591699:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788271938.591876:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83391880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3608:1875138590184064:0@lo:400:kworker.0 00000100:00080000:1.0:1788271938.591987:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788271938.591994:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8f6e859ce800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788271938.592015:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d83391f80 x1875138590184192/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788271938.592309:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788271938.592315:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788271938.592318:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788271938.592321:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788271938.592323:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788271938.592326:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788271938.592328:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f6eb4b8c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788271938.592333:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8f6eb4b8c800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788271938.592347:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d83392680 x1875138590184320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788271938.592411:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83391f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3605:1875138590184192:0@lo:38:kworker.0 00000100:00100000:0.0:1788271938.592447:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271938.592566:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590184192 00000100:00100000:2.0:1788271938.592571:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590184192 00000100:00100000:2.0:1788271938.592602:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788271938.592609:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3605:x1875138590184192:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788271938.592645:0:17217:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788271938.595174:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83392680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3605:1875138590184320:0@lo:38:kworker.0 00000100:00100000:0.0:1788271938.595263:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271938.595347:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590184320 00000100:00100000:0.0:1788271938.595355:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590184320 00000100:00100000:0.0:1788271938.595387:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788271938.595395:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3605:x1875138590184320:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788271938.595423:0:17213:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 499 last 0 00000020:00000080:0.0:1788271938.595458:0:17213:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x99288105fd38f915 00000004:00100000:0.0:1788271938.595592:0:17213:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788271938.595805:0:17213:0:(import.c:65:import_set_state_nolock()) ffff8f6e8ac6b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788271938.595860:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3605:x1875138590184320:12345-0@lo:38:kworker.0 Request processed in 464us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271938.595868:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788271938.595908:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f6d83392680 x1875138590184320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788271948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788271938.595923:0:3605:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788271938.595939:0:3605:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788271938.595944:0:3605:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788271938.595946:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6eb4b8c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788271938.595952:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83392680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3605:1875138590184320:0@lo:38:kworker.0 00000100:00100000:2.0:1788271938.617273:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3605:x1875138590184192:12345-0@lo:38:kworker.0 Request processed in 24656us (24818us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788271938.617289:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788271938.620597:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6e859ce800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788271938.620606:0:3605:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788271938.620611:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83391f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3605:1875138590184192:0@lo:38:kworker.0 00010000:00010000:2.0:1788271939.165840:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788271939.243717:0:17598:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788271939.244026:0:17598:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788271939.549746:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc98dc00 going to sleep for 0 seconds 00010000:00010000:3.0:1788271940.191279:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271940.575271:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc98dc00 going to sleep for 0 seconds 00010000:00010000:2.0:1788271941.214755:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271941.597847:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc98dc00 going to sleep for 0 seconds 00010000:00010000:3.0:1788271942.238932:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271942.623074:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc98dc00 going to sleep for 0 seconds 00010000:00010000:3.0:1788271943.270981:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271943.645715:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc98dc00 going to sleep for 0 seconds 00000100:00080000:1.0:1788271943.710842:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788271943.710848:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788271943.710852:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f6e859ce800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788271943.710861:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 499 00000100:00080000:1.0:1788271943.710867:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788271943.710888:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8f6e859ce800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788271943.710912:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d83391c00 x1875138590184576/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788271943.710927:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788271943.710930:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788271943.710932:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788271943.710935:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788271943.711043:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83392300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875138590184704:0@lo:400:kworker.0 00000100:00100000:2.0:1788271943.711107:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271943.711175:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788271943.711183:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83393b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3607:1875138590184448:0@lo:400:kworker.0 00000100:00100000:2.0:1788271943.711215:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271943.711231:0:3605:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788271933/real 1788271933] req@ffff8f6d832bdf80 x1875138590181248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788271943 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271943.711253:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590184448 00000100:00100000:3.0:1788271943.711255:0:3605:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f6d832bdf80 x1875138590181248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788271943 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271943.711267:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590184448 00000100:00100000:3.0:1788271943.711271:0:3605:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788271933/real 1788271933] req@ffff8f6d832bca80 x1875138590181120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788271943 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271943.711286:0:3605:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f6d832bca80 x1875138590181120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788271943 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271943.711301:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83391c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3605:1875138590184576:0@lo:38:kworker.0 00000100:00100000:2.0:1788271943.711313:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788271943.711324:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e8528d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+12:3607:x1875138590184448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271943.711377:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e8528d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+12:3607:x1875138590184448:12345-0@lo:400:kworker.0 Request processed in 55us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271943.711381:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271943.711391:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788271943.711412:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6e8ac65000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788271943.711426:0:3605:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788271943.711431:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d832bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3605:1875138590181248:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788271943.711438:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6e859c8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788271943.711446:0:3605:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788271943.711446:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83393b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3607:1875138590184448:0@lo:400:kworker.0 00000100:00100000:3.0:1788271943.711454:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d832bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3605:1875138590181120:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788271943.711493:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590184576 00000100:00100000:3.0:1788271943.711498:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590184576 00000100:00100000:1.0:1788271943.711522:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590184704 00000100:00100000:1.0:1788271943.711528:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590184704 00000100:00100000:3.0:1788271943.711532:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788271943.711546:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3605:x1875138590184576:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788271943.711561:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00010000:00020000:3.0:1788271943.711565:0:17216:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788271943.711571:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875138590184704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271943.711613:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875138590184704:12345-0@lo:400:kworker.0 Request processed in 43us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271943.711639:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788271943.712525:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f6d83392300 x1875138590184704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271943.712539:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83392300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875138590184704:0@lo:400:kworker.0 00000100:00080000:2.0:1788271943.713684:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788271943.713693:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788271943.713696:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f6e859c8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788271943.713702:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 494 00000100:00080000:2.0:1788271943.713706:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788271943.713713:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f6e859c8800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788271943.713744:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d8406ea00 x1875138590184832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788271943.713765:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788271943.713768:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788271943.713770:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f6e8ac65000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788271943.713774:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 494 00000100:00080000:2.0:1788271943.713788:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788271943.713793:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f6e8ac65000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788271943.713815:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d8406e680 x1875138590184960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788271943.719712:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3605:1875138590184832:0@lo:8:kworker.0 00000400:00000100:2.0:1788271943.719773:0:3605:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875138590184832 offset 0 length 520: 4 00000100:00100000:2.0:1788271943.719809:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3605:1875138590184960:0@lo:8:kworker.0 00000400:00000100:2.0:1788271943.719828:0:3605:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875138590184960 offset 0 length 520: 4 00000100:00100000:3.0:1788271943.731254:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3605:x1875138590184576:12345-0@lo:38:kworker.0 Request processed in 19700us (19868us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788271943.731270:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788271943.731385:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6e859ce800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788271943.731391:0:3605:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788271943.731395:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83391c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3605:1875138590184576:0@lo:38:kworker.0 00010000:00010000:3.0:1788271944.297922:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271944.670682:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc98dc00 going to sleep for 0 seconds 00010000:00010000:0.0:1788271945.310017:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788271945.694317:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788271945.694530:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc98dc00 going to sleep for 0 seconds 00000020:01000004:3.0:1788271945.876151:0:17944:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788271945.876156:0:17944:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788271945.876157:0:17944:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788271945.876285:0:17944:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f6d82344800 00000020:01000004:3.0:1788271945.876302:0:17944:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1788271945.876315:0:17944:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788271945.876329:0:17944:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8f6d82350000) 00000020:00000080:3.0:1788271945.876400:0:17944:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788271945.925966:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1788271945.926395:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788271945.927223:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788271945.927590:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788271945.927909:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788271945.928113:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1788271945.928289:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788271945.928542:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1788271945.928826:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788271945.929010:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788271945.929230:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788271945.929467:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788271945.929676:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788271945.929908:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1788271945.931494:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1788271945.932113:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788271945.932320:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1788271945.932533:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788271945.932757:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788271945.932955:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1788271945.933188:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788271945.933370:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788271945.933581:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788271945.933885:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788271945.934058:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788271945.934278:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788271945.934505:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1788271945.934862:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1788271945.935086:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788271945.935316:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788271945.935534:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788271945.935804:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788271945.936045:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1788271945.936274:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1788271945.936639:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1788271945.936894:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788271945.937120:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788271945.937427:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788271945.937676:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788271945.937935:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1788271945.938129:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788271945.938309:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788271945.938602:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788271945.938988:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788271945.939178:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788271945.939403:0:17944:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00080000:01000000:2.0:1788271945.940889:0:17944:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788271945.941156:0:17944:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788271945.941167:0:17944:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788271945.941178:0:17944:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x99288105fd38f923 00000020:01000004:2.0:1788271945.941185:0:17944:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788271945.941207:0:17944:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.103@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788271945.941211:0:17944:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788271945.941218:0:17944:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788271945.941246:0:17944:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788271945.941250:0:17944:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.103@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1788271945.946257:0:17944:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.103@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788271945.946298:0:17944:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.201.103@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1788271945.946303:0:17944:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788271945.946305:0:17944:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788271945.946306:0:17944:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788271945.946307:0:17944:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788271945.946309:0:17944:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788271945.946310:0:17944:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788271945.946312:0:17944:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788271945.946313:0:17944:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788271945.946315:0:17944:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788271945.946318:0:17944:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1788271945.946321:0:17944:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788271945.946322:0:17944:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788271945.946323:0:17944:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788271945.946324:0:17944:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788271945.946325:0:17944:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788271945.946326:0:17944:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788271945.946327:0:17944:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788271945.946328:0:17944:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788271945.946336:0:17944:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788271945.946378:0:17944:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788271945.946401:0:17944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590185088:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788271945.946478:0:17944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271945.946580:0:17944:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9828e240 going to sleep for 11 seconds 00000100:00100000:0.0:1788271945.946902:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590185088 00000100:00100000:0.0:1788271945.946911:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590185088 00000100:00100000:0.0:1788271945.947003:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788271945.947015:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e8528fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+12:17944:x1875138590185088:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788271945.947048:0:17206:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788271945.947052:0:17206:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1788271945.947060:0:17206:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788271945.947404:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e8528fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+12:17944:x1875138590185088:12345-0@lo:253:mount.lustre.0 Request processed in 390us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271945.947413:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788271945.947518:0:17944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590185088:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788271945.947529:0:17944:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788271945.947531:0:17944:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788271945.947533:0:17944:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788271945.947534:0:17944:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788271945.947535:0:17944:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788271945.947536:0:17944:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788271945.947538:0:17944:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788271945.947539:0:17944:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788271945.947540:0:17944:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788271945.947541:0:17944:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788271945.947562:0:17944:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f6d82344800 from lustre-MDT0001 10000000:01000000:3.0:1788271945.947590:0:17944:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788271945.947593:0:17944:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788271945.947600:0:17944:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f6eb4174d28 local copy 00010000:00010000:3.0:1788271945.947610:0:17944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6400/0x99288105fd38f819 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f820 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271945.947853:0:17944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590185216:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788271945.947884:0:17944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271945.947949:0:17944:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9828e780 going to sleep for 11 seconds 00000100:00100000:0.0:1788271945.950602:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590185216 00000100:00100000:0.0:1788271945.950636:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590185216 00000100:00100000:0.0:1788271945.950832:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788271945.950844:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e8528f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+12:17944:x1875138590185216:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788271945.950983:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e8528f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+12:17944:x1875138590185216:12345-0@lo:501:mount.lustre.0 Request processed in 141us (3097us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788271945.950991:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788271945.951103:0:17944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590185216:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788271945.951124:0:17944:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788271945.951149:0:17944:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788271945.951157:0:17944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6400/0x99288105fd38f819 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f820 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271945.951183:0:17944:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6400/0x99288105fd38f819 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f820 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271945.951220:0:17944:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f6d82344800 10000000:01000000:3.0:1788271945.951226:0:17944:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788271945.951233:0:17944:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8f6eb4174d28 10000000:01000000:3.0:1788271945.951236:0:17944:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788271945.951240:0:17944:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8f6eb4174d28 from 1 10000000:01000000:3.0:1788271945.951243:0:17944:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788271945.951277:0:17944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4e00/0x99288105fd38f92a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271945.951286:0:17944:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4e00/0x99288105fd38f92a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271945.951296:0:17944:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4e00/0x99288105fd38f92a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271945.951319:0:17944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590185344:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788271945.951369:0:17944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271945.951397:0:17944:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9828e780 going to sleep for 11 seconds 00000100:00100000:0.0:1788271945.951521:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590185344 00000100:00100000:0.0:1788271945.951532:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590185344 00000100:00100000:0.0:1788271945.951567:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788271945.951574:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e8528ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+12:17944:x1875138590185344:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788271945.951583:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271945.951595:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6e8511cc00/0x99288105fd38f931 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38f92a expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271945.951644:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6e8511cc00/0x99288105fd38f931 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38f92a expref: 13 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271945.951655:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6e8511cc00/0x99288105fd38f931 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38f92a expref: 13 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271945.951663:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e8511cc00, rc 0) 00000100:00100000:0.0:1788271945.951691:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e8528ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+13:17944:x1875138590185344:12345-0@lo:101:mount.lustre.0 Request processed in 117us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271945.951696:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788271945.951846:0:17944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590185344:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788271945.951858:0:17944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4e00/0x99288105fd38f92a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f931 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271945.951867:0:17944:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4e00/0x99288105fd38f92a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38f931 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271945.951881:0:17944:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788271945.952060:0:17944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4e00/0x99288105fd38f92a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f931 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271945.952069:0:17944:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4e00/0x99288105fd38f92a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f931 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271945.952084:0:17944:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8f6d82344800 10000000:01000000:0.0:1788271945.952088:0:17944:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788271945.952102:0:17944:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8f6d82344800 from 1 10000000:01000000:0.0:1788271945.952105:0:17944:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788271945.952124:0:17944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e8511ce00/0x99288105fd38f938 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271945.952131:0:17944:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6e8511ce00/0x99288105fd38f938 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271945.952139:0:17944:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6e8511ce00/0x99288105fd38f938 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271945.952155:0:17944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d832bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590185472:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788271945.952185:0:17944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271945.952219:0:17944:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb35bd900 going to sleep for 11 seconds 00000100:00100000:2.0:1788271945.952371:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590185472 00000100:00100000:2.0:1788271945.952376:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590185472 00000100:00100000:1.0:1788271945.952691:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788271945.952713:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e8528d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+13:17944:x1875138590185472:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788271945.952725:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271945.952737:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4ed4800/0x99288105fd38f93f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38f938 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271945.952755:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4ed4800/0x99288105fd38f93f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38f938 expref: 14 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271945.952764:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4ed4800/0x99288105fd38f93f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38f938 expref: 14 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271945.952783:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4ed4800, rc 0) 00000100:00100000:1.0:1788271945.952822:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e8528d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+14:17944:x1875138590185472:12345-0@lo:101:mount.lustre.0 Request processed in 120us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271945.952829:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788271945.953023:0:17944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d832bc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590185472:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788271945.953036:0:17944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6e8511ce00/0x99288105fd38f938 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f93f expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271945.953044:0:17944:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6e8511ce00/0x99288105fd38f938 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38f93f expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271945.953057:0:17944:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788271945.956673:0:17944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e8511ce00/0x99288105fd38f938 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f93f expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271945.956720:0:17944:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6e8511ce00/0x99288105fd38f938 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f93f expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271945.956729:0:17944:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788271945.956736:0:17944:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788271945.956743:0:17944:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8f6d82344800 10000000:01000000:2.0:1788271945.956746:0:17944:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788271945.956751:0:17944:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1788271945.956754:0:17944:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788271945.956797:0:17944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7c00/0x99288105fd38f946 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271945.956805:0:17944:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7c00/0x99288105fd38f946 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271945.956817:0:17944:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7c00/0x99288105fd38f946 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271945.956845:0:17944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590185600:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788271945.956921:0:17944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271945.956966:0:17944:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb3f2f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271945.957112:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590185600 00000100:00100000:1.0:1788271945.957121:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590185600 00000100:00100000:1.0:1788271945.957173:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788271945.957184:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e8528c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+14:17944:x1875138590185600:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788271945.957200:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271945.957214:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4ed4c00/0x99288105fd38f94d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38f946 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271945.957241:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4ed4c00/0x99288105fd38f94d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38f946 expref: 15 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271945.957253:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4ed4c00/0x99288105fd38f94d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38f946 expref: 15 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271945.957262:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4ed4c00, rc 0) 00000100:00100000:1.0:1788271945.957314:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e8528c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+15:17944:x1875138590185600:12345-0@lo:101:mount.lustre.0 Request processed in 131us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271945.957321:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788271945.957522:0:17944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590185600:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788271945.957536:0:17944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7c00/0x99288105fd38f946 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f94d expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271945.957545:0:17944:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7c00/0x99288105fd38f946 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38f94d expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788271945.959068:0:17944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:2.0:1788271945.959798:0:17944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788271945.963937:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788271945.963997:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1788271945.964014:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1788271945.964028:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1788271945.964043:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:1.0:1788271945.964066:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:1.0:1788271945.964078:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:1.0:1788271945.964099:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1788271945.964115:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1788271945.964128:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:1.0:1788271945.964142:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:1.0:1788271945.964158:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:1.0:1788271945.964171:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:1.0:1788271945.964182:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1788271945.964196:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1788271945.964210:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:1.0:1788271945.964224:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1788271945.964238:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1788271945.964251:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:1.0:1788271945.964264:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1788271945.964277:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1788271945.964291:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1788271945.964305:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1788271945.964334:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:1.0:1788271945.964502:0:17944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:1.0:1788271945.964797:0:17944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83391180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590185728:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788271945.964870:0:17944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271945.964951:0:17944:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e852266c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271945.965000:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590185728 00000100:00100000:0.0:1788271945.965008:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590185728 00000100:00100000:0.0:1788271945.965107:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788271945.965117:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e851a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+15:17944:x1875138590185728:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788271945.965312:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e851a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+15:17944:x1875138590185728:12345-0@lo:501:mount.lustre.0 Request processed in 196us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271945.965320:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788271945.965470:0:17944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83391180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590185728:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788271945.965509:0:17944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590185856:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788271945.965554:0:17944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271945.965616:0:17944:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb3f2f000 going to sleep for 11 seconds 00000100:00100000:0.0:1788271945.965793:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590185856 00000100:00100000:0.0:1788271945.965799:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590185856 00000100:00100000:0.0:1788271945.965834:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788271945.965842:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e851a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+15:17944:x1875138590185856:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788271945.966518:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e851a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+15:17944:x1875138590185856:12345-0@lo:503:mount.lustre.0 Request processed in 676us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271945.966527:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788271945.966617:0:17944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590185856:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788271945.967158:0:17944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788271945.967243:0:17944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590185984:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788271945.967290:0:17944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271945.967439:0:17944:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb3f2f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271945.967506:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590185984 00000100:00100000:3.0:1788271945.967512:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590185984 00000100:00100000:3.0:1788271945.967554:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788271945.967562:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e851a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+15:17944:x1875138590185984:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788271945.968412:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e851a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+15:17944:x1875138590185984:12345-0@lo:502:mount.lustre.0 Request processed in 846us (1118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271945.968422:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788271945.968573:0:17944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590185984:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788271945.969074:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788271945.969122:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1788271945.969139:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1788271945.969152:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1788271945.969166:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1788271945.969180:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1788271945.969195:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1788271945.969208:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1788271945.969223:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1788271945.969237:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1788271945.969251:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1788271945.969262:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1788271945.969275:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1788271945.969289:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1788271945.969304:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1788271945.969318:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1788271945.969332:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1788271945.969428:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1788271945.969446:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1788271945.969464:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1788271945.969479:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1788271945.969495:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1788271945.969511:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1788271945.969528:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1788271945.969542:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1788271945.969557:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1788271945.969571:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1788271945.969586:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1788271945.969603:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:2.0:1788271945.969963:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:2.0:1788271945.969992:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:2.0:1788271945.970016:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:2.0:1788271945.970032:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:2.0:1788271945.970045:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:2.0:1788271945.970059:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:2.0:1788271945.970071:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:2.0:1788271945.970085:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:2.0:1788271945.970111:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:2.0:1788271945.970125:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:2.0:1788271945.970138:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:2.0:1788271945.970152:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:2.0:1788271945.970178:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:2.0:1788271945.970194:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:2.0:1788271945.970223:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:2.0:1788271945.970266:0:17944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590186112:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788271945.970329:0:17944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271945.970485:0:17944:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb3f2f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271945.970528:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590186112 00000100:00100000:1.0:1788271945.970536:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590186112 00000100:00100000:1.0:1788271945.970651:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788271945.970660:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e851a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+15:17944:x1875138590186112:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788271945.970790:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e851a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+15:17944:x1875138590186112:12345-0@lo:502:mount.lustre.0 Request processed in 131us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271945.970798:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788271945.970911:0:17944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590186112:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788271945.970957:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:2.0:1788271945.970965:0:17944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1788271945.971833:0:17948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788271945.971845:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271945.971847:0:17948:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788271945.971853:0:17948:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1788271945.971856:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788271945.971870:0:17948:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8f6eb0cf8000) 00000020:00000080:2.0:1788271945.971890:0:17948:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1788271945.971895:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788271945.971963:0:17948:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788271945.971970:0:17948:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x99288105fd38f95b 00000020:00000080:2.0:1788271945.972198:0:17948:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788271945.972203:0:17948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788271945.972207:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271945.972208:0:17948:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788271945.972211:0:17948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788271945.972215:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271945.972216:0:17948:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1788271945.972219:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788271945.972227:0:17948:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8f6eb0cfb370) 00000020:00000080:2.0:1788271945.972237:0:17948:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1788271945.972242:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788271945.972243:0:17948:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1788271945.972253:0:17948:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1788271945.972259:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788271945.972319:0:17948:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f6d82344800 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1788271945.972333:0:17948:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8f6eb3cd4d28) 00000020:00000080:2.0:1788271945.972417:0:17948:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1788271945.972472:0:17948:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788271945.972479:0:17948:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x99288105fd38f970 00000020:00000080:2.0:1788271945.972571:0:17948:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1788271945.972578:0:17948:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788271945.972583:0:17948:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x99288105fd38f977 00080000:01000000:2.0:1788271945.972588:0:17948:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788271945.972592:0:17948:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x99288105fd38f97e 00010000:00010000:1.0:1788271946.022238:0:17948:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1788271946.022855:0:17948:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:1.0:1788271946.023119:0:17948:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788271946.025031:0:17948:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788271946.025044:0:17948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788271946.025051:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271946.025053:0:17948:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788271946.025057:0:17948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788271946.025062:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271946.025064:0:17948:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788271946.025067:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788271946.025072:0:17948:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.103@tcp to nid 0x20000c0a8c967 (192.168.201.103@tcp) 00000020:00000080:1.0:1788271946.025109:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788271946.025125:0:17948:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8f6eb4e919b8) 00000020:00000080:1.0:1788271946.025145:0:17948:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1788271946.025150:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788271946.025232:0:17948:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1788271946.025239:0:17948:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788271946.025246:0:17948:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x99288105fd38f98c 00010000:00080000:1.0:1788271946.025278:0:17948:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f6e812a9800@lustre-MDT0000-osp-MDT0001: add connection 192.168.201.103@tcp at head 00010000:00010000:1.0:1788271946.026921:0:17948:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1788271946.029928:0:17948:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788271946.029942:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788271946.029984:0:17948:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788271946.030006:0:17948:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x99288105fd38f993 00000100:00080000:1.0:1788271946.030017:0:17948:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788271946.030023:0:17948:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8f6e812a9800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788271946.030059:0:17948:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d83390700 x1875138590186240/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788271946.030143:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83390700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3605:1875138590186240:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788271946.030212:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788271946.030289:0:17948:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788271946.030326:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788271946.030331:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788271946.030333:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f6e859ce800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788271946.030338:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 504 00000100:00080000:1.0:1788271946.030342:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788271946.030346:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8f6e859ce800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788271946.030360:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d83393480 x1875138590186368/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788271946.030470:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590186240 00000100:00100000:0.0:1788271946.030477:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590186240 00000100:00100000:0.0:1788271946.030508:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788271946.030515:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3605:x1875138590186240:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788271946.030536:0:17217:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 507 last 0 00000020:00000080:0.0:1788271946.030580:0:17217:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x99288105fd38f99a 00000004:00100000:0.0:1788271946.030594:0:17217:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788271946.030600:0:17217:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1788271946.031883:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83393480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3605:1875138590186368:0@lo:38:kworker.0 00000100:00100000:3.0:1788271946.031936:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271946.032043:0:17216:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1788271946.032053:0:17216:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1788271946.033290:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590186368 00000100:00100000:3.0:1788271946.033301:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590186368 00000100:00100000:0.0:1788271946.033448:0:17953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788271946.033456:0:17953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3605:x1875138590186368:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788271946.033544:0:17953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3605:x1875138590186368:12345-0@lo:38:kworker.0 Request processed in 88us (1607us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788271946.033551:0:17953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788271946.033645:0:3605:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788271946.033653:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6e859ce800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788271946.033658:0:3605:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788271946.033662:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83393480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3605:1875138590186368:0@lo:38:kworker.0 00000020:01000000:0.0:1788271946.033787:0:17948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788271946.033793:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271946.033795:0:17948:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1788271946.033799:0:17948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788271946.033802:0:17948:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788271946.033804:0:17948:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788271946.033805:0:17948:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788271946.033807:0:17948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788271946.033810:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271946.033811:0:17948:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788271946.033813:0:17948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788271946.033825:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271946.033827:0:17948:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1788271946.033832:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788271946.033876:0:17948:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788271946.033893:0:17948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788271946.033896:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271946.033897:0:17948:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1788271946.033900:0:17948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788271946.033902:0:17948:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1788271946.033903:0:17948:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788271946.033904:0:17948:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788271946.033906:0:17948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788271946.033908:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271946.033909:0:17948:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788271946.033912:0:17948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788271946.033915:0:17948:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788271946.033918:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271946.033920:0:17948:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788271946.033923:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788271946.033926:0:17948:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.103@tcp to nid 0x20000c0a8c967 (192.168.201.103@tcp) 00000020:01000000:0.0:1788271946.033951:0:17948:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788271946.033953:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788271946.033966:0:17948:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8f6d82f08000) 00000020:00000080:0.0:1788271946.033983:0:17948:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788271946.033987:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788271946.034065:0:17948:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1788271946.034071:0:17948:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788271946.034078:0:17948:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x99288105fd38f9a8 00010000:00080000:0.0:1788271946.034114:0:17948:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f6eb0cec000@lustre-OST0000-osc-MDT0001: add connection 192.168.201.103@tcp at head 00010000:00010000:0.0:1788271946.034323:0:17948:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:0.0:1788271946.035261:0:17948:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788271946.035534:0:17948:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:0.0:1788271946.036257:0:17217:0:(import.c:65:import_set_state_nolock()) ffff8f6eb0cec800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788271946.036418:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3605:x1875138590186240:12345-0@lo:38:llog_process_th.0 Request processed in 5901us (6204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271946.036427:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788271946.036742:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788271946.036747:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788271946.036749:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788271946.036751:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788271946.036800:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83393480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875138590186496:0@lo:400:kworker.0 00000100:00100000:1.0:1788271946.036837:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271946.036875:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590186496 00000100:00100000:1.0:1788271946.036882:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590186496 00000100:00100000:1.0:1788271946.036919:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788271946.036926:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83391180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875138590186496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271946.036962:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83391180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875138590186496:12345-0@lo:400:kworker.0 Request processed in 36us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271946.036968:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788271946.037005:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f6d83393480 x1875138590186496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271946.037019:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83393480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875138590186496:0@lo:400:kworker.0 00000100:00100000:3.0:1788271946.037188:0:3605:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788271946.037197:0:3605:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788271946.037206:0:3605:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788271946.037211:0:3605:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788271946.037214:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6e812a9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788271946.037236:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83390700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3605:1875138590186240:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788271946.037333:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788271946.037351:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83393480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590186624:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788271946.037386:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271946.037458:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590186624 00000100:00100000:3.0:1788271946.037463:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590186624 00000100:00100000:3.0:1788271946.037500:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788271946.037508:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83391c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3608:x1875138590186624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788271946.037533:0:17216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788271946.037572:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83391c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3608:x1875138590186624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271946.037578:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788271946.037603:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83393480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590186624:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1788271946.040569:0:17948:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788271946.041085:0:17948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788271946.041240:0:17948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:2.0:1788271946.042523:0:17954:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788271946.042528:0:17954:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788271946.043416:0:17948:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788271946.043430:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788271946.043479:0:17948:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788271946.043504:0:17948:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x99288105fd38f9af 00000100:00080000:1.0:1788271946.043515:0:17948:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788271946.043521:0:17948:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8f6eb0cec000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788271946.043557:0:17948:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d83392300 x1875138590186752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788271946.043590:0:17948:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1788271946.043716:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83392300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3605:1875138590186752:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788271946.043773:0:3605:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875138590186752 offset 0 length 520: 4 00000020:01000000:1.0:1788271946.043994:0:17948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788271946.043999:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271946.044002:0:17948:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788271946.044005:0:17948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788271946.044008:0:17948:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1788271946.044009:0:17948:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788271946.044011:0:17948:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788271946.044013:0:17948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788271946.044015:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271946.044016:0:17948:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788271946.044019:0:17948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788271946.044023:0:17948:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788271946.044026:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271946.044029:0:17948:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788271946.044031:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788271946.044044:0:17948:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.103@tcp to nid 0x20000c0a8c967 (192.168.201.103@tcp) 00000020:01000000:1.0:1788271946.044065:0:17948:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788271946.044067:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788271946.044080:0:17948:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8f6eb4e93370) 00000020:00000080:1.0:1788271946.044103:0:17948:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1788271946.044109:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788271946.044187:0:17948:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788271946.044196:0:17948:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788271946.044202:0:17948:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x99288105fd38f9bd 00010000:00080000:1.0:1788271946.044234:0:17948:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f6e812ab000@lustre-OST0001-osc-MDT0001: add connection 192.168.201.103@tcp at head 00010000:00010000:1.0:1788271946.044432:0:17948:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1788271946.044507:0:17948:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788271946.044523:0:17948:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788271946.047184:0:17948:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788271946.047441:0:17948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788271946.047586:0:17948:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000100:00080000:2.0:1788271946.048039:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788271946.048045:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788271946.048047:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788271946.048050:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1788271946.048273:0:17956:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788271946.048278:0:17956:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788271946.049200:0:17948:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788271946.049213:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788271946.049253:0:17948:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788271946.049275:0:17948:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x99288105fd38f9c4 00000100:00080000:1.0:1788271946.049288:0:17948:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788271946.049294:0:17948:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f6e812ab000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788271946.049327:0:17948:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d83393b80 x1875138590186880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788271946.049468:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83393b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3605:1875138590186880:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788271946.049527:0:3605:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875138590186880 offset 0 length 520: 4 00000100:00080000:1.0:1788271946.049592:0:17948:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788271946.049692:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788271946.049706:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788271946.049709:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788271946.049712:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1788271946.049851:0:17948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788271946.049856:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271946.049859:0:17948:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788271946.049862:0:17948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788271946.049866:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271946.049873:0:17948:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788271946.049878:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788271946.049880:0:17948:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788271946.049883:0:17948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788271946.049885:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271946.049886:0:17948:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788271946.049888:0:17948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788271946.049891:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271946.049892:0:17948:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788271946.049896:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788271946.049924:0:17948:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788271946.049926:0:17948:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271946.049927:0:17948:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788271946.049930:0:17948:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:2.0:1788271946.050254:0:17944:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1788271946.050285:0:17944:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788271946.050308:0:17944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7c00/0x99288105fd38f946 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f94d expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271946.050328:0:17944:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7c00/0x99288105fd38f946 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f94d expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271946.050348:0:17944:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f6d82344800 from 1 10000000:01000000:2.0:1788271946.050352:0:17944:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788271946.050381:0:17944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6e00/0x99288105fd38f9cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271946.050388:0:17944:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6e00/0x99288105fd38f9cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271946.050398:0:17944:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6e00/0x99288105fd38f9cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271946.050414:0:17944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590187008:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788271946.050461:0:17944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271946.050492:0:17944:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d88240 going to sleep for 11 seconds 00000100:00100000:1.0:1788271946.050581:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590187008 00000100:00100000:1.0:1788271946.050588:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590187008 00000100:00100000:1.0:1788271946.050660:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788271946.050669:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e851a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+15:17944:x1875138590187008:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788271946.050682:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271946.050694:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4ed5400/0x99288105fd38f9d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38f9cb expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271946.050723:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4ed5400/0x99288105fd38f9d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38f9cb expref: 16 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271946.050732:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4ed5400/0x99288105fd38f9d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38f9cb expref: 16 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271946.050740:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4ed5400, rc 0) 00000100:00100000:1.0:1788271946.050787:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e851a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+16:17944:x1875138590187008:12345-0@lo:101:mount.lustre.0 Request processed in 119us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271946.050794:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788271946.050956:0:17944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590187008:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788271946.050970:0:17944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6e00/0x99288105fd38f9cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f9d2 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271946.050978:0:17944:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6e00/0x99288105fd38f9cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38f9d2 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271946.051510:0:17944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590187136:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788271946.053578:0:17944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271946.053684:0:17944:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9828ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1788271946.053946:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590187136 00000100:00100000:1.0:1788271946.053957:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590187136 00000100:00100000:1.0:1788271946.054042:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788271946.054054:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+16:17944:x1875138590187136:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788271946.054079:0:17205:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788271946.054119:0:17205:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788271946.054122:0:17205:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788271946.054232:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+16:17944:x1875138590187136:12345-0@lo:256:mount.lustre.0 Request processed in 180us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271946.054240:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788271946.054317:0:17944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590187136:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788271946.055159:0:17944:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788271946.055277:0:17944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6e00/0x99288105fd38f9cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f9d2 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271946.055288:0:17944:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6e00/0x99288105fd38f9cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f9d2 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271946.055297:0:17944:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f6d82344800 from 1 10000000:01000000:3.0:1788271946.055299:0:17944:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788271946.055333:0:17944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4400/0x99288105fd38f9d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271946.055352:0:17944:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4400/0x99288105fd38f9d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271946.055364:0:17944:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4400/0x99288105fd38f9d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271946.055396:0:17944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590187264:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788271946.055438:0:17944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271946.055473:0:17944:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9828ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788271946.055531:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590187264 00000100:00100000:0.0:1788271946.055538:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590187264 00000100:00100000:0.0:1788271946.055575:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788271946.055583:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+16:17944:x1875138590187264:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788271946.055591:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271946.055601:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6e8511c200/0x99288105fd38f9e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38f9d9 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271946.055639:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6e8511c200/0x99288105fd38f9e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38f9d9 expref: 17 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271946.055647:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6e8511c200/0x99288105fd38f9e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38f9d9 expref: 17 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271946.055653:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e8511c200, rc 0) 00000100:00100000:0.0:1788271946.055677:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+17:17944:x1875138590187264:12345-0@lo:101:mount.lustre.0 Request processed in 96us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271946.055681:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788271946.055830:0:17944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590187264:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788271946.055839:0:17944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4400/0x99288105fd38f9d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f9e0 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271946.055845:0:17944:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4400/0x99288105fd38f9d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38f9e0 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788271946.055941:0:17944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788271946.055973:0:17944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590187392:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788271946.055995:0:17944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271946.056022:0:17944:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9828eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788271946.056066:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590187392 00000100:00100000:0.0:1788271946.056070:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590187392 00000100:00100000:0.0:1788271946.056103:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788271946.056118:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+17:17944:x1875138590187392:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788271946.056204:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+17:17944:x1875138590187392:12345-0@lo:501:mount.lustre.0 Request processed in 95us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271946.056217:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788271946.056288:0:17944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590187392:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788271946.056313:0:17944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590187520:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788271946.056359:0:17944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271946.056378:0:17944:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9828eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788271946.056472:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590187520 00000100:00100000:0.0:1788271946.056476:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590187520 00000100:00100000:0.0:1788271946.056499:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788271946.056505:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+17:17944:x1875138590187520:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788271946.056583:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+17:17944:x1875138590187520:12345-0@lo:503:mount.lustre.0 Request processed in 77us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271946.056589:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788271946.056686:0:17944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590187520:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788271946.057083:0:17944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788271946.057159:0:17944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590187648:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788271946.057201:0:17944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271946.057268:0:17944:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9828ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1788271946.057721:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590187648 00000100:00100000:1.0:1788271946.057727:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590187648 00000100:00100000:1.0:1788271946.057763:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788271946.057772:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+17:17944:x1875138590187648:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788271946.057867:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+17:17944:x1875138590187648:12345-0@lo:502:mount.lustre.0 Request processed in 95us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271946.057874:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788271946.058327:0:17944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590187648:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788271946.058537:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788271946.058567:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:3.0:1788271946.058582:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:3.0:1788271946.058594:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:3.0:1788271946.058605:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:3.0:1788271946.058662:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:3.0:1788271946.058691:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:3.0:1788271946.058773:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:3.0:1788271946.058788:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788271946.058802:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:3.0:1788271946.058813:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:3.0:1788271946.058838:0:17944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590187776:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788271946.058883:0:17944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271946.058913:0:17944:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9828ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1788271946.059373:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590187776 00000100:00100000:1.0:1788271946.059379:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590187776 00000100:00100000:1.0:1788271946.059418:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788271946.059427:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+17:17944:x1875138590187776:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788271946.059530:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+17:17944:x1875138590187776:12345-0@lo:502:mount.lustre.0 Request processed in 104us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271946.059537:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788271946.059745:0:17944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590187776:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788271946.059799:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:3.0:1788271946.059808:0:17944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788271946.060540:0:17958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788271946.060550:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271946.060553:0:17958:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788271946.060559:0:17958:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f6d82344800 00000020:00000080:2.0:1788271946.060561:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788271946.060569:0:17958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788271946.060571:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271946.060573:0:17958:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788271946.060575:0:17958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788271946.060578:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788271946.060579:0:17958:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788271946.060582:0:17958:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f6d82344800 00000020:00000080:2.0:1788271946.060584:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788271946.060846:0:17958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788271946.060892:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271946.060894:0:17958:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788271946.060899:0:17958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788271946.060902:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271946.060903:0:17958:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788271946.060907:0:17958:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f6d82344800 00000020:00000080:3.0:1788271946.060909:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788271946.060933:0:17958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788271946.060935:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271946.060936:0:17958:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788271946.060939:0:17958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788271946.060941:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271946.060942:0:17958:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788271946.060952:0:17958:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f6d82344800 00000020:00000080:3.0:1788271946.060954:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788271946.060976:0:17958:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788271946.060979:0:17958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271946.060980:0:17958:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788271946.060982:0:17958:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:2.0:1788271946.061114:0:17944:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788271946.061138:0:17944:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788271946.061161:0:17944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4400/0x99288105fd38f9d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f9e0 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271946.061171:0:17944:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4400/0x99288105fd38f9d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f9e0 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271946.061219:0:17944:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788271946.061222:0:17944:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f6d82344800 10000000:01000000:2.0:1788271946.061225:0:17944:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f6d82344800 10000000:01000000:2.0:1788271946.061229:0:17944:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788271946.061234:0:17944:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f6d82344800 from 1 10000000:01000000:2.0:1788271946.061236:0:17944:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788271946.061266:0:17944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7400/0x99288105fd38f9e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271946.061274:0:17944:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7400/0x99288105fd38f9e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271946.061284:0:17944:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7400/0x99288105fd38f9e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271946.061302:0:17944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590187904:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788271946.061367:0:17944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271946.061406:0:17944:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d88d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788271946.061460:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590187904 00000100:00100000:1.0:1788271946.061467:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590187904 00000100:00100000:1.0:1788271946.061504:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788271946.061513:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+17:17944:x1875138590187904:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788271946.061531:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271946.061543:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4ed5a00/0x99288105fd38f9ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38f9e7 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271946.061563:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4ed5a00/0x99288105fd38f9ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38f9e7 expref: 18 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271946.061572:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4ed5a00/0x99288105fd38f9ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38f9e7 expref: 18 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271946.061581:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4ed5a00, rc 0) 00000100:00100000:1.0:1788271946.061650:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+18:17944:x1875138590187904:12345-0@lo:101:mount.lustre.0 Request processed in 137us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271946.061657:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788271946.061920:0:17944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590187904:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788271946.061935:0:17944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7400/0x99288105fd38f9e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f9ee expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271946.061955:0:17944:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7400/0x99288105fd38f9e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38f9ee expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788271946.065283:0:17944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788271946.065656:0:17944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788271946.065939:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788271946.065964:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:3.0:1788271946.065977:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:3.0:1788271946.065992:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:3.0:1788271946.066006:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:3.0:1788271946.066019:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:3.0:1788271946.066031:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:3.0:1788271946.066045:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:3.0:1788271946.066056:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:3.0:1788271946.066069:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:3.0:1788271946.066080:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:3.0:1788271946.066123:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:3.0:1788271946.066137:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:3.0:1788271946.066150:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:3.0:1788271946.066163:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:3.0:1788271946.066192:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:3.0:1788271946.066209:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:3.0:1788271946.066224:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:3.0:1788271946.066236:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:3.0:1788271946.066248:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:3.0:1788271946.066262:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:3.0:1788271946.066273:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:3.0:1788271946.066284:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:3.0:1788271946.066296:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:3.0:1788271946.066308:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:3.0:1788271946.066329:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:3.0:1788271946.066341:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:3.0:1788271946.066353:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:3.0:1788271946.066370:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:3.0:1788271946.066374:0:17944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788271946.066464:0:17944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590188032:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788271946.066528:0:17944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271946.066574:0:17944:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9828ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788271946.066676:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590188032 00000100:00100000:2.0:1788271946.066684:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590188032 00000100:00100000:2.0:1788271946.066743:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788271946.066753:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+18:17944:x1875138590188032:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788271946.066879:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+18:17944:x1875138590188032:12345-0@lo:501:mount.lustre.0 Request processed in 127us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271946.066887:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788271946.067453:0:17944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590188032:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788271946.067490:0:17944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590188160:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788271946.067530:0:17944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271946.067557:0:17944:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9828ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788271946.067792:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590188160 00000100:00100000:2.0:1788271946.067797:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590188160 00000100:00100000:2.0:1788271946.067831:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788271946.067839:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+18:17944:x1875138590188160:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788271946.067926:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+18:17944:x1875138590188160:12345-0@lo:503:mount.lustre.0 Request processed in 87us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271946.067934:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788271946.068829:0:17944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590188160:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788271946.070828:0:17944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788271946.070927:0:17944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590188288:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788271946.070993:0:17944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271946.071040:0:17944:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9828ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788271946.071154:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590188288 00000100:00100000:2.0:1788271946.071161:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590188288 00000100:00100000:2.0:1788271946.071217:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788271946.071230:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+18:17944:x1875138590188288:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788271946.071354:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+18:17944:x1875138590188288:12345-0@lo:502:mount.lustre.0 Request processed in 126us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271946.071362:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788271946.073470:0:17944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590188288:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788271946.073743:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788271946.073776:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:3.0:1788271946.073790:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:3.0:1788271946.073802:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:3.0:1788271946.073813:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:3.0:1788271946.073824:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:3.0:1788271946.073837:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:3.0:1788271946.073850:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:3.0:1788271946.074079:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:3.0:1788271946.074117:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:3.0:1788271946.074132:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:3.0:1788271946.074146:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:3.0:1788271946.074158:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:3.0:1788271946.074171:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:3.0:1788271946.074185:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:3.0:1788271946.074200:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:3.0:1788271946.074400:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:3.0:1788271946.074417:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:3.0:1788271946.074430:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:3.0:1788271946.074442:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:3.0:1788271946.074455:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:3.0:1788271946.074468:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:3.0:1788271946.074482:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:3.0:1788271946.074496:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:3.0:1788271946.074510:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:3.0:1788271946.074524:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:3.0:1788271946.074537:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:3.0:1788271946.074551:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:3.0:1788271946.074565:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:3.0:1788271946.074580:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:3.0:1788271946.074594:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:3.0:1788271946.074610:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:3.0:1788271946.074657:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:3.0:1788271946.074675:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:3.0:1788271946.074690:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:3.0:1788271946.075338:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:3.0:1788271946.075353:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:3.0:1788271946.075364:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:3.0:1788271946.075378:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:3.0:1788271946.075391:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:3.0:1788271946.075403:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:3.0:1788271946.075417:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:3.0:1788271946.075441:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:3.0:1788271946.075455:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:3.0:1788271946.075470:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:3.0:1788271946.075483:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:3.0:1788271946.075496:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:3.0:1788271946.075509:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:3.0:1788271946.075573:0:17944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590188416:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788271946.075671:0:17944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271946.075851:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590188416 00000100:00100000:1.0:1788271946.075859:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590188416 00000100:00100000:1.0:1788271946.075906:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788271946.075915:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83260450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+18:17944:x1875138590188416:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788271946.076481:0:17944:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9828ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1788271946.090559:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83260450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+18:17944:x1875138590188416:12345-0@lo:502:mount.lustre.0 Request processed in 14634us (14877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271946.090575:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788271946.092438:0:17944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590188416:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788271946.092839:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1788271946.092870:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1788271946.092912:0:17944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590188544:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788271946.092985:0:17944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271946.093023:0:17944:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb3e87a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788271946.093046:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590188544 00000100:00100000:3.0:1788271946.093052:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590188544 00000100:00100000:3.0:1788271946.093109:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788271946.093118:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83262850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+18:17944:x1875138590188544:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788271946.093303:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83262850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+18:17944:x1875138590188544:12345-0@lo:502:mount.lustre.0 Request processed in 184us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271946.093311:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788271946.093364:0:17944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590188544:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788271946.093401:0:17944:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:3.0:1788271946.093409:0:17944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788271946.097359:0:17962:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1788271946.097380:0:17962:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8f6e85beb370) 00000020:00000080:0.0:1788271946.097406:0:17962:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1788271946.097498:0:17962:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f6d82344800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788271946.097503:0:17962:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f6d82344800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788271946.097506:0:17962:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f6d82344800 3 00010000:00080000:0.0:1788271946.097536:0:17962:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f6e91513000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.201.103@tcp at head 00010000:00010000:0.0:1788271946.099082:0:17962:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1788271946.101424:0:17962:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1788271946.101472:0:17962:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788271946.101489:0:17962:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x99288105fd38f9fc 00000100:00080000:3.0:1788271946.101512:0:17962:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788271946.101519:0:17962:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8f6e91513000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788271946.101553:0:17962:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d83253480 x1875138590188672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788271946.101586:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3605:1875138590188672:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788271946.101663:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271946.101724:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590188672 00000100:00100000:3.0:1788271946.101731:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590188672 00000100:00100000:3.0:1788271946.101759:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788271946.101767:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3605:x1875138590188672:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788271946.101788:0:17213:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 507 last 0 00000020:00000080:3.0:1788271946.101832:0:17213:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x99288105fd38fa03 00000004:00100000:3.0:1788271946.101846:0:17213:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788271946.101874:0:17213:0:(import.c:65:import_set_state_nolock()) ffff8f6d81dc2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788271946.101922:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83251880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3605:x1875138590188672:12345-0@lo:38:llog_process_th.0 Request processed in 154us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271946.101930:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788271946.101964:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f6d83253480 x1875138590188672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788271956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271946.101974:0:3605:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788271946.101981:0:3605:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788271946.101987:0:3605:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788271946.101990:0:3605:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788271946.101993:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6e91513000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788271946.101998:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3605:1875138590188672:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788271946.102021:0:17962:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788271946.104373:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788271946.104390:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788271946.104393:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788271946.104396:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1788271946.104700:0:17962:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:3.0:1788271946.104774:0:17944:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788271946.104803:0:17944:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788271946.108158:0:17944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7400/0x99288105fd38f9e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f9ee expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271946.108177:0:17944:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7400/0x99288105fd38f9e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f9ee expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788271946.108251:0:17944:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788271946.108253:0:17944:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788271946.108255:0:17944:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788271946.108256:0:17944:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788271946.108258:0:17944:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788271946.108259:0:17944:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788271946.108261:0:17944:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788271946.108263:0:17944:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788271946.108264:0:17944:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788271946.108268:0:17944:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1788271946.108270:0:17944:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788271946.108271:0:17944:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788271946.108272:0:17944:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788271946.108273:0:17944:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788271946.108274:0:17944:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788271946.108275:0:17944:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788271946.108276:0:17944:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788271946.108277:0:17944:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788271946.108278:0:17944:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788271946.108308:0:17944:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788271946.108330:0:17944:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590188800:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788271946.108396:0:17944:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271946.108440:0:17944:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb3e87a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788271946.108964:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590188800 00000100:00100000:1.0:1788271946.108972:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590188800 00000100:00100000:1.0:1788271946.109337:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788271946.109413:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83260050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+18:17944:x1875138590188800:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788271946.109444:0:17204:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788271946.109458:0:17204:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1788271946.118695:0:17191:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1788271946.118734:0:17204:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788271946.118746:0:17204:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788271946.118763:0:17227:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788271946.118768:0:17227:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788271946.118791:0:17227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f6eb4ed4400/0x99288105fd38fa0a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271946.118810:0:17227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6eb4ed4a00/0x99288105fd38f90e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38f907 expref: 18 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271946.118817:0:17227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6eb4ed5400/0x99288105fd38f9d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38f9cb expref: 18 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271946.118825:0:17227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f6eb4ed4400/0x99288105fd38fa0a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271946.118862:0:17227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6eb4ed5400/0x99288105fd38f9d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38f9cb expref: 18 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271946.118880:0:17227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f6eb4ed5400/0x99288105fd38f9d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38f9cb expref: 18 pid: 17204 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271946.118894:0:17227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83391f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1875138590188928:0@lo:104: 00000100:00100000:1.0:1788271946.118960:0:17227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788271946.119007:0:17227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6eb4ed4a00/0x99288105fd38f90e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38f907 expref: 18 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271946.119016:0:17227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f6eb4ed4a00/0x99288105fd38f90e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38f907 expref: 18 pid: 17205 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271946.119024:0:17227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83391880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1875138590189056:0@lo:104: 00000100:00100000:1.0:1788271946.119055:0:17227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271946.119071:0:17227:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb3ded480 going to sleep for 11 seconds 00000100:00100000:1.0:1788271946.119104:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590188928 00000100:00100000:1.0:1788271946.119112:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590188928 00000100:00100000:1.0:1788271946.119147:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590189056 00000100:00100000:1.0:1788271946.119150:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590189056 00000100:00100000:1.0:1788271946.119163:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788271946.119170:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83392680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+4:17227:x1875138590188928:12345-0@lo:104: 00010000:00010000:1.0:1788271946.119181:0:17194:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6e00/0x99288105fd38f9cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38f9d2 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271946.119228:0:17194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788271946.119235:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83392680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+4:17227:x1875138590188928:12345-0@lo:104: Request processed in 65us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271946.119242:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788271946.119258:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788271946.119266:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83390380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+3:17227:x1875138590189056:12345-0@lo:104: 00010000:00010000:1.0:1788271946.119273:0:17194:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6a00/0x99288105fd38f907 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38f90e expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271946.119303:0:17194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788271946.119308:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83390380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+3:17227:x1875138590189056:12345-0@lo:104: Request processed in 44us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271946.119314:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788271946.119674:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788271946.119686:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6e00/0x99288105fd38f9cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38f9d2 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271946.119694:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f6e00 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:3.0:1788271946.119697:0:17199:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6e00/0x99288105fd38f9cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38f9d2 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271946.119705:0:17199:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6e00/0x99288105fd38f9cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38f9d2 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788271946.119713:0:17199:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6e00/0x99288105fd38f9cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38f9d2 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271946.119718:0:17199:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788271946.119747:0:17199:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6e00/0x99288105fd38f9cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38f9d2 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271946.119755:0:17199:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788271946.119773:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6e00/0x99288105fd38f9cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38f9d2 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271946.119780:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6e00/0x99288105fd38f9cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38f9d2 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271946.119793:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788271946.119796:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6a00/0x99288105fd38f907 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38f90e expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271946.119801:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f6a00 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:3.0:1788271946.119804:0:17199:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6a00/0x99288105fd38f907 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38f90e expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271946.119821:0:17199:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6a00/0x99288105fd38f907 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38f90e expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788271946.119827:0:17199:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6a00/0x99288105fd38f907 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38f90e expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271946.119832:0:17199:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788271946.119844:0:17199:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6a00/0x99288105fd38f907 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38f90e expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271946.119849:0:17199:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788271946.119855:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6a00/0x99288105fd38f907 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38f90e expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271946.119860:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6a00/0x99288105fd38f907 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38f90e expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271946.119871:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271946.119873:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271946.119874:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271946.120726:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83250a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3606:1875138590189184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788271946.120779:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271946.120831:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788271946.120837:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83251c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3606:1875138590189312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788271946.120841:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590189184 00000100:00100000:0.0:1788271946.120846:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590189184 00000100:00100000:3.0:1788271946.120857:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788271946.120875:0:17197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6eb4ed5400/0x99288105fd38f9d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38f9cb expref: 19 pid: 17204 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271946.120903:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590189312 00000100:00100000:0.0:1788271946.120907:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590189312 00010000:00010000:0.0:1788271946.120918:0:17197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6eb4ed4a00/0x99288105fd38f90e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38f907 expref: 20 pid: 17205 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271946.120942:0:17227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83391f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1875138590188928:0@lo:104: 00000100:00100000:1.0:1788271946.120956:0:17227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83391880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1875138590189056:0@lo:104: 00010000:00010000:1.0:1788271946.120976:0:17227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f6eb4ed4400/0x99288105fd38fa0a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271946.121065:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788271946.121074:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83252300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+20:3606:x1875138590189184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788271946.121085:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271946.121104:0:17196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6eb4ed5400/0x99288105fd38f9d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38f9cb expref: 20 pid: 17204 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271946.121115:0:17196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6eb4ed5400/0x99288105fd38f9d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38f9cb expref: 20 pid: 17204 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271946.121130:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4ed5400/0x99288105fd38f9d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38f9cb expref: 20 pid: 17204 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271946.121143:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271946.121171:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83252300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+19:3606:x1875138590189184:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271946.121177:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788271946.121192:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788271946.121197:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83251f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+18:3606:x1875138590189312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788271946.121204:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271946.121208:0:17196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6eb4ed4a00/0x99288105fd38f90e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38f907 expref: 18 pid: 17205 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271946.121217:0:17196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6eb4ed4a00/0x99288105fd38f90e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38f907 expref: 18 pid: 17205 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271946.121227:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4ed4a00/0x99288105fd38f90e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38f907 expref: 18 pid: 17205 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271946.121238:0:17196:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f6eb4ed4400/0x99288105fd38fa0a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271946.121246:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4ed4400/0x99288105fd38fa0a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788271946.121268:0:17196:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002501695s 00010000:00010000:3.0:1788271946.121273:0:17196:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f6eb4ed4400/0x99288105fd38fa0a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271946.121279:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f6eb4ed4400/0x99288105fd38fa0a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271946.121286:0:17196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f6eb4ed4400/0x99288105fd38fa0a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271946.121291:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f6eb4ed4400/0x99288105fd38fa0a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271946.121297:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4ed4400 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:3.0:1788271946.121301:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f6eb4ed4400/0x99288105fd38fa0a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271946.121308:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f6eb4ed4400/0x99288105fd38fa0a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271946.121317:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f6eb4ed4400/0x99288105fd38fa0a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271946.121325:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788271946.121413:0:17227:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f6eb4ed4400/0x99288105fd38fa0a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271946.121419:0:17227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f6eb4ed4400/0x99288105fd38fa0a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271946.121425:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4ed4400/0x99288105fd38fa0a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271946.121444:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271946.121853:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83260050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+17:17944:x1875138590188800:12345-0@lo:253:mount.lustre.0 Request processed in 12443us (13455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271946.121862:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788271946.121926:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83251f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+16:3606:x1875138590189312:12345-0@lo:103:ldlm_bl.0 Request processed in 728us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271946.121933:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788271946.121960:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83251c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3606:1875138590189312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788271946.121968:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83250a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3606:1875138590189184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788271946.122084:0:17944:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17944:1875138590188800:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788271946.122108:0:17944:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788271946.122111:0:17944:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788271946.122113:0:17944:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788271946.122114:0:17944:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788271946.122115:0:17944:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788271946.122117:0:17944:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788271946.122118:0:17944:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788271946.122119:0:17944:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788271946.122121:0:17944:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788271946.122123:0:17944:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788271946.122131:0:17944:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:3.0:1788271946.132979:0:17944:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1788271946.133116:0:17969:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788271946.133120:0:17969:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788271946.133330:0:17970:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788271946.133403:0:17944:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:1.0:1788271946.133926:0:17970:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788271946.136445:0:17970:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788271946.136518:0:17970:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:2.0:1788271946.136795:0:17971:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406d500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17971:1875138590189440:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788271946.136865:0:17971:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271946.136903:0:17971:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d88600 going to sleep for 11 seconds 00000100:00100000:1.0:1788271946.137083:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590189440 00000100:00100000:1.0:1788271946.137101:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590189440 00000100:00100000:1.0:1788271946.137180:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788271946.137190:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17971:x1875138590189440:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788271946.137271:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17971:x1875138590189440:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 83us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271946.137279:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:01000000:1.0:1788271946.137584:0:17944:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:0.0:1788271946.137736:0:17971:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406d500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17971:1875138590189440:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1788271946.137765:0:17971:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788271946.137804:0:17971:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d832bce00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17971:1875138590189568:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788271946.137844:0:17971:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271946.137867:0:17971:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4041180 going to sleep for 11 seconds 00000100:00100000:1.0:1788271946.138065:0:17953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590189568 00000100:00100000:1.0:1788271946.138075:0:17953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590189568 00000100:00100000:1.0:1788271946.138145:0:17953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788271946.138152:0:17953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17971:x1875138590189568:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788271946.138253:0:17953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17971:x1875138590189568:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 101us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271946.138260:0:17953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788271946.138319:0:17971:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d832bce00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17971:1875138590189568:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788271946.138366:0:17971:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d832bce00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17971:1875138590189696:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788271946.138396:0:17971:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271946.138418:0:17971:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4041b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788271946.138432:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590189696 00000100:00100000:3.0:1788271946.138436:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590189696 00000100:00100000:3.0:1788271946.138471:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788271946.138478:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17971:x1875138590189696:12345-0@lo:900:lod0001_rec0000.0 00000040:00080000:1.0:1788271946.138518:0:17944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788271946.138591:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17971:x1875138590189696:12345-0@lo:900:lod0001_rec0000.0 Request processed in 113us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271946.138598:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788271946.138667:0:17971:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f6d832bce00 x1875138590189696/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788271962 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271946.138678:0:17971:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d832bce00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17971:1875138590189696:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788271946.138722:0:17971:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d832bce00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17971:1875138590189824:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788271946.138746:0:17971:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271946.138765:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590189824 00000100:00100000:0.0:1788271946.138768:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590189824 00000100:00100000:0.0:1788271946.138791:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788271946.138797:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17971:x1875138590189824:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788271946.138852:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17971:x1875138590189824:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 55us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271946.138858:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788271946.138872:0:17971:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4041180 going to sleep for 11 seconds 00000100:00100000:0.0:1788271946.138882:0:17971:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d832bce00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17971:1875138590189824:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788271946.138912:0:17971:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788271946.141247:0:17971:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788271946.141339:0:17971:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788271946.141344:0:17971:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000004:00000080:1.0:1788271946.142226:0:17944:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788271946.142241:0:17944:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788271946.142337:0:17944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788271946.143502:0:17944:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788271946.145403:0:17944:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788271946.145461:0:17944:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1788271946.145908:0:17944:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788271946.146399:0:17944:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:1.0:1788271946.148639:0:17944:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788271946.166010:0:17944:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788271946.166053:0:17944:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa349c0f67988 00100000:10000000:1.0:1788271946.166061:0:17944:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788271946.166890:0:17944:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788271946.166924:0:17944:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.103@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788271946.166943:0:17944:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788271946.166961:0:17944:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788271946.167795:0:17944:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788271946.168042:0:17944:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788271946.337216:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271946.717983:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc98dc00 going to sleep for 0 seconds 00000040:00080000:2.0:1788271947.166542:0:17972:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788271947.357986:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788271947.425264:0:17208:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788271947.425273:0:17208:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f6d82344800 from 8 10000000:01000000:3.0:1788271947.425290:0:17208:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788271947.425341:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4000/0x99288105fd38fa11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271947.425353:0:17208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4000/0x99288105fd38fa11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271947.425398:0:17208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4000/0x99288105fd38fa11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271947.425426:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590189952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788271947.425500:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271947.425580:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9ab10d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788271947.426234:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590189952 00000100:00100000:2.0:1788271947.426243:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590189952 00000100:00100000:2.0:1788271947.426304:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788271947.426315:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83262050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+16:17208:x1875138590189952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788271947.426330:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271947.426346:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6d833f6c00/0x99288105fd38fa18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38fa11 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271947.426370:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6d833f6c00/0x99288105fd38fa18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38fa11 expref: 17 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271947.426382:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6d833f6c00/0x99288105fd38fa18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38fa11 expref: 17 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271947.426392:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d833f6c00, rc 0) 00000100:00100000:2.0:1788271947.426453:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83262050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+17:17208:x1875138590189952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271947.426460:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788271947.426562:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590189952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788271947.426578:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4000/0x99288105fd38fa11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fa18 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271947.426588:0:17208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4000/0x99288105fd38fa11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38fa18 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271947.426690:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d832bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590190080:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788271947.426736:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271947.426757:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e82b8b180 going to sleep for 11 seconds 00000100:00100000:1.0:1788271947.426823:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590190080 00000100:00100000:1.0:1788271947.426827:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590190080 00000100:00100000:1.0:1788271947.426861:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788271947.426868:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83261850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+17:17208:x1875138590190080:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788271947.426901:0:17204:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788271947.426916:0:17204:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788271947.426920:0:17204:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1788271947.427004:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83261850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+17:17208:x1875138590190080:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 136us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271947.427011:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788271947.427089:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d832bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590190080:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788271947.427132:0:17208:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788271947.427138:0:17208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4000/0x99288105fd38fa11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fa18 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271947.427147:0:17208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4000/0x99288105fd38fa11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fa18 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271947.427158:0:17208:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788271947.427160:0:17208:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f6e851db000 from 8 10000000:01000000:0.0:1788271947.427163:0:17208:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788271947.427178:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d400/0x99288105fd38fa1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271947.427186:0:17208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d400/0x99288105fd38fa1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271947.427194:0:17208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d400/0x99288105fd38fa1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271947.427217:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d832bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590190208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788271947.427241:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271947.427262:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e82b8b180 going to sleep for 11 seconds 00000100:00100000:1.0:1788271947.427311:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590190208 00000100:00100000:1.0:1788271947.427315:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590190208 00000100:00100000:1.0:1788271947.427332:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788271947.427337:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83260c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+17:17208:x1875138590190208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788271947.427345:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271947.427353:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4ed4400/0x99288105fd38fa26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38fa1f expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271947.427367:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4ed4400/0x99288105fd38fa26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38fa1f expref: 18 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271947.427376:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4ed4400/0x99288105fd38fa26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38fa1f expref: 18 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271947.427383:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4ed4400, rc 0) 00000100:00100000:1.0:1788271947.427419:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83260c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+18:17208:x1875138590190208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271947.427425:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788271947.427493:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d832bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590190208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788271947.427504:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d400/0x99288105fd38fa1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fa26 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271947.427513:0:17208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d400/0x99288105fd38fa1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38fa26 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271947.427547:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d832bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590190336:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788271947.427573:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271947.427593:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e82b8b180 going to sleep for 11 seconds 00000100:00100000:1.0:1788271947.427643:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590190336 00000100:00100000:1.0:1788271947.427647:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590190336 00000100:00100000:1.0:1788271947.427663:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788271947.427669:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83263450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+18:17208:x1875138590190336:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788271947.427691:0:17204:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788271947.427699:0:17204:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788271947.427701:0:17204:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1788271947.427775:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83263450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+18:17208:x1875138590190336:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 105us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271947.427781:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788271947.427974:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d832bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590190336:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788271947.428006:0:17208:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788271947.428012:0:17208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d400/0x99288105fd38fa1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fa26 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271947.428020:0:17208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d400/0x99288105fd38fa1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fa26 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271947.744279:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc98dc00 going to sleep for 0 seconds 00000040:00080000:2.0:1788271948.192777:0:17972:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788271948.382336:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271948.770029:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc98dc00 going to sleep for 0 seconds 00010000:00010000:1.0:1788271949.405847:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271949.791465:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc98dc00 going to sleep for 0 seconds 00000001:02000400:1.0:1788271950.368342:0:18215:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg103-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788271950.433908:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271950.814125:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc98dc00 going to sleep for 0 seconds 00000020:00000004:2.0:1788271951.308581:0:18267:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788271951.310839:0:18267:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:1.0:1788271951.390229:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788271951.390236:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788271951.390242:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f6e859ce800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788271951.390255:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8f6e859ce800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788271951.390278:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d83391f80 x1875138590190592/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788271951.390295:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788271951.390299:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788271951.390301:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788271951.390304:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788271951.390330:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788271951.390337:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788271951.390339:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788271951.390342:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788271951.390385:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83391f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3605:1875138590190592:0@lo:38:kworker.0 00000100:00100000:1.0:1788271951.390470:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271951.390544:0:17953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590190592 00000100:00100000:1.0:1788271951.390552:0:17953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590190592 00000100:00100000:1.0:1788271951.390589:0:17953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788271951.390599:0:17953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83391500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3605:x1875138590190592:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788271951.390653:0:17953:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 512 last 0 00000020:00000080:1.0:1788271951.390693:0:17953:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x99288105fd38fa2d 00000004:00100000:1.0:1788271951.390710:0:17953:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788271951.390715:0:17953:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1788271951.390946:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83390000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875138590190720:0@lo:400:kworker.0 00000100:00100000:2.0:1788271951.390986:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271951.391023:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788271951.391028:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83391880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3609:1875138590190464:0@lo:400:kworker.0 00000100:00100000:2.0:1788271951.391064:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271951.391117:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590190464 00000100:00100000:2.0:1788271951.391121:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590190464 00000100:00100000:2.0:1788271951.391160:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788271951.391167:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83261050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+18:3609:x1875138590190464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271951.391220:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83261050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+18:3609:x1875138590190464:12345-0@lo:400:kworker.0 Request processed in 53us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271951.391230:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788271951.391276:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83391880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3609:1875138590190464:0@lo:400:kworker.0 00000100:00100000:1.0:1788271951.391347:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590190720 00000100:00100000:1.0:1788271951.391351:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590190720 00000100:00100000:1.0:1788271951.391391:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788271951.391401:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875138590190720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271951.391446:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875138590190720:12345-0@lo:400:kworker.0 Request processed in 49us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271951.391455:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788271951.391538:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f6d83390000 x1875138590190720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271951.391549:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83390000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875138590190720:0@lo:400:kworker.0 00000100:00100000:3.0:1788271951.392174:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83390e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590190848:0@lo:400:kworker.0 00000100:00100000:3.0:1788271951.392212:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271951.392338:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788271951.392345:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83392d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875138590190976:0@lo:400:kworker.0 00000100:00100000:3.0:1788271951.392369:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271951.393406:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590190976 00000100:00100000:1.0:1788271951.393415:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590190976 00000100:00100000:1.0:1788271951.393457:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788271951.393465:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1875138590190976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271951.393523:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1875138590190976:12345-0@lo:400:kworker.0 Request processed in 58us (1153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271951.393530:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788271951.393576:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f6d83392d80 x1875138590190976/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271951.393600:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83392d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875138590190976:0@lo:400:kworker.0 00000100:00100000:0.0:1788271951.393736:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83390a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590191104:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788271951.393770:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271951.399751:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590190848 00000100:00100000:2.0:1788271951.399765:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590190848 00000100:00100000:2.0:1788271951.399809:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590191104 00000100:00100000:2.0:1788271951.399812:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590191104 00000100:00100000:2.0:1788271951.399829:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788271951.399838:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3606:x1875138590190848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271951.399941:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3606:x1875138590190848:12345-0@lo:400:kworker.0 Request processed in 103us (7727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271951.399955:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788271951.399972:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788271951.399978:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590191104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788271951.400013:0:17216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788271951.400055:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590191104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (6283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271951.400062:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788271951.400154:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83390e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590190848:0@lo:400:kworker.0 00000100:00080000:0.0:1788271951.411188:0:17953:0:(import.c:65:import_set_state_nolock()) ffff8f6e91510800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788271951.411289:0:17953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83391500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3605:x1875138590190592:12345-0@lo:38:kworker.0 Request processed in 20691us (20817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271951.411301:0:17953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788271951.411395:0:3605:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788271951.411405:0:3605:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788271951.411410:0:3605:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788271951.411413:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6e859ce800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1788271951.411466:0:3605:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000d64b1cf4): req@ffff8f6d83252d80 x1875138590183680/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271951.411494:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83391f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3605:1875138590190592:0@lo:38:kworker.0 00000100:00100000:2.0:1788271951.412767:0:17252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271951.412805:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc98dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788271951.412841:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83390a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590191104:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788271951.412866:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590183680 00000100:00100000:2.0:1788271951.412872:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590183680 00000100:00100000:2.0:1788271951.412910:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788271951.412918:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17252:x1875138590183680:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788271951.413004:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17252:x1875138590183680:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 76us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271951.413012:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788271951.413040:0:17252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83252d80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17252:1875138590183680:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1788271951.413072:0:17252:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788271951.413115:0:17252:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406d500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17252:1875138590191232:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788271951.413144:0:17252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271951.413167:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d88000 going to sleep for 11 seconds 00000100:00100000:2.0:1788271951.413179:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590191232 00000100:00100000:2.0:1788271951.413182:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590191232 00000100:00100000:2.0:1788271951.413203:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788271951.413219:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17252:x1875138590191232:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788271951.413309:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17252:x1875138590191232:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 91us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271951.413316:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788271951.413340:0:17252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406d500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17252:1875138590191232:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788271951.413396:0:17252:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406d500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17252:1875138590191360:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788271951.413419:0:17252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271951.413433:0:17252:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d88000 going to sleep for 11 seconds 00000100:00100000:2.0:1788271951.413444:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590191360 00000100:00100000:2.0:1788271951.413447:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590191360 00000100:00100000:2.0:1788271951.413463:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788271951.413469:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17252:x1875138590191360:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788271951.413523:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17252:x1875138590191360:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 54us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271951.413530:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788271951.413552:0:17252:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406d500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17252:1875138590191360:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1788271951.413585:0:17252:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788271951.415693:0:17252:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788271951.415768:0:17252:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 18, retries 0 00000004:00080000:2.0:1788271951.415773:0:17252:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:3.0:1788271951.417278:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d832be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590191488:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788271951.417351:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271951.417440:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590191488 00000100:00100000:0.0:1788271951.417448:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590191488 00000100:00100000:0.0:1788271951.417497:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788271951.417507:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3609:x1875138590191488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788271951.417540:0:17217:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788271951.417585:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3609:x1875138590191488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271951.417593:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788271951.420153:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d832be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590191488:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788271951.458221:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788271952.179161:0:18317:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788271952.179861:0:18317:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788271952.485408:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788271953.005589:0:18365:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffceb8a25e0 20000000:00000080:1.0:1788271953.005609:0:18365:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f6eb54c1800 uarg=0000000000000000 20000000:01000000:1.0:1788271953.005739:0:18365:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788271953.005749:0:18365:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788271953.005753:0:18365:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788271953.009288:0:18366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1788271953.009452:0:18365:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788271953.015885:0:18365:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788271953.016080:0:18365:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f6d830c4c00/0x99288105fd38fa34 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271953.016102:0:18365:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6d833f7600/0x99288105fd38f8dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38f8d6 expref: 17 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271953.016111:0:18365:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6e8511c200/0x99288105fd38f9e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38f9d9 expref: 17 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271953.016118:0:18365:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f6d830c4c00/0x99288105fd38fa34 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271953.016182:0:18365:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6e8511c200/0x99288105fd38f9e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38f9d9 expref: 17 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271953.016197:0:18365:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f6e8511c200/0x99288105fd38f9e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38f9d9 expref: 17 pid: 17206 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271953.016212:0:18365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83252a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18365:1875138590191616:0@lo:104: 00000100:00100000:3.0:1788271953.016501:0:18365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788271953.016574:0:18365:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6d833f7600/0x99288105fd38f8dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38f8d6 expref: 17 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271953.016577:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590191616 00010000:00010000:3.0:1788271953.016583:0:18365:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f6d833f7600/0x99288105fd38f8dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38f8d6 expref: 17 pid: 17206 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271953.016584:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590191616 00000100:00100000:3.0:1788271953.016591:0:18365:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18365:1875138590191744:0@lo:104: 00000100:00100000:3.0:1788271953.016612:0:18365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271953.016665:0:18365:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9ab10240 going to sleep for 11 seconds 00000100:00100000:1.0:1788271953.016676:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590191744 00000100:00100000:1.0:1788271953.016680:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590191744 00000100:00100000:1.0:1788271953.016696:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788271953.016705:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83252d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+4:18365:x1875138590191616:12345-0@lo:104: 00010000:00010000:1.0:1788271953.016719:0:17195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4400/0x99288105fd38f9d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38f9e0 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271953.016832:0:17195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788271953.016840:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83252d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+4:18365:x1875138590191616:12345-0@lo:104: Request processed in 135us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271953.016848:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788271953.016867:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788271953.016875:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83253b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+3:18365:x1875138590191744:12345-0@lo:104: 00010000:00010000:0.0:1788271953.016883:0:17195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5e00/0x99288105fd38f8d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38f8dd expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271953.016891:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271953.016897:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4400/0x99288105fd38f9d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38f9e0 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271953.016904:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4400 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:1.0:1788271953.016907:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4400/0x99288105fd38f9d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38f9e0 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271953.016915:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4400/0x99288105fd38f9d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38f9e0 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271953.016919:0:17195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:1.0:1788271953.016922:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4400/0x99288105fd38f9d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38f9e0 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271953.016923:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83253b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+3:18365:x1875138590191744:12345-0@lo:104: Request processed in 51us (311us total) trans 0 rc 0/0 10000000:01000000:1.0:1788271953.016929:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1788271953.016930:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788271953.016957:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4400/0x99288105fd38f9d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38f9e0 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271953.016963:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788271953.017037:0:18365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83252a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18365:1875138590191616:0@lo:104: 00000100:00100000:3.0:1788271953.017046:0:18365:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18365:1875138590191744:0@lo:104: 00010000:00010000:3.0:1788271953.017065:0:18365:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f6d830c4c00/0x99288105fd38fa34 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271953.017145:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83391f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3606:1875138590191872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788271953.017181:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788271953.017230:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4400/0x99288105fd38f9d9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38f9e0 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271953.017238:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4400/0x99288105fd38f9d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38f9e0 expref: -99 pid: 17944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271953.017294:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271953.017298:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5e00/0x99288105fd38f8d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38f8dd expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271953.017303:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c5e00 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:0.0:1788271953.017306:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5e00/0x99288105fd38f8d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38f8dd expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271953.017312:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5e00/0x99288105fd38f8d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38f8dd expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788271953.017318:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5e00/0x99288105fd38f8d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38f8dd expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271953.017322:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788271953.017349:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5e00/0x99288105fd38f8d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38f8dd expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271953.017355:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788271953.017368:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5e00/0x99288105fd38f8d6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38f8dd expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271953.017375:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5e00/0x99288105fd38f8d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38f8dd expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271953.017387:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271953.017389:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271953.017390:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271953.017398:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d832bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3607:1875138590192000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788271953.017431:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271953.017459:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590191872 00010000:00010000:2.0:1788271953.017462:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271953.017463:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590191872 00010000:00010000:0.0:1788271953.017480:0:17197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6e8511c200/0x99288105fd38f9e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38f9d9 expref: 18 pid: 17206 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271953.017506:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590192000 00000100:00100000:0.0:1788271953.017509:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590192000 00000100:00100000:3.0:1788271953.017510:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788271953.017517:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+19:3606:x1875138590191872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788271953.017520:0:17197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6d833f7600/0x99288105fd38f8dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38f8d6 expref: 19 pid: 17206 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271953.017528:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788271953.017530:0:17197:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:3.0:1788271953.017533:0:17196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6e8511c200/0x99288105fd38f9e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38f9d9 expref: 19 pid: 17206 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271953.017536:0:17197:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1788271953.017553:0:17196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6e8511c200/0x99288105fd38f9e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38f9d9 expref: 19 pid: 17206 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271953.017565:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6e8511c200/0x99288105fd38f9e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38f9d9 expref: 19 pid: 17206 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271953.017575:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271953.017599:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+18:3606:x1875138590191872:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271953.017605:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788271953.017634:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788271953.017641:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+17:3607:x1875138590192000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788271953.017648:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271953.017652:0:17196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6d833f7600/0x99288105fd38f8dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38f8d6 expref: 17 pid: 17206 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271953.017660:0:17196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6d833f7600/0x99288105fd38f8dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38f8d6 expref: 17 pid: 17206 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271953.017670:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6d833f7600/0x99288105fd38f8dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38f8d6 expref: 17 pid: 17206 timeout: 614 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271953.017682:0:17196:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f6d830c4c00/0x99288105fd38fa34 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271953.017690:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6d830c4c00/0x99288105fd38fa34 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271953.017701:0:17196:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f6d830c4c00/0x99288105fd38fa34 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271953.017714:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f6d830c4c00/0x99288105fd38fa34 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271953.017721:0:17196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f6d830c4c00/0x99288105fd38fa34 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271953.017728:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f6d830c4c00/0x99288105fd38fa34 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271953.017734:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4c00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:3.0:1788271953.017738:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f6d830c4c00/0x99288105fd38fa34 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271953.017746:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f6d830c4c00/0x99288105fd38fa34 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271953.017759:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f6d830c4c00/0x99288105fd38fa34 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271953.017767:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271953.017795:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+16:3607:x1875138590192000:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271953.017801:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788271953.017819:0:18365:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f6d830c4c00/0x99288105fd38fa34 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271953.017826:0:18365:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f6d830c4c00/0x99288105fd38fa34 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271953.017832:0:18365:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6d830c4c00/0x99288105fd38fa34 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18365 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271953.018615:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d832bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3607:1875138590192000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788271953.018845:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83391f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3606:1875138590191872:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788271953.502792:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788271954.398114:0:17208:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788271954.398123:0:17208:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f6d82344800 from 13 10000000:01000000:0.0:1788271954.398129:0:17208:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788271954.398173:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d200/0x99288105fd38fa3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271954.398291:0:17208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d200/0x99288105fd38fa3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271954.398306:0:17208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d200/0x99288105fd38fa3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271954.398331:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d832bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590192128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788271954.398395:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271954.398482:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e82b8b180 going to sleep for 11 seconds 00000100:00100000:3.0:1788271954.399364:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590192128 00000100:00100000:3.0:1788271954.399373:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590192128 00000100:00100000:2.0:1788271954.399583:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788271954.399595:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83263850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+16:17208:x1875138590192128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788271954.399651:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271954.399668:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6d833f6000/0x99288105fd38fa42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38fa3b expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271954.399694:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6d833f6000/0x99288105fd38fa42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38fa3b expref: 17 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271954.399706:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6d833f6000/0x99288105fd38fa42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38fa3b expref: 17 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271954.399715:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d833f6000, rc 0) 00000100:00100000:2.0:1788271954.399764:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83263850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+17:17208:x1875138590192128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (1368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271954.399770:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788271954.399866:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d832bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590192128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788271954.399880:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d200/0x99288105fd38fa3b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fa42 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271954.399888:0:17208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d200/0x99288105fd38fa3b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38fa42 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271954.399956:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d832bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590192256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271954.399984:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271954.400166:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e82b8b180 going to sleep for 11 seconds 00000100:00100000:3.0:1788271954.400209:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590192256 00000100:00100000:3.0:1788271954.400213:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590192256 00000100:00100000:3.0:1788271954.400235:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788271954.400243:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+17:17208:x1875138590192256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788271954.400345:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+17:17208:x1875138590192256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271954.400352:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788271954.400369:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d832bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590192256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271954.400398:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83392d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590192384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271954.400890:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271954.400919:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e8a0720c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271954.400932:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590192384 00000100:00100000:1.0:1788271954.400936:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590192384 00000100:00100000:1.0:1788271954.400971:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788271954.400978:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+17:17208:x1875138590192384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271954.401058:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+17:17208:x1875138590192384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271954.401065:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788271954.401150:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83392d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590192384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788271954.402707:0:18435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788271954.402997:0:17208:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788271954.403025:0:17208:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788271954.403035:0:17208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d200/0x99288105fd38fa3b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fa42 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271954.403045:0:17208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d200/0x99288105fd38fa3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fa42 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271954.403056:0:17208:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788271954.403058:0:17208:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f6e851db000 from 13 10000000:01000000:2.0:1788271954.403061:0:17208:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788271954.403090:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6600/0x99288105fd38fa49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271954.403111:0:17208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6600/0x99288105fd38fa49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271954.403123:0:17208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6600/0x99288105fd38fa49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271954.403142:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590192512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788271954.403257:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271954.403316:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d88d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788271954.403407:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590192512 00000100:00100000:3.0:1788271954.403413:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590192512 00000100:00100000:3.0:1788271954.403542:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788271954.403552:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+17:17208:x1875138590192512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788271954.403563:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271954.403575:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6d830c4c00/0x99288105fd38fa50 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38fa49 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271954.403597:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6d830c4c00/0x99288105fd38fa50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38fa49 expref: 18 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271954.403607:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6d830c4c00/0x99288105fd38fa50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38fa49 expref: 18 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271954.403616:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c4c00, rc 0) 00000100:00100000:3.0:1788271954.403697:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+18:17208:x1875138590192512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271954.403714:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788271954.403804:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590192512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788271954.403829:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6600/0x99288105fd38fa49 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fa50 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271954.403844:0:17208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6600/0x99288105fd38fa49 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38fa50 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271954.403895:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d832bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590192640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271954.403920:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271954.404118:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e82b8bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788271954.404141:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590192640 00000100:00100000:2.0:1788271954.404145:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590192640 00000100:00100000:2.0:1788271954.404165:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788271954.404171:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8312a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+18:17208:x1875138590192640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788271954.404274:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8312a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+18:17208:x1875138590192640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271954.404281:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788271954.404415:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d832bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590192640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271954.404440:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d832bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590192768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788271954.406426:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271954.406547:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e82b8bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788271954.406581:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590192768 00000100:00100000:2.0:1788271954.406588:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590192768 00000100:00100000:2.0:1788271954.407757:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788271954.407770:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+18:17208:x1875138590192768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788271954.408673:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+18:17208:x1875138590192768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 905us (2248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271954.408682:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788271954.410140:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d832bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590192768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788271954.411538:0:18436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788271954.411792:0:17208:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788271954.411932:0:17208:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788271954.411952:0:17208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6600/0x99288105fd38fa49 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fa50 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271954.411964:0:17208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6600/0x99288105fd38fa49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fa50 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271954.530019:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271955.549816:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788271955.934780:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788271956.510832:0:3605:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788271946/real 1788271946] req@ffff8f6d83393b80 x1875138590186880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788271956 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271956.510865:0:3605:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f6d83393b80 x1875138590186880/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788271956 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271956.510875:0:3605:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788271946/real 1788271946] req@ffff8f6d83392300 x1875138590186752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788271956 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271956.510887:0:3605:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f6d83392300 x1875138590186752/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788271956 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788271956.510918:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6e812ab000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788271956.510927:0:3605:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788271956.510930:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83393b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3605:1875138590186880:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788271956.510936:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6eb0cec000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788271956.510939:0:3605:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788271956.510942:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83392300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3605:1875138590186752:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788271956.511116:0:17749:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788271956.511120:0:17749:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788271956.511122:0:17749:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788271956.511125:0:17749:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788271956.511142:0:17749:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788271956.511144:0:17749:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788271956.511147:0:17749:0:(import.c:65:import_set_state_nolock()) ffff8f6eb0cec000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788271956.511152:0:17749:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 507 00000100:00080000:2.0:1788271956.511156:0:17749:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788271956.511162:0:17749:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8f6eb0cec000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788271956.511181:0:17749:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d8406dc00 x1875138590193408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788271956.511196:0:17749:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788271956.511198:0:17749:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788271956.511200:0:17749:0:(import.c:65:import_set_state_nolock()) ffff8f6e812ab000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788271956.511202:0:17749:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 507 00000100:00080000:2.0:1788271956.511205:0:17749:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788271956.511207:0:17749:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f6e812ab000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788271956.511217:0:17749:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d8406f800 x1875138590193536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788271956.511244:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3605:1875138590193408:0@lo:8:kworker.0 00000400:00000100:2.0:1788271956.511294:0:3605:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875138590193408 offset 0 length 520: 4 00000100:00100000:2.0:1788271956.511327:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3605:1875138590193536:0@lo:8:kworker.0 00000400:00000100:2.0:1788271956.511362:0:3605:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875138590193536 offset 0 length 520: 4 00000100:00100000:0.0:1788271956.511434:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3608:1875138590192896:0@lo:400:kworker.0 00000100:00100000:0.0:1788271956.511475:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271956.511503:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875138590193664:0@lo:400:kworker.0 00000100:00100000:0.0:1788271956.511527:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271956.511547:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788271956.511552:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590193024:0@lo:400:kworker.0 00000100:00100000:0.0:1788271956.511575:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271956.511601:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875138590193152:0@lo:400:kworker.0 00000100:00100000:0.0:1788271956.511656:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271956.511675:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788271956.511680:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590193280:0@lo:400:kworker.0 00000100:00100000:0.0:1788271956.511699:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271956.511728:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590193664 00000100:00100000:0.0:1788271956.511734:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590193664 00000100:00100000:0.0:1788271956.511774:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590193152 00000100:00100000:0.0:1788271956.511777:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590193152 00000100:00100000:0.0:1788271956.511791:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788271956.511799:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875138590193664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271956.511845:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875138590193664:12345-0@lo:400:kworker.0 Request processed in 46us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271956.511858:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788271956.511872:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788271956.511878:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875138590193152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271956.511921:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875138590193152:12345-0@lo:400:kworker.0 Request processed in 43us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271956.511927:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788271956.511950:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590193024 00000100:00100000:0.0:1788271956.511953:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590193024 00000100:00100000:0.0:1788271956.511976:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590193280 00000100:00100000:0.0:1788271956.511979:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590193280 00000100:00100000:0.0:1788271956.511991:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788271956.511997:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3608:x1875138590193024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271956.512028:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3608:x1875138590193024:12345-0@lo:400:kworker.0 Request processed in 31us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271956.512034:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788271956.512045:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788271956.512051:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590193280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271956.512076:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590193280:12345-0@lo:400:kworker.0 Request processed in 26us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271956.512082:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788271956.512121:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590193280:0@lo:400:kworker.0 00010000:00080000:0.0:1788271956.512134:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f6d8406ca80 x1875138590193152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271956.512143:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875138590193152:0@lo:400:kworker.0 00000100:00100000:0.0:1788271956.512168:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590193024:0@lo:400:kworker.0 00010000:00080000:0.0:1788271956.512187:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f6d8406e300 x1875138590193664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271956.512196:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875138590193664:0@lo:400:kworker.0 00000100:00100000:2.0:1788271956.512286:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590192896 00000100:00100000:2.0:1788271956.512290:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590192896 00000100:00100000:2.0:1788271956.512315:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788271956.512322:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+18:3608:x1875138590192896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271956.512355:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+18:3608:x1875138590192896:12345-0@lo:400:kworker.0 Request processed in 33us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271956.512361:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788271956.512583:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590193920:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788271956.512611:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271956.512706:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590193920 00000100:00100000:2.0:1788271956.512710:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590193920 00000100:00100000:2.0:1788271956.512739:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788271956.512746:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3606:x1875138590193920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788271956.512768:0:17217:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788271956.512803:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3606:x1875138590193920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271956.512809:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788271956.512872:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590193792:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788271956.512900:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271956.512982:0:17953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590193792 00000100:00100000:2.0:1788271956.512989:0:17953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590193792 00000100:00100000:2.0:1788271956.513020:0:17953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788271956.513026:0:17953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83392300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590193792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788271956.513043:0:17953:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788271956.513077:0:17953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83392300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590193792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271956.513083:0:17953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788271956.513112:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590193792:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788271956.513734:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3608:1875138590192896:0@lo:400:kworker.0 00000100:00100000:3.0:1788271956.514417:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590193920:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788271956.575004:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788271957.029273:0:17945:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788271957.597842:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788271958.432813:0:17972:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788271958.557904:0:3605:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788271943/real 1788271943] req@ffff8f6d8406ea00 x1875138590184832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788271958 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271958.557945:0:3605:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f6d8406ea00 x1875138590184832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788271958 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271958.557955:0:3605:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788271943/real 1788271943] req@ffff8f6d8406e680 x1875138590184960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788271958 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271958.557965:0:3605:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f6d8406e680 x1875138590184960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788271958 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788271958.557984:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6e859c8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788271958.558007:0:3605:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788271958.558011:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3605:1875138590184832:0@lo:8:kworker.0 00000100:00080000:2.0:1788271958.558016:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6e8ac65000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788271958.558022:0:3605:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788271958.558024:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3605:1875138590184960:0@lo:8:kworker.0 00000100:00080000:3.0:1788271958.559056:0:17749:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788271958.559061:0:17749:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788271958.559064:0:17749:0:(import.c:65:import_set_state_nolock()) ffff8f6e859c8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788271958.559069:0:17749:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 504 00000100:00080000:3.0:1788271958.559075:0:17749:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788271958.559081:0:17749:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f6e859c8800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788271958.559102:0:17749:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d83250380 x1875138590194304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788271958.559114:0:17749:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788271958.559117:0:17749:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788271958.559119:0:17749:0:(import.c:65:import_set_state_nolock()) ffff8f6e8ac65000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788271958.559122:0:17749:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 504 00000100:00080000:3.0:1788271958.559125:0:17749:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788271958.559128:0:17749:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f6e8ac65000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788271958.559139:0:17749:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d83251180 x1875138590194432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788271958.559161:0:17749:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788271958.559164:0:17749:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788271958.559176:0:17749:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788271958.559179:0:17749:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788271958.559241:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590194688:0@lo:400:kworker.0 00000100:00100000:2.0:1788271958.559314:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271958.559371:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788271958.559379:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3606:1875138590194048:0@lo:400:kworker.0 00000100:00100000:2.0:1788271958.559405:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271958.559432:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875138590194816:0@lo:400:kworker.0 00000100:00100000:2.0:1788271958.559460:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271958.559491:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875138590194560:0@lo:400:kworker.0 00000100:00100000:2.0:1788271958.559513:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271958.559532:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788271958.559544:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590194176:0@lo:400:kworker.0 00000100:00100000:2.0:1788271958.559566:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271958.559593:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590194048 00000100:00100000:2.0:1788271958.559600:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590194048 00000100:00100000:2.0:1788271958.559668:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788271958.559677:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8312b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+18:3606:x1875138590194048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271958.559729:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8312b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+18:3606:x1875138590194048:12345-0@lo:400:kworker.0 Request processed in 52us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271958.559737:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788271958.559775:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590194816 00000100:00100000:2.0:1788271958.559779:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590194816 00000100:00100000:2.0:1788271958.559803:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590194560 00000100:00100000:2.0:1788271958.559806:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590194560 00000100:00100000:2.0:1788271958.559819:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788271958.559824:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1875138590194816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271958.559857:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1875138590194816:12345-0@lo:400:kworker.0 Request processed in 32us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271958.559863:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788271958.559886:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788271958.559893:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875138590194560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271958.559923:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3609:x1875138590194560:12345-0@lo:400:kworker.0 Request processed in 31us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271958.559929:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788271958.559975:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f6d8313c380 x1875138590194560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271958.559993:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3609:1875138590194560:0@lo:400:kworker.0 00000100:00100000:2.0:1788271958.560033:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83250380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3605:1875138590194304:0@lo:8:kworker.0 00000400:00000100:2.0:1788271958.560060:0:3605:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875138590194304 offset 0 length 520: 4 00000100:00100000:2.0:1788271958.560073:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83251180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3605:1875138590194432:0@lo:8:kworker.0 00000400:00000100:2.0:1788271958.560090:0:3605:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875138590194432 offset 0 length 520: 4 00000100:00100000:2.0:1788271958.560125:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3606:1875138590194048:0@lo:400:kworker.0 00010000:00080000:2.0:1788271958.560138:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f6d8313dc00 x1875138590194816/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271958.560148:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875138590194816:0@lo:400:kworker.0 00000100:00100000:3.0:1788271958.561159:0:17953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590194688 00000100:00100000:3.0:1788271958.561167:0:17953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590194688 00000100:00100000:3.0:1788271958.561221:0:17953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590194176 00000100:00100000:3.0:1788271958.561224:0:17953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590194176 00000100:00100000:3.0:1788271958.561241:0:17953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788271958.561249:0:17953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590194688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271958.561324:0:17953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590194688:12345-0@lo:400:kworker.0 Request processed in 74us (2010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271958.561331:0:17953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788271958.561346:0:17953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788271958.561352:0:17953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590194176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271958.561389:0:17953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590194176:12345-0@lo:400:kworker.0 Request processed in 37us (1821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271958.561396:0:17953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788271958.561436:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590194176:0@lo:400:kworker.0 00000100:00100000:0.0:1788271958.561513:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590194688:0@lo:400:kworker.0 00010000:00010000:1.0:1788271958.623663:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788271959.462817:0:18715:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788271959.462821:0:18715:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788271959.462822:0:18715:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788271959.463266:0:18715:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f6ebfb71000 00000020:01000004:2.0:1788271959.463282:0:18715:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788271959.463295:0:18715:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788271959.463308:0:18715:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8f6eb3cd0000) 00000020:00000080:2.0:1788271959.463325:0:18715:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788271959.523689:0:18715:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788271959.526215:0:18715:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788271959.526564:0:18715:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788271959.527243:0:18715:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788271959.527490:0:18715:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788271959.527884:0:18715:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788271959.528132:0:18715:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:3.0:1788271959.530459:0:18715:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788271959.530946:0:18715:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788271959.530959:0:18715:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788271959.530983:0:18715:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x99288105fd38fa5e 00000020:01000004:3.0:1788271959.530991:0:18715:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788271959.531027:0:18715:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.103@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788271959.531031:0:18715:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788271959.531037:0:18715:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788271959.531042:0:18715:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788271959.531054:0:18715:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8f6d823519b8) 00000020:00000080:3.0:1788271959.531067:0:18715:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1788271959.537835:0:18715:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788271959.538029:0:18715:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788271959.538034:0:18715:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788271959.544765:0:18715:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788271959.544777:0:18715:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788271959.547871:0:18715:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788271959.548241:0:18715:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788271959.551265:0:18715:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788271959.551613:0:18715:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788271959.551810:0:18715:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788271959.553124:0:18715:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788271959.553134:0:18715:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788271959.577325:0:18715:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788271959.577851:0:18715:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788271959.577869:0:18715:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788271959.579461:0:18715:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788271959.579472:0:18715:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788271959.580839:0:18715:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788271959.580850:0:18715:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788271959.582909:0:18715:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788271959.583091:0:18715:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788271959.583097:0:18715:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788271959.584416:0:18715:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788271959.584424:0:18715:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:3.0:1788271959.645925:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271959.650532:0:18715:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788271959.650997:0:18715:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788271959.651064:0:18715:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788271959.653532:0:18715:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788271959.653546:0:18715:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788271959.654918:0:18715:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788271959.654947:0:18715:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1788271959.654952:0:18715:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.103@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788271959.670348:0:18715:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.103@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788271959.670488:0:18715:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.103@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788271959.670494:0:18715:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788271959.670496:0:18715:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788271959.670497:0:18715:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788271959.670499:0:18715:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788271959.670500:0:18715:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788271959.670501:0:18715:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788271959.670503:0:18715:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788271959.670505:0:18715:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788271959.670506:0:18715:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788271959.670510:0:18715:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788271959.670513:0:18715:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788271959.670514:0:18715:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788271959.670515:0:18715:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788271959.670516:0:18715:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788271959.670517:0:18715:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788271959.670519:0:18715:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788271959.670520:0:18715:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788271959.670521:0:18715:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788271959.670521:0:18715:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788271959.670552:0:18715:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788271959.670573:0:18715:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83393b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:18715:1875138590194944:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788271959.670878:0:18715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271959.671165:0:18715:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e89061d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788271959.671213:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590194944 00000100:00100000:3.0:1788271959.671221:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590194944 00000100:00100000:3.0:1788271959.671320:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788271959.671330:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+18:18715:x1875138590194944:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788271959.671379:0:17204:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788271959.671383:0:17204:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788271959.671387:0:17204:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788271959.671753:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+18:18715:x1875138590194944:12345-0@lo:253:mount.lustre.0 Request processed in 423us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271959.671762:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788271959.671879:0:18715:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83393b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:18715:1875138590194944:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788271959.671889:0:18715:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788271959.671892:0:18715:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788271959.671893:0:18715:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788271959.671894:0:18715:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788271959.671895:0:18715:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788271959.671896:0:18715:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788271959.671898:0:18715:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788271959.671909:0:18715:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788271959.671911:0:18715:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788271959.671912:0:18715:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788271959.671933:0:18715:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f6ebfb71000 from lustre-OST0000 10000000:01000000:1.0:1788271959.671968:0:18715:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788271959.671971:0:18715:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788271959.671979:0:18715:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f6eb4174d28 local copy 00010000:00010000:1.0:1788271959.671989:0:18715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6400/0x99288105fd38f819 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f820 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271959.672090:0:18715:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83393b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:18715:1875138590195072:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788271959.672131:0:18715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271959.672728:0:18715:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d81623d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788271959.672980:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590195072 00000100:00100000:2.0:1788271959.672986:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590195072 00000100:00100000:2.0:1788271959.673035:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788271959.673043:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc816450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+18:18715:x1875138590195072:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788271959.673259:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc816450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+18:18715:x1875138590195072:12345-0@lo:501:mount.lustre.0 Request processed in 215us (1126us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788271959.673266:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788271959.673350:0:18715:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83393b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:18715:1875138590195072:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788271959.673435:0:18715:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788271959.673456:0:18715:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788271959.673463:0:18715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6400/0x99288105fd38f819 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f820 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271959.673473:0:18715:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6400/0x99288105fd38f819 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f820 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271959.673515:0:18715:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f6ebfb71000 10000000:01000000:1.0:1788271959.673520:0:18715:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788271959.673525:0:18715:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788271959.673527:0:18715:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788271959.673531:0:18715:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788271959.673534:0:18715:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788271959.673560:0:18715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5000/0x99288105fd38fa6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271959.673568:0:18715:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5000/0x99288105fd38fa6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271959.673577:0:18715:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5000/0x99288105fd38fa6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271959.673789:0:18715:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83393b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:18715:1875138590195200:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788271959.673828:0:18715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271959.673917:0:18715:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d81623d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788271959.674028:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590195200 00000100:00100000:3.0:1788271959.674033:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590195200 00000100:00100000:2.0:1788271959.674195:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788271959.674205:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc815450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+18:18715:x1875138590195200:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788271959.674216:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271959.674230:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6d833f6a00/0x99288105fd38fa73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38fa6c expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271959.674253:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6d833f6a00/0x99288105fd38fa73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38fa6c expref: 19 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271959.674263:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6d833f6a00/0x99288105fd38fa73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38fa6c expref: 19 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271959.674271:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d833f6a00, rc 0) 00000100:00100000:2.0:1788271959.674313:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc815450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+19:18715:x1875138590195200:12345-0@lo:101:mount.lustre.0 Request processed in 111us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271959.674320:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788271959.674457:0:18715:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83393b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:18715:1875138590195200:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788271959.674470:0:18715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5000/0x99288105fd38fa6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fa73 expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271959.674479:0:18715:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5000/0x99288105fd38fa6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38fa73 expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788271959.675868:0:18715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788271959.677269:0:18715:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788271959.680280:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788271959.680332:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788271959.680346:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788271959.680372:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788271959.680386:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788271959.680396:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788271959.680418:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788271959.680424:0:18715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788271959.680534:0:18715:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d832bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:18715:1875138590195328:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788271959.680997:0:18715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271959.681300:0:18715:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e870bc540 going to sleep for 11 seconds 00000100:00100000:2.0:1788271959.681405:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590195328 00000100:00100000:2.0:1788271959.681414:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590195328 00000100:00100000:2.0:1788271959.681459:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788271959.681469:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+19:18715:x1875138590195328:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788271959.681989:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+19:18715:x1875138590195328:12345-0@lo:501:mount.lustre.0 Request processed in 520us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271959.681998:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788271959.682240:0:18715:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d832bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:18715:1875138590195328:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788271959.682281:0:18715:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d832bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:18715:1875138590195456:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788271959.682335:0:18715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271959.682469:0:18715:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e870bc540 going to sleep for 11 seconds 00000100:00100000:2.0:1788271959.682514:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590195456 00000100:00100000:2.0:1788271959.682524:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590195456 00000100:00100000:2.0:1788271959.682817:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788271959.682826:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc815850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+19:18715:x1875138590195456:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788271959.683874:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc815850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+19:18715:x1875138590195456:12345-0@lo:503:mount.lustre.0 Request processed in 1046us (1535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271959.683884:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788271959.684040:0:18715:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d832bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:18715:1875138590195456:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788271959.684524:0:18715:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788271959.687822:0:18715:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83393b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:18715:1875138590195584:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788271959.687954:0:18715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271959.687999:0:18715:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d81623d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788271959.688083:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590195584 00000100:00100000:0.0:1788271959.688091:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590195584 00000100:00100000:0.0:1788271959.688159:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788271959.688169:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+19:18715:x1875138590195584:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788271959.688863:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+19:18715:x1875138590195584:12345-0@lo:502:mount.lustre.0 Request processed in 683us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271959.688871:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788271959.689215:0:18715:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83393b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:18715:1875138590195584:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788271959.689464:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788271959.689497:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788271959.689513:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788271959.689542:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788271959.689557:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788271959.689571:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788271959.689585:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788271959.689610:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788271959.689644:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1788271959.689656:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1788271959.689666:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1788271959.689678:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1788271959.689910:0:18715:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83393b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:18715:1875138590195712:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788271959.689959:0:18715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271959.689985:0:18715:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d81623d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788271959.690052:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590195712 00000100:00100000:0.0:1788271959.690058:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590195712 00000100:00100000:0.0:1788271959.690098:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788271959.690115:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+19:18715:x1875138590195712:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788271959.690209:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+19:18715:x1875138590195712:12345-0@lo:502:mount.lustre.0 Request processed in 95us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271959.690217:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788271959.690475:0:18715:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83393b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:18715:1875138590195712:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788271959.690524:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1788271959.690534:0:18715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788271959.691529:0:18732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788271959.691537:0:18732:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788271959.691544:0:18732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271959.691546:0:18732:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788271959.691551:0:18732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788271959.691565:0:18732:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8f6ea6bf0000) 00000020:00000080:1.0:1788271959.691794:0:18732:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788271959.691804:0:18732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788271959.691917:0:18732:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f6ebfb71000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788271959.691933:0:18732:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788271959.691939:0:18732:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x99288105fd38fa81 00010000:00010000:1.0:1788271959.697348:0:18732:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1788271959.698193:0:18732:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1788271959.700309:0:18732:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1788271959.702576:0:18732:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788271959.702600:0:18732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788271959.702608:0:18732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271959.702610:0:18732:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788271959.702614:0:18732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788271959.702640:0:18732:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1788271959.702642:0:18732:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788271959.702644:0:18732:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788271959.702645:0:18732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788271959.702649:0:18732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271959.702651:0:18732:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788271959.702654:0:18732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788271959.702657:0:18732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271959.702658:0:18732:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788271959.702661:0:18732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788271959.702669:0:18732:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788271959.702673:0:18732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788271959.702675:0:18732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271959.702676:0:18732:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788271959.702678:0:18732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788271959.702680:0:18732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271959.702682:0:18732:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788271959.702993:0:18732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788271959.703166:0:18732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788271959.703171:0:18732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788271959.703173:0:18732:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788271959.703176:0:18732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788271959.703475:0:18715:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788271959.703510:0:18715:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788271959.703560:0:18715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5000/0x99288105fd38fa6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fa73 expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271959.703574:0:18715:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5000/0x99288105fd38fa6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fa73 expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271959.703582:0:18715:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f6ebfb71000 from 1 10000000:01000000:3.0:1788271959.703586:0:18715:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788271959.703650:0:18715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5000/0x99288105fd38fa88 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271959.703658:0:18715:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5000/0x99288105fd38fa88 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271959.703670:0:18715:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5000/0x99288105fd38fa88 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271959.703792:0:18715:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:18715:1875138590195840:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788271959.703872:0:18715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271959.703912:0:18715:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d9b300 going to sleep for 11 seconds 00000100:00100000:0.0:1788271959.704454:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590195840 00000100:00100000:0.0:1788271959.704462:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590195840 00000100:00100000:0.0:1788271959.704512:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788271959.704520:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc815c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+19:18715:x1875138590195840:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788271959.704533:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271959.704547:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6e8511c600/0x99288105fd38fa8f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38fa88 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271959.704571:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6e8511c600/0x99288105fd38fa8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38fa88 expref: 20 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271959.704582:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6e8511c600/0x99288105fd38fa8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38fa88 expref: 20 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271959.704591:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e8511c600, rc 0) 00000100:00100000:0.0:1788271959.704656:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc815c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+20:18715:x1875138590195840:12345-0@lo:101:mount.lustre.0 Request processed in 136us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271959.704663:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788271959.705743:0:18715:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:18715:1875138590195840:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788271959.705770:0:18715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5000/0x99288105fd38fa88 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fa8f expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271959.705781:0:18715:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5000/0x99288105fd38fa88 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38fa8f expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788271959.707452:0:18715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788271959.708938:0:18715:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788271959.709166:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788271959.709194:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788271959.709213:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788271959.709219:0:18715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788271959.709308:0:18715:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d832bf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:18715:1875138590195968:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788271959.709439:0:18715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271959.709481:0:18715:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e870bccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271959.709563:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590195968 00000100:00100000:2.0:1788271959.709572:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590195968 00000100:00100000:2.0:1788271959.709633:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788271959.709643:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+20:18715:x1875138590195968:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788271959.709756:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+20:18715:x1875138590195968:12345-0@lo:501:mount.lustre.0 Request processed in 113us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271959.709763:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788271959.709909:0:18715:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d832bf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:18715:1875138590195968:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788271959.709938:0:18715:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d832bf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:18715:1875138590196096:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788271959.709978:0:18715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271959.710005:0:18715:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e870bccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271959.711483:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590196096 00000100:00100000:2.0:1788271959.711493:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590196096 00000100:00100000:2.0:1788271959.711544:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788271959.711555:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+20:18715:x1875138590196096:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788271959.711707:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+20:18715:x1875138590196096:12345-0@lo:503:mount.lustre.0 Request processed in 153us (1727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271959.711716:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788271959.712145:0:18715:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d832bf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:18715:1875138590196096:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788271959.712538:0:18715:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788271959.712644:0:18715:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d832bf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:18715:1875138590196224:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788271959.712918:0:18715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271959.712947:0:18715:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e870bc300 going to sleep for 11 seconds 00000100:00100000:0.0:1788271959.712969:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590196224 00000100:00100000:0.0:1788271959.712974:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590196224 00000100:00100000:2.0:1788271959.713114:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788271959.713125:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+20:18715:x1875138590196224:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788271959.713214:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+20:18715:x1875138590196224:12345-0@lo:502:mount.lustre.0 Request processed in 90us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271959.713221:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788271959.713342:0:18715:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d832bf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:18715:1875138590196224:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788271959.713566:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788271959.714095:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788271959.714178:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788271959.714196:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788271959.714211:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788271959.714222:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788271959.714233:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788271959.714245:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1788271959.714256:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788271959.714266:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1788271959.714290:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1788271959.714316:0:18715:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d832bf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:18715:1875138590196352:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788271959.715183:0:18715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271959.717451:0:18715:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e870bc300 going to sleep for 11 seconds 00000100:00100000:2.0:1788271959.718180:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590196352 00000100:00100000:2.0:1788271959.718199:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590196352 00000100:00100000:0.0:1788271959.718365:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788271959.718375:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e83ea2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+20:18715:x1875138590196352:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788271959.718546:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e83ea2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+20:18715:x1875138590196352:12345-0@lo:502:mount.lustre.0 Request processed in 172us (3365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271959.718555:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788271959.718709:0:18715:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d832bf800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:18715:1875138590196352:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788271959.718794:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1788271959.718808:0:18715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788271959.719899:0:18736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788271959.719909:0:18736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271959.719911:0:18736:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788271959.719918:0:18736:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f6ebfb71000 00000020:00000080:1.0:1788271959.719921:0:18736:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788271959.719928:0:18736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788271959.719931:0:18736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271959.719932:0:18736:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788271959.719934:0:18736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788271959.719936:0:18736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271959.719938:0:18736:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788271959.719941:0:18736:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f6ebfb71000 00000020:00000080:1.0:1788271959.719943:0:18736:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788271959.719999:0:18736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788271959.721478:0:18736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271959.721480:0:18736:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788271959.721487:0:18736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788271959.721490:0:18736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271959.721491:0:18736:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788271959.721496:0:18736:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f6ebfb71000 00000020:00000080:1.0:1788271959.721498:0:18736:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788271959.721537:0:18736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788271959.721540:0:18736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271959.721542:0:18736:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788271959.721551:0:18736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788271959.721553:0:18736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271959.721555:0:18736:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788271959.721558:0:18736:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f6ebfb71000 00000020:00000080:1.0:1788271959.721560:0:18736:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788271959.721605:0:18736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788271959.721610:0:18736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271959.721611:0:18736:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788271959.721615:0:18736:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1788271959.727735:0:18715:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788271959.727793:0:18715:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788271959.727812:0:18715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5000/0x99288105fd38fa88 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fa8f expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271959.727826:0:18715:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5000/0x99288105fd38fa88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fa8f expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271959.727903:0:18715:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788271959.727907:0:18715:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f6ebfb71000 10000000:01000000:2.0:1788271959.727910:0:18715:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f6ebfb71000 10000000:01000000:2.0:1788271959.727914:0:18715:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788271959.727920:0:18715:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f6ebfb71000 from 1 10000000:01000000:2.0:1788271959.727922:0:18715:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788271959.727959:0:18715:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6e00/0x99288105fd38fa96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271959.727968:0:18715:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6e00/0x99288105fd38fa96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271959.727979:0:18715:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6e00/0x99288105fd38fa96 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271959.728013:0:18715:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:18715:1875138590196480:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788271959.728079:0:18715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271959.728433:0:18715:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830a6540 going to sleep for 11 seconds 00000100:00100000:2.0:1788271959.728461:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590196480 00000100:00100000:2.0:1788271959.728469:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590196480 00000100:00100000:2.0:1788271959.728513:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788271959.728521:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+20:18715:x1875138590196480:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788271959.728541:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271959.728553:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6d833f6200/0x99288105fd38fa9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38fa96 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271959.728577:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6d833f6200/0x99288105fd38fa9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38fa96 expref: 21 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271959.728588:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6d833f6200/0x99288105fd38fa9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38fa96 expref: 21 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271959.728606:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d833f6200, rc 0) 00000100:00100000:2.0:1788271959.728660:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+21:18715:x1875138590196480:12345-0@lo:101:mount.lustre.0 Request processed in 140us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271959.728667:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788271959.729110:0:18715:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:18715:1875138590196480:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788271959.729125:0:18715:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6e00/0x99288105fd38fa96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fa9d expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271959.729136:0:18715:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6e00/0x99288105fd38fa96 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38fa9d expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788271959.731887:0:18715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788271959.732579:0:18715:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788271959.735490:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788271959.735531:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788271959.735544:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788271959.735556:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788271959.735570:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788271959.735584:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788271959.736206:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788271959.736223:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788271959.736238:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788271959.736253:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788271959.736269:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788271959.736283:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788271959.736297:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788271959.736312:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788271959.736326:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788271959.737777:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788271959.737813:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788271959.737828:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788271959.737841:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788271959.737867:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788271959.737884:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788271959.737898:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788271959.737912:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788271959.737926:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788271959.737939:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1788271959.737953:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1788271959.737967:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1788271959.737980:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1788271959.737993:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1788271959.739194:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1788271959.739223:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1788271959.739246:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1788271959.739254:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1788271959.739262:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1788271959.739269:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1788271959.739276:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1788271959.739284:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1788271959.739300:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1788271959.739304:0:18715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788271959.739946:0:18715:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:18715:1875138590196608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788271959.740011:0:18715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271959.740112:0:18715:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830a6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271959.740302:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590196608 00000100:00100000:1.0:1788271959.740309:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590196608 00000100:00100000:1.0:1788271959.740360:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788271959.740371:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+21:18715:x1875138590196608:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788271959.740482:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+21:18715:x1875138590196608:12345-0@lo:501:mount.lustre.0 Request processed in 113us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271959.740489:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788271959.740572:0:18715:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:18715:1875138590196608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788271959.740601:0:18715:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:18715:1875138590196736:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788271959.740674:0:18715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271959.740688:0:18715:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830a6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271959.740702:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590196736 00000100:00100000:2.0:1788271959.740707:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590196736 00000100:00100000:2.0:1788271959.740728:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788271959.740734:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+21:18715:x1875138590196736:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788271959.740804:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+21:18715:x1875138590196736:12345-0@lo:503:mount.lustre.0 Request processed in 70us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271959.740811:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788271959.740844:0:18715:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:18715:1875138590196736:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788271959.741429:0:18715:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788271959.741490:0:18715:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:18715:1875138590196864:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788271959.741525:0:18715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271959.741549:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590196864 00000100:00100000:2.0:1788271959.741553:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590196864 00000100:00100000:2.0:1788271959.741616:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788271959.741641:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+21:18715:x1875138590196864:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788271959.741717:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+21:18715:x1875138590196864:12345-0@lo:502:mount.lustre.0 Request processed in 77us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271959.741723:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788271959.741859:0:18715:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830a6540 going to sleep for 11 seconds 00000100:00100000:2.0:1788271959.741874:0:18715:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:18715:1875138590196864:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788271959.742035:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788271959.742174:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788271959.742188:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788271959.742200:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788271959.742211:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788271959.742221:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788271959.742232:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788271959.742255:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788271959.742268:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788271959.742278:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788271959.742289:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788271959.742299:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788271959.742315:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788271959.742326:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788271959.742336:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788271959.742347:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788271959.742359:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788271959.742373:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788271959.742384:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788271959.742396:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788271959.742409:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788271959.742423:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788271959.742436:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788271959.742460:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788271959.742474:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1788271959.742487:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1788271959.742500:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1788271959.742513:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1788271959.742524:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1788271959.742537:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1788271959.742557:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1788271959.742570:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1788271959.742583:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1788271959.742595:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1788271959.742609:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1788271959.742790:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788271959.742808:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1788271959.742821:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1788271959.742832:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1788271959.742865:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1788271959.742880:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1788271959.742891:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1788271959.742903:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1788271959.742915:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1788271959.742926:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1788271959.742937:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1788271959.742948:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1788271959.742960:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1788271959.742994:0:18715:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:18715:1875138590196992:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788271959.743159:0:18715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271959.743235:0:18715:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830a6540 going to sleep for 11 seconds 00000100:00100000:1.0:1788271959.743272:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590196992 00000100:00100000:1.0:1788271959.743276:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590196992 00000100:00100000:1.0:1788271959.743342:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788271959.743350:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+21:18715:x1875138590196992:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788271959.743439:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+21:18715:x1875138590196992:12345-0@lo:502:mount.lustre.0 Request processed in 89us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271959.743446:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788271959.743506:0:18715:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:18715:1875138590196992:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788271959.743647:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1788271959.743667:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1788271959.743686:0:18715:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:18715:1875138590197120:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788271959.743720:0:18715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271959.743734:0:18715:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830a6540 going to sleep for 11 seconds 00000100:00100000:1.0:1788271959.743781:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590197120 00000100:00100000:1.0:1788271959.743785:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590197120 00000100:00100000:1.0:1788271959.743841:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788271959.743848:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87096c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+21:18715:x1875138590197120:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788271959.743916:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87096c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+21:18715:x1875138590197120:12345-0@lo:502:mount.lustre.0 Request processed in 69us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271959.743927:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788271959.743979:0:18715:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:18715:1875138590197120:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788271959.744010:0:18715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1788271959.744023:0:18715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788271959.744928:0:18741:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788271959.744939:0:18741:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8f6e85be99b8) 00000020:00000080:0.0:1788271959.744955:0:18741:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1788271959.745091:0:18741:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f6ebfb71000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788271959.745096:0:18741:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f6ebfb71000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788271959.745156:0:18741:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f6ebfb71000 3 00010000:00080000:0.0:1788271959.745179:0:18741:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f6d81d6e000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.103@tcp at head 00010000:00010000:0.0:1788271959.750323:0:18741:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1788271959.752894:0:18741:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788271959.752946:0:18741:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788271959.752959:0:18741:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x99288105fd38faab 00000100:00080000:1.0:1788271959.752968:0:18741:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788271959.752974:0:18741:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8f6d81d6e000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:1.0:1788271959.753008:0:18741:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d83392a00 x1875138590197248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788271959.753068:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83392a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3605:1875138590197248:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788271959.753192:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788271959.753247:0:18741:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788271959.753308:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590197248 00000100:00100000:2.0:1788271959.753315:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590197248 00000100:00100000:2.0:1788271959.753342:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788271959.753350:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3605:x1875138590197248:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788271959.753372:0:17213:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 520 last 0 00000020:00000080:2.0:1788271959.753402:0:17213:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x99288105fd38fab2 00000004:00100000:2.0:1788271959.753417:0:17213:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788271959.753447:0:17213:0:(import.c:65:import_set_state_nolock()) ffff8f6e84d0c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788271959.753493:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3605:x1875138590197248:12345-0@lo:38:llog_process_th.0 Request processed in 142us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271959.753500:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788271959.753643:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f6d83392a00 x1875138590197248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788271969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271959.753654:0:3605:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788271959.753661:0:3605:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1788271959.753668:0:3605:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788271959.753672:0:3605:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788271959.753674:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6d81d6e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788271959.753680:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83392a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3605:1875138590197248:0@lo:38:llog_process_th.0 00000020:01000004:2.0:1788271959.753899:0:18741:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788271959.753914:0:18741:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8f6eb3cd19b8) 00000020:00000080:2.0:1788271959.753931:0:18741:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1788271959.754015:0:18741:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f6ebfb71000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788271959.754024:0:18741:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f6ebfb71000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788271959.754027:0:18741:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f6ebfb71000 3 00010000:00080000:2.0:1788271959.758044:0:18741:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f6ea0f8a800@lustre-MDT0001-lwp-OST0000: add connection 192.168.201.103@tcp at head 00000100:00080000:0.0:1788271959.760450:0:17749:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788271959.760461:0:17749:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788271959.760464:0:17749:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788271959.760467:0:17749:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788271959.760492:0:17749:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788271959.760496:0:17749:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788271959.760499:0:17749:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788271959.760501:0:17749:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788271959.761686:0:18741:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1788271959.761902:0:18741:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1788271959.761947:0:18741:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000100:00100000:0.0:1788271959.762245:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d832bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590197376:0@lo:400:kworker.0 00000100:00100000:0.0:1788271959.762313:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271959.762412:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788271959.762421:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d832bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875138590197504:0@lo:400:kworker.0 00000100:00100000:0.0:1788271959.762450:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271959.762491:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d832bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590197632:0@lo:400:kworker.0 00000100:00100000:0.0:1788271959.762514:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271959.762533:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788271959.762539:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d832bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875138590197760:0@lo:400:kworker.0 00000100:00100000:0.0:1788271959.762558:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271959.763760:0:17953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590197376 00000100:00100000:0.0:1788271959.763772:0:17953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590197376 00000020:00000080:2.0:1788271959.763841:0:18741:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x99288105fd38fac0 00000100:00080000:2.0:1788271959.763860:0:18741:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788271959.763865:0:18741:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8f6ea0f8a800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:0.0:1788271959.763877:0:17953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590197632 00000100:00100000:0.0:1788271959.763880:0:17953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590197632 00000100:00100000:0.0:1788271959.763895:0:17953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788271959.763896:0:18741:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d8406ed80 x1875138590197888/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788271959.763903:0:17953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590197376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271959.763927:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3605:1875138590197888:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788271959.763959:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271959.763970:0:17953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590197376:12345-0@lo:400:kworker.0 Request processed in 67us (1657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271959.763994:0:17953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788271959.763999:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590197504 00000100:00100000:2.0:1788271959.764002:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590197504 00000100:00100000:2.0:1788271959.764020:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590197760 00000100:00100000:2.0:1788271959.764023:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590197760 00000100:00100000:2.0:1788271959.764033:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590197888 00000100:00100000:2.0:1788271959.764035:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590197888 00000100:00100000:1.0:1788271959.764176:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788271959.764185:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590197632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271959.764222:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590197632:12345-0@lo:400:kworker.0 Request processed in 39us (1707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271959.764227:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788271959.764262:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d832bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590197632:0@lo:400:kworker.0 00000100:00100000:2.0:1788271959.764310:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788271959.764316:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875138590197504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271959.764343:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ece680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875138590197504:12345-0@lo:400:kworker.0 Request processed in 28us (1893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271959.764348:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788271959.764358:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788271959.764363:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1875138590197760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271959.764425:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1875138590197760:12345-0@lo:400:kworker.0 Request processed in 61us (1865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271959.764439:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788271959.764449:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788271959.764453:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3605:x1875138590197888:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788271959.764474:0:17211:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 520 last 0 00000020:00000080:2.0:1788271959.764510:0:17211:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x99288105fd38fac7 00000004:00100000:2.0:1788271959.764523:0:17211:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788271959.764550:0:17211:0:(import.c:65:import_set_state_nolock()) ffff8f6ea0f88800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788271959.764580:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3605:x1875138590197888:12345-0@lo:38:llog_process_th.0 Request processed in 125us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271959.764586:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788271959.764608:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f6d8406ed80 x1875138590197888/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788271969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271959.764632:0:3605:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788271959.764639:0:3605:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1788271959.764644:0:3605:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788271959.764648:0:3605:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788271959.764650:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6ea0f8a800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788271959.764655:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3605:1875138590197888:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788271959.764668:0:18741:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788271959.764688:0:17749:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788271959.764692:0:17749:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788271959.764695:0:17749:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788271959.764697:0:17749:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788271959.764705:0:17749:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788271959.764708:0:17749:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788271959.764711:0:17749:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788271959.764713:0:17749:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:1.0:1788271959.764858:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f6d832bc000 x1875138590197760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271959.764869:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d832bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875138590197760:0@lo:400:kworker.0 00000040:00080000:2.0:1788271959.765032:0:18741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1788271959.765107:0:18715:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788271959.765134:0:18715:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788271959.765146:0:18715:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6e00/0x99288105fd38fa96 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fa9d expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271959.765156:0:18715:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6e00/0x99288105fd38fa96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fa9d expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788271959.765193:0:18715:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788271959.765195:0:18715:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788271959.765196:0:18715:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788271959.765197:0:18715:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788271959.765198:0:18715:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788271959.765199:0:18715:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788271959.765201:0:18715:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788271959.765203:0:18715:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788271959.765204:0:18715:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788271959.765207:0:18715:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788271959.765210:0:18715:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788271959.765211:0:18715:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788271959.765212:0:18715:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788271959.765213:0:18715:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788271959.765214:0:18715:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788271959.765215:0:18715:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788271959.765216:0:18715:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788271959.765217:0:18715:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788271959.765218:0:18715:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788271959.765231:0:18715:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788271959.765244:0:18715:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:18715:1875138590198016:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788271959.765276:0:18715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271959.765295:0:18715:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830a6840 going to sleep for 11 seconds 00000100:00100000:2.0:1788271959.765312:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590198016 00000100:00100000:2.0:1788271959.765316:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590198016 00000100:00100000:2.0:1788271959.765340:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788271959.765345:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+21:18715:x1875138590198016:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788271959.765362:0:17204:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788271959.765373:0:17204:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:1.0:1788271959.767730:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f6d832bf800 x1875138590197504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271959.767747:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d832bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875138590197504:0@lo:400:kworker.0 00000100:00100000:1.0:1788271959.767758:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d832bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590197376:0@lo:400:kworker.0 20000000:01000000:2.0:1788271959.771471:0:17204:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788271959.771487:0:17204:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788271959.772011:0:17227:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788271959.772017:0:17227:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788271959.772038:0:17227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f6d833f6800/0x99288105fd38face lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271959.772058:0:17227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6d833f6c00/0x99288105fd38fa18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38fa11 expref: 21 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271959.772066:0:17227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6eb4ed4400/0x99288105fd38fa26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38fa1f expref: 21 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271959.772073:0:17227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f6d833f6800/0x99288105fd38face lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271959.772225:0:17227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6eb4ed4400/0x99288105fd38fa26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38fa1f expref: 21 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271959.772239:0:17227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f6eb4ed4400/0x99288105fd38fa26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38fa1f expref: 21 pid: 17204 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271959.772266:0:17227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1875138590198144:0@lo:104: 00000100:00100000:2.0:1788271959.772331:0:17227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788271959.772422:0:17227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6d833f6c00/0x99288105fd38fa18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38fa11 expref: 21 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271959.772430:0:17227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f6d833f6c00/0x99288105fd38fa18 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38fa11 expref: 21 pid: 17205 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271959.772439:0:17227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1875138590198272:0@lo:104: 00000100:00100000:2.0:1788271959.772462:0:17227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271959.772510:0:17227:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830a60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271959.772547:0:17195:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788271959.772569:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590198144 00000100:00100000:1.0:1788271959.772575:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590198144 00000100:00100000:1.0:1788271959.772608:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590198272 00000100:00100000:1.0:1788271959.772611:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590198272 00000100:00100000:1.0:1788271959.772654:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788271959.772663:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+4:17227:x1875138590198144:12345-0@lo:104: 00010000:00010000:1.0:1788271959.772675:0:17195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d400/0x99288105fd38fa1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38fa26 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271959.772725:0:17195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788271959.772731:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+4:17227:x1875138590198144:12345-0@lo:104: Request processed in 69us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271959.772739:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788271959.772755:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788271959.772761:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e902a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+3:17227:x1875138590198272:12345-0@lo:104: 00010000:00010000:1.0:1788271959.772768:0:17195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4000/0x99288105fd38fa11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38fa18 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271959.772800:0:17195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788271959.772805:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e902a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+3:17227:x1875138590198272:12345-0@lo:104: Request processed in 45us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271959.772811:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788271959.772843:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788271959.772862:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d400/0x99288105fd38fa1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38fa26 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271959.772870:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511d400 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:1.0:1788271959.772873:0:17199:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d400/0x99288105fd38fa1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38fa26 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271959.772891:0:17199:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d400/0x99288105fd38fa1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38fa26 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788271959.772899:0:17199:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d400/0x99288105fd38fa1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38fa26 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271959.772906:0:17199:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788271959.772933:0:17199:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d400/0x99288105fd38fa1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38fa26 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271959.772939:0:17199:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788271959.772965:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d400/0x99288105fd38fa1f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38fa26 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271959.772973:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d400/0x99288105fd38fa1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38fa26 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271959.772984:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271959.772987:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4000/0x99288105fd38fa11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38fa18 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271959.772993:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4000 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:1.0:1788271959.772996:0:17199:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4000/0x99288105fd38fa11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38fa18 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271959.773002:0:17199:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4000/0x99288105fd38fa11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38fa18 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788271959.773008:0:17199:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4000/0x99288105fd38fa11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38fa18 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271959.773019:0:17199:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788271959.773032:0:17199:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4000/0x99288105fd38fa11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38fa18 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271959.773038:0:17199:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788271959.773044:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4000/0x99288105fd38fa11 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38fa18 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271959.773051:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4000/0x99288105fd38fa11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38fa18 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271959.773062:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271959.773064:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271959.773065:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271959.773072:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271959.773226:0:17194:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:2.0:1788271959.773289:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+21:18715:x1875138590198016:12345-0@lo:253:mount.lustre.0 Request processed in 7942us (8011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271959.773297:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788271959.773342:0:18715:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:18715:1875138590198016:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788271959.773353:0:18715:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788271959.773356:0:18715:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788271959.773358:0:18715:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788271959.773359:0:18715:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788271959.773360:0:18715:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788271959.773362:0:18715:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788271959.773363:0:18715:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788271959.773364:0:18715:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788271959.773366:0:18715:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788271959.773368:0:18715:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788271959.773380:0:18715:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788271959.773583:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83390380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3609:1875138590198528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788271959.773715:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271959.773750:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788271959.773756:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83392680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3609:1875138590198400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788271959.773778:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271959.773806:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590198528 00000100:00100000:0.0:1788271959.773809:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590198528 00010000:00010000:0.0:1788271959.773828:0:17197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6d833f6c00/0x99288105fd38fa18 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38fa11 expref: 21 pid: 17205 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271959.773847:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590198400 00000100:00100000:0.0:1788271959.773865:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590198400 00010000:00010000:0.0:1788271959.773875:0:17197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6eb4ed4400/0x99288105fd38fa26 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38fa1f expref: 22 pid: 17204 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271959.773892:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788271959.773898:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+22:3609:x1875138590198528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788271959.773907:0:17197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271959.773913:0:17197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6d833f6c00/0x99288105fd38fa18 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38fa11 expref: 22 pid: 17205 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271959.773921:0:17197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6d833f6c00/0x99288105fd38fa18 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38fa11 expref: 22 pid: 17205 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271959.773935:0:17197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271959.773959:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+22:3609:x1875138590198528:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271959.773961:0:17227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1875138590198144:0@lo:104: 00010000:00010000:2.0:1788271959.773970:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6d833f6c00/0x99288105fd38fa18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38fa11 expref: 22 pid: 17205 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271959.773974:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788271959.773984:0:17227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1875138590198272:0@lo:104: 00000100:00100000:0.0:1788271959.773987:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788271959.773993:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83128850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+20:3609:x1875138590198400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788271959.773997:0:17227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f6d833f6800/0x99288105fd38face lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271959.773999:0:17197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271959.774183:0:17197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6eb4ed4400/0x99288105fd38fa26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38fa1f expref: 20 pid: 17204 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271959.774193:0:17197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6eb4ed4400/0x99288105fd38fa26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38fa1f expref: 20 pid: 17204 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271959.774203:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4ed4400/0x99288105fd38fa26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38fa1f expref: 20 pid: 17204 timeout: 620 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271959.774217:0:17197:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f6d833f6800/0x99288105fd38face lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271959.774225:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6d833f6800/0x99288105fd38face lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788271959.774236:0:17197:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002501695s 00010000:00010000:0.0:1788271959.774241:0:17197:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f6d833f6800/0x99288105fd38face lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271959.774248:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f6d833f6800/0x99288105fd38face lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271959.774255:0:17197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f6d833f6800/0x99288105fd38face lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271959.774261:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f6d833f6800/0x99288105fd38face lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271959.774272:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f6800 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:0.0:1788271959.774276:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f6d833f6800/0x99288105fd38face lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271959.774284:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f6d833f6800/0x99288105fd38face lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271959.774306:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f6d833f6800/0x99288105fd38face lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271959.774315:0:17197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271959.774335:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83128850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+19:3609:x1875138590198400:12345-0@lo:103:ldlm_bl.0 Request processed in 342us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271959.774339:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788271959.774433:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83392680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3609:1875138590198400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788271959.774438:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83390380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3609:1875138590198528:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788271959.775309:0:17227:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f6d833f6800/0x99288105fd38face lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271959.775326:0:17227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f6d833f6800/0x99288105fd38face lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271959.775331:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6d833f6800/0x99288105fd38face lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:2.0:1788271959.776180:0:18715:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788271959.778992:0:18715:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788271959.779002:0:18715:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788271959.779037:0:18715:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788271959.779077:0:18715:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.103@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788271959.779214:0:18715:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788271959.779233:0:18715:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1788271959.779994:0:18715:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788271959.780207:0:18715:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:2.0:1788271960.626144:0:18796:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788271960.626367:0:18796:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788271960.669827:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788271961.181756:0:17208:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788271961.181765:0:17208:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f6d82344800 from 9 10000000:01000000:2.0:1788271961.181770:0:17208:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788271961.181839:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7800/0x99288105fd38fad5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271961.181854:0:17208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7800/0x99288105fd38fad5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271961.181866:0:17208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7800/0x99288105fd38fad5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271961.181905:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590198656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788271961.181988:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271961.182041:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e856bb0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271961.182325:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590198656 00000100:00100000:1.0:1788271961.182333:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590198656 00000100:00100000:1.0:1788271961.182406:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788271961.182417:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+19:17208:x1875138590198656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788271961.182431:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271961.182448:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4ed4400/0x99288105fd38fadc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38fad5 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271961.182471:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4ed4400/0x99288105fd38fadc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38fad5 expref: 20 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271961.182482:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4ed4400/0x99288105fd38fadc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38fad5 expref: 20 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271961.182514:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4ed4400, rc 0) 00000100:00100000:1.0:1788271961.182577:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+20:17208:x1875138590198656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271961.182585:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788271961.182914:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590198656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788271961.182931:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7800/0x99288105fd38fad5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fadc expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271961.182940:0:17208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7800/0x99288105fd38fad5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38fadc expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271961.182998:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590198784:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788271961.183031:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271961.183066:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb3e87480 going to sleep for 11 seconds 00000100:00100000:0.0:1788271961.183184:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590198784 00000100:00100000:0.0:1788271961.183191:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590198784 00000100:00100000:0.0:1788271961.183229:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788271961.183237:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+20:17208:x1875138590198784:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788271961.183257:0:17204:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788271961.183274:0:17204:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788271961.183277:0:17204:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1788271961.183363:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+20:17208:x1875138590198784:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271961.183371:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788271961.183535:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590198784:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788271961.183593:0:17208:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788271961.183600:0:17208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7800/0x99288105fd38fad5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fadc expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271961.183637:0:17208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7800/0x99288105fd38fad5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fadc expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271961.183647:0:17208:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788271961.183649:0:17208:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f6e851db000 from 9 10000000:01000000:3.0:1788271961.183652:0:17208:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788271961.183668:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5600/0x99288105fd38fae3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271961.183676:0:17208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5600/0x99288105fd38fae3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271961.183683:0:17208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5600/0x99288105fd38fae3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271961.183694:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590198912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788271961.183716:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271961.183741:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb3e87480 going to sleep for 11 seconds 00000100:00100000:0.0:1788271961.183880:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590198912 00000100:00100000:0.0:1788271961.183885:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590198912 00000100:00100000:0.0:1788271961.183911:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788271961.183918:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87094050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+20:17208:x1875138590198912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788271961.183925:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271961.183934:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6e8511d400/0x99288105fd38faea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38fae3 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271961.183948:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6e8511d400/0x99288105fd38faea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38fae3 expref: 21 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271961.183956:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6e8511d400/0x99288105fd38faea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38fae3 expref: 21 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271961.183963:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e8511d400, rc 0) 00000100:00100000:0.0:1788271961.183995:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87094050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+21:17208:x1875138590198912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 78us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271961.184001:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788271961.184200:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590198912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788271961.184211:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5600/0x99288105fd38fae3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38faea expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271961.184220:0:17208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5600/0x99288105fd38fae3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38faea expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271961.184259:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590199040:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788271961.184285:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271961.184312:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb3e87480 going to sleep for 11 seconds 00000100:00100000:1.0:1788271961.184375:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590199040 00000100:00100000:1.0:1788271961.184379:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590199040 00000100:00100000:1.0:1788271961.184410:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788271961.184416:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87094450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+21:17208:x1875138590199040:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788271961.184426:0:17205:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788271961.184437:0:17205:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788271961.184440:0:17205:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1788271961.184512:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87094450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+21:17208:x1875138590199040:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 95us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271961.184518:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788271961.184813:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590199040:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788271961.184869:0:17208:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788271961.184886:0:17208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5600/0x99288105fd38fae3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38faea expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271961.184894:0:17208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5600/0x99288105fd38fae3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38faea expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271961.630053:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590199168:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788271961.630137:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271961.630512:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788271961.630520:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590199296:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788271961.630545:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271961.630966:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590199168 00000100:00100000:1.0:1788271961.630976:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590199168 00000100:00100000:1.0:1788271961.631026:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590199296 00000100:00100000:1.0:1788271961.631029:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590199296 00000100:00100000:1.0:1788271961.631045:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788271961.631055:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590199168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788271961.631159:0:17217:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788271961.631278:0:17953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788271961.631287:0:17953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590199296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788271961.631307:0:17953:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788271961.631385:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590199168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 332us (1248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271961.631393:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788271961.631612:0:17953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ece300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590199296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 326us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271961.631657:0:17953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788271961.631728:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590199168:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788271961.631757:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590199296:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788271961.693839:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271962.719300:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271963.741901:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271964.767897:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788271965.152547:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:0.0:1788271965.217521:0:17749:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788271965.217528:0:17749:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788271965.217531:0:17749:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788271965.217534:0:17749:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788271965.217563:0:17749:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788271965.217567:0:17749:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788271965.217569:0:17749:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788271965.217572:0:17749:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788271965.217614:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ecdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590199552:0@lo:400:kworker.0 00000100:00100000:0.0:1788271965.217718:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271965.217781:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ecf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3609:1875138590200064:0@lo:400:kworker.0 00000100:00100000:0.0:1788271965.217809:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271965.217833:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788271965.217839:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ecc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3609:1875138590199424:0@lo:400:kworker.0 00000100:00100000:0.0:1788271965.217863:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271965.217882:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875138590199936:0@lo:400:kworker.0 00000100:00100000:0.0:1788271965.217898:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271965.217921:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ecfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875138590199680:0@lo:400:kworker.0 00000100:00100000:0.0:1788271965.218146:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271965.218175:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ecc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3606:1875138590200192:0@lo:400:kworker.0 00000100:00100000:0.0:1788271965.218216:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271965.218231:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788271965.218236:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590199808:0@lo:400:kworker.0 00000100:00100000:0.0:1788271965.218258:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271965.218292:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590199552 00000100:00100000:0.0:1788271965.218299:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590199552 00000100:00100000:0.0:1788271965.218339:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590199808 00000100:00100000:0.0:1788271965.218342:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590199808 00000100:00100000:0.0:1788271965.218357:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788271965.218365:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590199552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271965.218419:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590199552:12345-0@lo:400:kworker.0 Request processed in 54us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271965.218426:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788271965.218442:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788271965.218449:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590199808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271965.218481:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590199808:12345-0@lo:400:kworker.0 Request processed in 32us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271965.218486:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788271965.218503:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590200064 00000100:00100000:0.0:1788271965.218506:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590200064 00000100:00100000:0.0:1788271965.218530:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590199936 00000100:00100000:0.0:1788271965.218533:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590199936 00000100:00100000:0.0:1788271965.218542:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590199680 00000100:00100000:0.0:1788271965.218545:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590199680 00000100:00100000:0.0:1788271965.218555:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590200192 00000100:00100000:0.0:1788271965.218557:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590200192 00000100:00100000:0.0:1788271965.218569:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788271965.218576:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875138590200064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271965.218614:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3609:x1875138590200064:12345-0@lo:400:kworker.0 Request processed in 39us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271965.218641:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788271965.218654:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788271965.218660:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875138590199936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271965.218687:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3609:x1875138590199936:12345-0@lo:400:kworker.0 Request processed in 27us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271965.218705:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788271965.218717:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788271965.218723:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875138590199680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271965.218748:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875138590199680:12345-0@lo:400:kworker.0 Request processed in 25us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271965.218764:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788271965.218776:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788271965.218781:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82eced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1875138590200192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271965.218808:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82eced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1875138590200192:12345-0@lo:400:kworker.0 Request processed in 27us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271965.218813:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788271965.218832:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590199424 00000100:00100000:0.0:1788271965.218835:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590199424 00000100:00100000:0.0:1788271965.218860:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788271965.218866:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+21:3609:x1875138590199424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271965.218895:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+21:3609:x1875138590199424:12345-0@lo:400:kworker.0 Request processed in 29us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271965.218901:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788271965.219231:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590199808:0@lo:400:kworker.0 00010000:00080000:0.0:1788271965.219247:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d82ecfb80 x1875138590199680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271965.219257:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ecfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875138590199680:0@lo:400:kworker.0 00010000:00080000:0.0:1788271965.219267:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d82ecc700 x1875138590200192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271965.219275:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ecc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3606:1875138590200192:0@lo:400:kworker.0 00000100:00100000:0.0:1788271965.219304:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ecc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3609:1875138590199424:0@lo:400:kworker.0 00010000:00080000:0.0:1788271965.219325:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d82ecc380 x1875138590199936/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271965.219334:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3609:1875138590199936:0@lo:400:kworker.0 00000100:00100000:0.0:1788271965.219346:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ecdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590199552:0@lo:400:kworker.0 00010000:00080000:0.0:1788271965.219355:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d82ecf100 x1875138590200064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271965.219363:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ecf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3609:1875138590200064:0@lo:400:kworker.0 00000100:00080000:1.0:1788271965.219497:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788271965.219501:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1788271965.661000:0:19086:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg103-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788271965.790233:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788271966.408277:0:19138:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788271966.408500:0:19138:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788271966.750650:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590200320:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788271966.750743:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271966.750897:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590200320 00000100:00100000:3.0:1788271966.750905:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590200320 00000100:00100000:3.0:1788271966.750958:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788271966.750968:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590200320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788271966.751011:0:17216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788271966.751068:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590200320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271966.751075:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788271966.751179:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590200320:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788271966.753022:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788271966.753043:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83393100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590200448:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788271966.753101:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271966.753213:0:17953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590200448 00000100:00100000:2.0:1788271966.753225:0:17953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590200448 00000100:00100000:2.0:1788271966.753273:0:17953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788271966.753288:0:17953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590200448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788271966.753320:0:17953:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788271966.753377:0:17953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590200448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271966.753385:0:17953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788271966.753793:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83393100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590200448:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788271966.813959:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788271967.127339:0:19188:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788271967.127560:0:19188:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788271967.843351:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788271968.684913:0:17972:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788271968.862789:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271969.893880:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788271970.334772:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788271970.334790:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788271970.334794:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788271970.334797:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788271970.334813:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788271970.334816:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788271970.334819:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788271970.334821:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788271970.334961:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ecfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590200960:0@lo:400:kworker.0 00000100:00100000:0.0:1788271970.335268:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271970.335391:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788271970.335398:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3608:1875138590200576:0@lo:400:kworker.0 00000100:00100000:0.0:1788271970.335441:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271970.335466:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875138590201088:0@lo:400:kworker.0 00000100:00100000:0.0:1788271970.335508:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271970.335535:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ecc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590200704:0@lo:400:kworker.0 00000100:00100000:0.0:1788271970.335559:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271970.335575:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d839cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3606:1875138590201216:0@lo:400:kworker.0 00000100:00100000:0.0:1788271970.335594:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271970.335613:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788271970.335638:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ecc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875138590200832:0@lo:400:kworker.0 00000100:00100000:0.0:1788271970.335682:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271970.335701:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d839cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3606:1875138590201344:0@lo:400:kworker.0 00000100:00100000:0.0:1788271970.335720:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271970.335747:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590200960 00000100:00100000:0.0:1788271970.335754:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590200960 00000100:00100000:0.0:1788271970.336570:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590200704 00000100:00100000:0.0:1788271970.336576:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590200704 00000100:00100000:0.0:1788271970.336601:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788271970.336610:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590200960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271970.336708:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590200960:12345-0@lo:400:kworker.0 Request processed in 99us (1441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271970.336718:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788271970.336739:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788271970.336745:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590200704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271970.336778:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590200704:12345-0@lo:400:kworker.0 Request processed in 33us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271970.337046:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788271970.337068:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590200576 00000100:00100000:0.0:1788271970.337073:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590200576 00000100:00100000:0.0:1788271970.337382:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788271970.337392:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+21:3608:x1875138590200576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271970.337431:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+21:3608:x1875138590200576:12345-0@lo:400:kworker.0 Request processed in 41us (1990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271970.337437:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788271970.337523:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590201088 00000100:00100000:0.0:1788271970.337527:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590201088 00000100:00100000:0.0:1788271970.337546:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590201216 00000100:00100000:0.0:1788271970.337554:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590201216 00000100:00100000:0.0:1788271970.337613:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590200832 00000100:00100000:0.0:1788271970.337635:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590200832 00000100:00100000:0.0:1788271970.337649:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590201344 00000100:00100000:0.0:1788271970.337652:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590201344 00000100:00080000:2.0:1788271970.337704:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788271970.337708:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788271970.337796:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788271970.337803:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875138590201088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271970.337836:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875138590201088:12345-0@lo:400:kworker.0 Request processed in 34us (2327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271970.337842:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788271970.337854:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788271970.337860:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1875138590201216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271970.337885:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1875138590201216:12345-0@lo:400:kworker.0 Request processed in 25us (2289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271970.337890:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788271970.337901:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788271970.337906:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875138590200832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271970.337931:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875138590200832:12345-0@lo:400:kworker.0 Request processed in 24us (2249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271970.337936:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788271970.337948:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788271970.337953:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1875138590201344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271970.337979:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1875138590201344:12345-0@lo:400:kworker.0 Request processed in 26us (2258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271970.337996:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788271970.338489:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d82ecc700 x1875138590200832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271970.338514:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ecc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875138590200832:0@lo:400:kworker.0 00010000:00080000:0.0:1788271970.338527:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d839cce00 x1875138590201344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271970.338535:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d839cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3606:1875138590201344:0@lo:400:kworker.0 00000100:00100000:0.0:1788271970.338546:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ecc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590200704:0@lo:400:kworker.0 00010000:00080000:0.0:1788271970.338555:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d839cca80 x1875138590201216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271970.338562:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d839cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3606:1875138590201216:0@lo:400:kworker.0 00000100:00100000:0.0:1788271970.338602:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3608:1875138590200576:0@lo:400:kworker.0 00010000:00080000:0.0:1788271970.338613:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d82ecd500 x1875138590201088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271986 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271970.338696:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875138590201088:0@lo:400:kworker.0 00000100:00100000:0.0:1788271970.338711:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ecfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590200960:0@lo:400:kworker.0 00010000:00010000:1.0:1788271970.910773:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271971.037732:0:3605:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788271956/real 1788271956] req@ffff8f6d8406dc00 x1875138590193408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788271971 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271971.037765:0:3605:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f6d8406dc00 x1875138590193408/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788271971 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271971.037775:0:3605:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788271956/real 1788271956] req@ffff8f6d8406f800 x1875138590193536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788271971 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271971.037785:0:3605:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f6d8406f800 x1875138590193536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788271971 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788271971.037805:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6eb0cec000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788271971.037890:0:3605:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788271971.037894:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3605:1875138590193408:0@lo:8:kworker.0 00000100:00080000:2.0:1788271971.037900:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6e812ab000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788271971.038242:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788271971.038246:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788271971.038249:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788271971.038252:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788271971.038275:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788271971.038278:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788271971.038280:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f6eb0cec000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788271971.038301:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 517 00000100:00080000:3.0:1788271971.038307:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788271971.038313:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8f6eb0cec000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788271971.038336:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d8313ea00 x1875138590201984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788271971.038345:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788271971.038348:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788271971.038349:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f6e812ab000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788271971.038352:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 517 00000100:00080000:3.0:1788271971.038355:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788271971.038358:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f6e812ab000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788271971.038368:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d8313f800 x1875138590202112/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788271971.038415:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3608:1875138590201472:0@lo:400:kworker.0 00000100:00100000:3.0:1788271971.038484:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271971.038523:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875138590202240:0@lo:400:kworker.0 00000100:00100000:3.0:1788271971.038548:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271971.038572:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788271971.038578:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590201600:0@lo:400:kworker.0 00000100:00100000:3.0:1788271971.038600:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271971.038644:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3608:1875138590202368:0@lo:400:kworker.0 00000100:00100000:3.0:1788271971.038810:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271971.038842:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875138590201728:0@lo:400:kworker.0 00000100:00100000:3.0:1788271971.038868:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271971.038896:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3606:1875138590202496:0@lo:400:kworker.0 00000100:00100000:3.0:1788271971.038920:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271971.038933:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788271971.038937:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590201856:0@lo:400:kworker.0 00000100:00100000:3.0:1788271971.039031:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271971.039105:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590201472 00000100:00100000:3.0:1788271971.039112:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590201472 00000100:00100000:3.0:1788271971.039221:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788271971.039231:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87095050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+21:3608:x1875138590201472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271971.039283:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87095050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+21:3608:x1875138590201472:12345-0@lo:400:kworker.0 Request processed in 53us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271971.039291:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788271971.039324:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590202240 00000100:00100000:3.0:1788271971.039328:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590202240 00000100:00100000:3.0:1788271971.039346:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590202368 00000100:00100000:3.0:1788271971.039348:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590202368 00000100:00100000:3.0:1788271971.039359:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590201728 00000100:00100000:3.0:1788271971.039361:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590201728 00000100:00100000:3.0:1788271971.039371:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590202496 00000100:00100000:3.0:1788271971.039372:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590202496 00000100:00100000:3.0:1788271971.039384:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788271971.039389:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875138590202240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271971.039422:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3608:x1875138590202240:12345-0@lo:400:kworker.0 Request processed in 32us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271971.039428:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788271971.039440:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788271971.039445:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875138590202368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271971.039472:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875138590202368:12345-0@lo:400:kworker.0 Request processed in 27us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271971.039487:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788271971.039499:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788271971.039505:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875138590201728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271971.039539:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875138590201728:12345-0@lo:400:kworker.0 Request processed in 34us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271971.039544:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788271971.039555:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788271971.039561:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1875138590202496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271971.039588:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3606:x1875138590202496:12345-0@lo:400:kworker.0 Request processed in 27us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271971.039594:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788271971.039611:0:17953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590201600 00000100:00100000:3.0:1788271971.039615:0:17953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590201600 00000100:00080000:2.0:1788271971.039800:0:3605:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788271971.039805:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3605:1875138590193536:0@lo:8:kworker.0 00000100:00100000:2.0:1788271971.039835:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3605:1875138590201984:0@lo:8:kworker.0 00000100:00100000:2.0:1788271971.039863:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271971.039891:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3605:1875138590202112:0@lo:8:kworker.0 00000100:00100000:2.0:1788271971.039911:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271971.039974:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590201984 00000100:00100000:2.0:1788271971.039978:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590201984 00000100:00100000:3.0:1788271971.042260:0:17953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590201856 00000100:00100000:3.0:1788271971.042272:0:17953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590201856 00000100:00100000:3.0:1788271971.042316:0:17953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788271971.042327:0:17953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590201600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271971.042445:0:17953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590201600:12345-0@lo:400:kworker.0 Request processed in 121us (3843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271971.042453:0:17953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788271971.042471:0:17953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788271971.042477:0:17953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590201856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271971.042504:0:17953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590201856:12345-0@lo:400:kworker.0 Request processed in 29us (3474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271971.042510:0:17953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788271971.042588:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590202112 00000100:00100000:3.0:1788271971.042592:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590202112 00000100:00100000:3.0:1788271971.042638:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788271971.042643:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83252300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3605:x1875138590202112:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788271971.042648:0:18722:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788271971.042666:0:18722:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00020000:3.0:1788271971.042673:0:18720:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788271971.053791:0:19409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788271971.053805:0:19409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3605:x1875138590201984:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788271971.053841:0:19409:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 532 last 0 00000020:00000080:1.0:1788271971.053873:0:19409:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x99288105fd38faf1 00002000:00100000:1.0:1788271971.053891:0:19409:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8f6d81d6e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113940 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1788271971.053895:0:19409:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1788271971.053898:0:19409:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788271971.054078:0:19409:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1788271971.054104:0:19409:0:(import.c:65:import_set_state_nolock()) ffff8f6d81d69800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788271971.054197:0:19409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3605:x1875138590201984:12345-0@lo:8:kworker.0 Request processed in 391us (14332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271971.054204:0:19409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788271971.055233:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590201856:0@lo:400:kworker.0 00010000:00080000:0.0:1788271971.055252:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d8313c000 x1875138590201728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271971.055273:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875138590201728:0@lo:400:kworker.0 00010000:00080000:0.0:1788271971.055285:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d8313e300 x1875138590202496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271971.055520:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3606:1875138590202496:0@lo:400:kworker.0 00000100:00100000:0.0:1788271971.055565:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590201600:0@lo:400:kworker.0 00010000:00080000:0.0:1788271971.055578:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d8313ed80 x1875138590202368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271971.055587:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3608:1875138590202368:0@lo:400:kworker.0 00000100:00100000:0.0:1788271971.055595:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3608:1875138590201472:0@lo:400:kworker.0 00010000:00080000:0.0:1788271971.055605:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d8313d180 x1875138590202240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271971.055644:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3608:1875138590202240:0@lo:400:kworker.0 00000100:00080000:0.0:1788271971.055676:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788271971.055681:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788271971.055684:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788271971.055687:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:2.0:1788271971.062265:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d8313ea00 x1875138590201984/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788271991 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271971.062282:0:3605:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788271971.062293:0:3605:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788271971.062303:0:3605:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788271971.062310:0:3605:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788271971.062314:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6eb0cec000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788271971.062349:0:3605:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788271971.062356:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3605:1875138590201984:0@lo:8:kworker.0 00000004:00080000:1.0:1788271971.062380:0:17954:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788271971.062482:0:17954:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 532151862418ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788271971.062489:0:17954:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1788271971.062586:0:17955:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788271971.062647:0:17955:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d839cce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17955:1875138590202752:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1788271971.062729:0:17955:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271971.062759:0:17955:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e83e9ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788271971.062960:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590202752 00000100:00100000:0.0:1788271971.062968:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590202752 00000100:00100000:0.0:1788271971.063020:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788271971.063030:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17955:x1875138590202752:12345-0@lo:7:osp-pre-0-1.0 00000100:00080000:2.0:1788271971.063163:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788271971.063265:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788271971.063277:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d839cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590202624:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788271971.063322:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271971.063355:0:18723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590202624 00000100:00100000:0.0:1788271971.063359:0:18723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590202624 00000100:00100000:0.0:1788271971.063383:0:18723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788271971.063389:0:18723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3606:x1875138590202624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788271971.063407:0:18723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788271971.063450:0:18723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3606:x1875138590202624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271971.063458:0:18723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788271971.063491:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d839cca80 x1875138590202624/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271987 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271971.063510:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d839cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590202624:0@lo:13:osp-pre-0-1.0 00002000:00080000:0.0:1788271971.066856:0:18722:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788271971.066866:0:18722:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788271971.066954:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17955:x1875138590202752:12345-0@lo:7:osp-pre-0-1.0 Request processed in 3922us (4221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271971.066964:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788271971.067019:0:17955:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d839cce00 x1875138590202752/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788271987 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271971.067034:0:17955:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d839cce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17955:1875138590202752:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1788271971.067062:0:17955:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788271971.067103:0:17955:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d839cce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17955:1875138590202880:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788271971.067134:0:17955:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271971.068017:0:17955:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84c8fcc0 going to sleep for 11 seconds 00000004:00080000:0.0:1788271971.069002:0:17945:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1788271971.070439:0:19409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590202880 00000100:00100000:1.0:1788271971.070451:0:19409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590202880 00000100:00100000:1.0:1788271971.070504:0:19409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788271971.070515:0:19409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17955:x1875138590202880:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788271971.070550:0:19409:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1788271971.070827:0:19409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17955:x1875138590202880:12345-0@lo:5:osp-pre-0-1.0 Request processed in 313us (3690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271971.070835:0:19409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788271971.074832:0:17955:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d839cce00 x1875138590202880/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788271987 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271971.074853:0:17955:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d839cce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17955:1875138590202880:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788271971.074870:0:17955:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788271971.074935:0:17955:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d839cce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17955:1875138590203008:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788271971.075000:0:17955:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271971.075031:0:17955:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84c8fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271971.075053:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590203008 00000100:00100000:0.0:1788271971.075060:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590203008 00000100:00100000:0.0:1788271971.075104:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788271971.075112:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17955:x1875138590203008:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788271971.075149:0:18722:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1788271971.075853:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83252300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3605:x1875138590202112:12345-0@lo:8:kworker.0 Request processed in 33206us (35938us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788271971.075863:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788271971.080398:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6e812ab000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788271971.080410:0:3605:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788271971.080416:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3605:1875138590202112:0@lo:8:kworker.0 00000001:00080000:2.0:1788271971.109280:0:18716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1788271971.109476:0:18716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788271971.110263:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17955:x1875138590203008:12345-0@lo:5:osp-pre-0-1.0 Request processed in 35146us (35257us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788271971.110276:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788271971.110840:0:17955:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d839cce00 x1875138590203008/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788271987 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271971.110855:0:17955:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788271971.110863:0:17955:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d839cce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17955:1875138590203008:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788271971.110881:0:17955:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1788271971.110939:0:17955:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d839cce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17955:1875138590203136:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788271971.111068:0:17955:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271971.111102:0:17955:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84c8fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271971.111161:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590203136 00000100:00100000:2.0:1788271971.111178:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590203136 00000100:00100000:2.0:1788271971.111222:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788271971.111232:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17955:x1875138590203136:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788271971.111302:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17955:x1875138590203136:12345-0@lo:900:osp-pre-0-1.0 Request processed in 63us (225us total) trans 0 rc 0/0 00010000:00080000:0.0:1788271971.111304:0:17955:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d839cce00 x1875138590203136/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788271987 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271971.111314:0:17955:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d839cce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17955:1875138590203136:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788271971.111321:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788271971.870874:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788271971.870897:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590203264:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788271971.870961:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271971.871003:0:17953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590203264 00000100:00100000:3.0:1788271971.871009:0:17953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590203264 00000100:00100000:3.0:1788271971.871048:0:17953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788271971.871056:0:17953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590203264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788271971.871087:0:17953:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788271971.871127:0:17953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590203264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271971.871134:0:17953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788271971.871177:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590203264:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788271971.871287:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788271971.873723:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83251f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590203392:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788271971.873799:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271971.873832:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590203392 00000100:00100000:2.0:1788271971.873840:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590203392 00000100:00100000:2.0:1788271971.873933:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788271971.873944:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590203392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788271971.873977:0:17217:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788271971.874035:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590203392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271971.874042:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788271971.874105:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83251f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590203392:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788271971.936087:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788271972.901613:0:19534:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788271972.901663:0:19534:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788271972.901666:0:19534:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788271972.901785:0:19534:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f6d81d68000 00000020:01000004:1.0:1788271972.901802:0:19534:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788271972.901818:0:19534:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788271972.901832:0:19534:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8f6ea6bf19b8) 00000020:00000080:1.0:1788271972.901849:0:19534:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788271972.953691:0:19534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788271972.956670:0:19534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788271972.957053:0:19534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788271972.957915:0:19534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00010000:00010000:1.0:1788271972.958192:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788271972.958391:0:19534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788271972.958647:0:19534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788271972.958904:0:19534:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:2.0:1788271972.960509:0:19534:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788271972.961289:0:19534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788271972.961303:0:19534:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788271972.961316:0:19534:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x99288105fd38faff 00000020:01000004:2.0:1788271972.961324:0:19534:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788271972.961346:0:19534:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.103@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788271972.961350:0:19534:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.103@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788271972.961357:0:19534:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788271972.961389:0:19534:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1788271972.961393:0:19534:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.103@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788271972.981767:0:19534:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.103@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788271972.981821:0:19534:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.103@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788271972.981824:0:19534:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788271972.981826:0:19534:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788271972.981827:0:19534:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788271972.981828:0:19534:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788271972.981829:0:19534:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788271972.981830:0:19534:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788271972.981838:0:19534:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788271972.981840:0:19534:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788271972.981841:0:19534:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788271972.981844:0:19534:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788271972.981846:0:19534:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788271972.981847:0:19534:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788271972.981848:0:19534:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788271972.981848:0:19534:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788271972.981849:0:19534:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788271972.981850:0:19534:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788271972.981851:0:19534:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788271972.981851:0:19534:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788271972.981852:0:19534:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788271972.981884:0:19534:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788271972.981905:0:19534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:19534:1875138590203520:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788271972.981974:0:19534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271972.982025:0:19534:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84611d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788271972.982073:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590203520 00000100:00100000:1.0:1788271972.982082:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590203520 00000100:00100000:1.0:1788271972.982137:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788271972.982146:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e8528c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+21:19534:x1875138590203520:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788271972.982175:0:17204:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788271972.982179:0:17204:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788271972.982183:0:17204:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788271972.982542:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e8528c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+21:19534:x1875138590203520:12345-0@lo:253:mount.lustre.0 Request processed in 394us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271972.982550:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788271972.982661:0:19534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:19534:1875138590203520:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788271972.982673:0:19534:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788271972.982676:0:19534:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788271972.982677:0:19534:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788271972.982678:0:19534:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788271972.982679:0:19534:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788271972.982681:0:19534:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788271972.982689:0:19534:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788271972.982690:0:19534:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788271972.982691:0:19534:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788271972.982692:0:19534:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788271972.982710:0:19534:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f6d81d68000 from lustre-OST0001 10000000:01000000:1.0:1788271972.982736:0:19534:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788271972.982739:0:19534:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788271972.982747:0:19534:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f6eb4174d28 local copy 00010000:00010000:1.0:1788271972.982757:0:19534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6400/0x99288105fd38f819 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f820 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271972.982834:0:19534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83393100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:19534:1875138590203648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788271972.982864:0:19534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271972.982892:0:19534:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830e6840 going to sleep for 11 seconds 00000100:00100000:3.0:1788271972.982943:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590203648 00000100:00100000:3.0:1788271972.982949:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590203648 00000100:00100000:3.0:1788271972.982982:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788271972.982990:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e8528d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+21:19534:x1875138590203648:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788271972.983063:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e8528d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+21:19534:x1875138590203648:12345-0@lo:501:mount.lustre.0 Request processed in 74us (198us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788271972.983069:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788271972.983140:0:19534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83393100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:19534:1875138590203648:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788271972.983152:0:19534:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.103@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788271972.983168:0:19534:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.103@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788271972.983174:0:19534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6400/0x99288105fd38f819 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f820 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271972.983184:0:19534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6400/0x99288105fd38f819 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38f820 expref: -99 pid: 17190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271972.983208:0:19534:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f6d81d68000 10000000:01000000:1.0:1788271972.983213:0:19534:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788271972.983218:0:19534:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788271972.983220:0:19534:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788271972.983224:0:19534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788271972.983227:0:19534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788271972.983247:0:19534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4a00/0x99288105fd38fb06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271972.983261:0:19534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4a00/0x99288105fd38fb06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271972.983270:0:19534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4a00/0x99288105fd38fb06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271972.983282:0:19534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83393100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:19534:1875138590203776:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788271972.983307:0:19534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271972.983328:0:19534:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830e6840 going to sleep for 11 seconds 00000100:00100000:3.0:1788271972.983376:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590203776 00000100:00100000:3.0:1788271972.983380:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590203776 00000100:00100000:3.0:1788271972.983407:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788271972.983413:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e8528fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+21:19534:x1875138590203776:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788271972.983422:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271972.983434:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6d830c5400/0x99288105fd38fb0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38fb06 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271972.983486:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6d830c5400/0x99288105fd38fb0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38fb06 expref: 22 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271972.983498:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6d830c5400/0x99288105fd38fb0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38fb06 expref: 22 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271972.983507:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c5400, rc 0) 00000100:00100000:3.0:1788271972.983543:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e8528fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+22:19534:x1875138590203776:12345-0@lo:101:mount.lustre.0 Request processed in 129us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271972.983549:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788271972.983720:0:19534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83393100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:19534:1875138590203776:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788271972.983731:0:19534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4a00/0x99288105fd38fb06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fb0d expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271972.983740:0:19534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4a00/0x99288105fd38fb06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38fb0d expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788271972.984965:0:19534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788271972.985468:0:19534:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788271972.990232:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788271972.990274:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788271972.990283:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788271972.990290:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788271972.990298:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788271972.990304:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788271972.990322:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788271972.990325:0:19534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788271972.990411:0:19534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83393100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:19534:1875138590203904:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788271972.990472:0:19534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271972.990509:0:19534:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e8a366240 going to sleep for 11 seconds 00000100:00100000:3.0:1788271972.994261:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590203904 00000100:00100000:3.0:1788271972.994276:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590203904 00000100:00100000:3.0:1788271972.994337:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788271972.994348:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e8528f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+22:19534:x1875138590203904:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788271972.994552:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e8528f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+22:19534:x1875138590203904:12345-0@lo:501:mount.lustre.0 Request processed in 204us (4077us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271972.994561:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788271972.994574:0:19534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83393100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:19534:1875138590203904:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788271972.994653:0:19534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83393100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:19534:1875138590204032:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788271972.994700:0:19534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271972.994914:0:19534:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e8a366240 going to sleep for 11 seconds 00000100:00100000:3.0:1788271972.994968:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590204032 00000100:00100000:3.0:1788271972.994973:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590204032 00000100:00100000:3.0:1788271972.995005:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788271972.995013:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e8528ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+22:19534:x1875138590204032:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788271972.995726:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e8528ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+22:19534:x1875138590204032:12345-0@lo:503:mount.lustre.0 Request processed in 713us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271972.995733:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788271972.996003:0:19534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83393100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:19534:1875138590204032:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788271972.996390:0:19534:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788271972.996461:0:19534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83393100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:19534:1875138590204160:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788271972.996502:0:19534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271972.996575:0:19534:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e8a366240 going to sleep for 11 seconds 00000100:00100000:3.0:1788271973.001766:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590204160 00000100:00100000:3.0:1788271973.001780:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590204160 00000100:00100000:3.0:1788271973.003592:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788271973.003605:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e8528d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+22:19534:x1875138590204160:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788271973.004144:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e8528d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+22:19534:x1875138590204160:12345-0@lo:502:mount.lustre.0 Request processed in 540us (7639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271973.004153:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788271973.004169:0:19534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83393100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:19534:1875138590204160:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788271973.004363:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788271973.004386:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788271973.004393:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788271973.004403:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788271973.004416:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788271973.004429:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788271973.004442:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788271973.004457:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788271973.004471:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1788271973.004503:0:19534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83393100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:19534:1875138590204288:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788271973.004540:0:19534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271973.004572:0:19534:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e8a366240 going to sleep for 11 seconds 00000100:00100000:3.0:1788271973.004603:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590204288 00000100:00100000:3.0:1788271973.004610:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590204288 00000100:00100000:3.0:1788271973.004674:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788271973.004681:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e8528c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+22:19534:x1875138590204288:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788271973.004752:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e8528c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+22:19534:x1875138590204288:12345-0@lo:502:mount.lustre.0 Request processed in 70us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271973.004760:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788271973.004765:0:19534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83393100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:19534:1875138590204288:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788271973.004795:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1788271973.004801:0:19534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1788271973.005682:0:19538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788271973.005689:0:19538:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1788271973.005695:0:19538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271973.005696:0:19538:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788271973.005700:0:19538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788271973.005711:0:19538:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8f6ea6bf4d28) 00000020:00000080:1.0:1788271973.005729:0:19538:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788271973.005733:0:19538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788271973.005790:0:19538:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f6d81d68000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788271973.005796:0:19538:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788271973.005800:0:19538:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x99288105fd38fb1b 00010000:00010000:1.0:1788271973.008434:0:19538:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1788271973.008943:0:19538:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967326 00080000:10000000:1.0:1788271973.010165:0:19538:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1788271973.011094:0:19538:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788271973.011106:0:19538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788271973.011112:0:19538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271973.011114:0:19538:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788271973.011117:0:19538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788271973.011120:0:19538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271973.011122:0:19538:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788271973.011125:0:19538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788271973.011126:0:19538:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788271973.011128:0:19538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788271973.011131:0:19538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271973.011132:0:19538:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788271973.011134:0:19538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788271973.011136:0:19538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271973.011137:0:19538:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788271973.011140:0:19538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788271973.011161:0:19538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788271973.011164:0:19538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788271973.011165:0:19538:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788271973.011174:0:19538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1788271973.012827:0:19534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788271973.012882:0:19534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788271973.012903:0:19534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4a00/0x99288105fd38fb06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fb0d expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271973.012916:0:19534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed4a00/0x99288105fd38fb06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fb0d expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788271973.012924:0:19534:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f6d81d68000 from 1 10000000:01000000:3.0:1788271973.012927:0:19534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788271973.012966:0:19534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4200/0x99288105fd38fb22 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271973.012973:0:19534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4200/0x99288105fd38fb22 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271973.012986:0:19534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4200/0x99288105fd38fb22 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271973.013018:0:19534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:19534:1875138590204416:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788271973.013086:0:19534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271973.013138:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590204416 00000100:00100000:3.0:1788271973.013144:0:19534:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc8ba0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271973.013147:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590204416 00000100:00100000:0.0:1788271973.013205:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788271973.013214:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e851a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+22:19534:x1875138590204416:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788271973.013228:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271973.013241:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6e8511d000/0x99288105fd38fb29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38fb22 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271973.013265:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6e8511d000/0x99288105fd38fb29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38fb22 expref: 23 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271973.013275:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6e8511d000/0x99288105fd38fb29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38fb22 expref: 23 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271973.013284:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e8511d000, rc 0) 00000100:00100000:0.0:1788271973.013332:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e851a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+23:19534:x1875138590204416:12345-0@lo:101:mount.lustre.0 Request processed in 119us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271973.013338:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788271973.013662:0:19534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:19534:1875138590204416:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788271973.013676:0:19534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4200/0x99288105fd38fb22 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fb29 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271973.013685:0:19534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4200/0x99288105fd38fb22 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38fb29 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788271973.014710:0:19534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788271973.014989:0:19534:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788271973.015203:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788271973.015232:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788271973.015251:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788271973.015257:0:19534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788271973.015323:0:19534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:19534:1875138590204544:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788271973.015376:0:19534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271973.015420:0:19534:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9828e780 going to sleep for 11 seconds 00000100:00100000:1.0:1788271973.015428:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590204544 00000100:00100000:1.0:1788271973.015436:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590204544 00000100:00100000:1.0:1788271973.015478:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788271973.015487:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e851a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+23:19534:x1875138590204544:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788271973.015588:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e851a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+23:19534:x1875138590204544:12345-0@lo:501:mount.lustre.0 Request processed in 102us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271973.015596:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788271973.015664:0:19534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:19534:1875138590204544:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788271973.015693:0:19534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d839cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:19534:1875138590204672:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788271973.015723:0:19534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271973.015759:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590204672 00000100:00100000:1.0:1788271973.015763:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590204672 00000100:00100000:1.0:1788271973.015795:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788271973.015803:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e851a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+23:19534:x1875138590204672:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788271973.015869:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e851a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+23:19534:x1875138590204672:12345-0@lo:503:mount.lustre.0 Request processed in 67us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271973.015875:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788271973.016041:0:19534:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb35bdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788271973.016059:0:19534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d839cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:19534:1875138590204672:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788271973.016300:0:19534:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788271973.016341:0:19534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d839cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:19534:1875138590204800:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788271973.016365:0:19534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271973.016382:0:19534:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb35bdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788271973.016396:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590204800 00000100:00100000:1.0:1788271973.016401:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590204800 00000100:00100000:1.0:1788271973.016431:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788271973.016437:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e851a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+23:19534:x1875138590204800:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788271973.016509:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e851a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+23:19534:x1875138590204800:12345-0@lo:502:mount.lustre.0 Request processed in 71us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271973.016516:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788271973.016535:0:19534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d839cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:19534:1875138590204800:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788271973.016693:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788271973.016715:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788271973.016728:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788271973.016740:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788271973.016750:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788271973.016766:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788271973.016774:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788271973.016780:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1788271973.016787:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788271973.016793:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1788271973.016800:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1788271973.016898:0:19534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d839cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:19534:1875138590204928:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788271973.016925:0:19534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271973.016976:0:19534:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb35bdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788271973.017000:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590204928 00000100:00100000:2.0:1788271973.017008:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590204928 00000100:00100000:2.0:1788271973.017036:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788271973.017043:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e851a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+23:19534:x1875138590204928:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788271973.017180:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e851a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+23:19534:x1875138590204928:12345-0@lo:502:mount.lustre.0 Request processed in 139us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271973.017185:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788271973.017225:0:19534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d839cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:19534:1875138590204928:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788271973.017259:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1788271973.017266:0:19534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788271973.018699:0:19542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788271973.018708:0:19542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271973.018710:0:19542:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788271973.018718:0:19542:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f6d81d68000 00000020:00000080:3.0:1788271973.018721:0:19542:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788271973.018729:0:19542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788271973.018732:0:19542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271973.018733:0:19542:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788271973.018735:0:19542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788271973.018746:0:19542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271973.018748:0:19542:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788271973.018752:0:19542:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f6d81d68000 00000020:00000080:3.0:1788271973.018754:0:19542:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788271973.018805:0:19542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788271973.018809:0:19542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271973.018810:0:19542:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788271973.018813:0:19542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788271973.018815:0:19542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271973.018817:0:19542:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788271973.018821:0:19542:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f6d81d68000 00000020:00000080:3.0:1788271973.018824:0:19542:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788271973.018842:0:19542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788271973.018845:0:19542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271973.018846:0:19542:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788271973.018849:0:19542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788271973.018851:0:19542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271973.018853:0:19542:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788271973.018855:0:19542:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f6d81d68000 00000020:00000080:3.0:1788271973.018858:0:19542:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788271973.018943:0:19542:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788271973.018947:0:19542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788271973.018949:0:19542:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788271973.018953:0:19542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1788271973.019032:0:19534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788271973.019064:0:19534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788271973.019078:0:19534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4200/0x99288105fd38fb22 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fb29 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271973.019090:0:19534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4200/0x99288105fd38fb22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fb29 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271973.019145:0:19534:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788271973.019148:0:19534:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f6d81d68000 10000000:01000000:1.0:1788271973.019151:0:19534:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f6d81d68000 10000000:01000000:1.0:1788271973.019155:0:19534:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788271973.019161:0:19534:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f6d81d68000 from 1 10000000:01000000:1.0:1788271973.019163:0:19534:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788271973.019192:0:19534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5800/0x99288105fd38fb30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271973.019200:0:19534:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5800/0x99288105fd38fb30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271973.019210:0:19534:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5800/0x99288105fd38fb30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271973.019239:0:19534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83393100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:19534:1875138590205056:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788271973.019285:0:19534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271973.019321:0:19534:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e82b8b840 going to sleep for 11 seconds 00000100:00100000:3.0:1788271973.019844:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590205056 00000100:00100000:3.0:1788271973.019850:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590205056 00000100:00100000:3.0:1788271973.021678:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788271973.021695:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+23:19534:x1875138590205056:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788271973.021713:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271973.021730:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6d830c4800/0x99288105fd38fb37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38fb30 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271973.021770:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6d830c4800/0x99288105fd38fb37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38fb30 expref: 24 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271973.021782:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6d830c4800/0x99288105fd38fb37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38fb30 expref: 24 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271973.021792:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c4800, rc 0) 00000100:00100000:3.0:1788271973.021867:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+24:19534:x1875138590205056:12345-0@lo:101:mount.lustre.0 Request processed in 180us (2582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271973.021874:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788271973.021965:0:19534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83393100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:19534:1875138590205056:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788271973.021983:0:19534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5800/0x99288105fd38fb30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fb37 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271973.021994:0:19534:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5800/0x99288105fd38fb30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38fb37 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788271973.026322:0:19534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:2.0:1788271973.026654:0:19534:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788271973.026859:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788271973.026885:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788271973.026898:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788271973.026912:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788271973.026925:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788271973.026939:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788271973.026965:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788271973.026981:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788271973.026995:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788271973.027006:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788271973.027018:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788271973.027031:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788271973.027044:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788271973.027057:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788271973.027069:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788271973.027092:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788271973.027106:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788271973.027119:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788271973.027133:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788271973.027146:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788271973.027160:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788271973.027174:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788271973.027198:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788271973.027213:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788271973.027226:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1788271973.027240:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1788271973.027253:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1788271973.027266:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1788271973.027279:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1788271973.027293:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1788271973.027308:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1788271973.027322:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1788271973.027337:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1788271973.027350:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1788271973.027364:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1788271973.027377:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1788271973.027390:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1788271973.027404:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1788271973.027430:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:2.0:1788271973.027446:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:2.0:1788271973.027459:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:2.0:1788271973.027472:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:2.0:1788271973.027486:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:2.0:1788271973.027500:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:2.0:1788271973.027514:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:2.0:1788271973.027528:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:2.0:1788271973.027550:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:2.0:1788271973.027555:0:19534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:2.0:1788271973.027682:0:19534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83252d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:19534:1875138590205184:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788271973.027755:0:19534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271973.027809:0:19534:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb36a80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271973.028652:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590205184 00000100:00100000:3.0:1788271973.028660:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590205184 00000100:00100000:1.0:1788271973.028737:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788271973.028751:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+24:19534:x1875138590205184:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788271973.028892:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+24:19534:x1875138590205184:12345-0@lo:501:mount.lustre.0 Request processed in 144us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271973.028900:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788271973.029353:0:19534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83252d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:19534:1875138590205184:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788271973.029399:0:19534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:19534:1875138590205312:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788271973.029448:0:19534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271973.029480:0:19534:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9828e000 going to sleep for 11 seconds 00000100:00100000:3.0:1788271973.029496:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590205312 00000100:00100000:3.0:1788271973.029500:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590205312 00000100:00100000:3.0:1788271973.029547:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788271973.029556:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+24:19534:x1875138590205312:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788271973.029675:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+24:19534:x1875138590205312:12345-0@lo:503:mount.lustre.0 Request processed in 120us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271973.029682:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788271973.029725:0:19534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:19534:1875138590205312:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788271973.030279:0:19534:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788271973.030350:0:19534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:19534:1875138590205440:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788271973.030393:0:19534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271973.030419:0:19534:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9828e000 going to sleep for 11 seconds 00000100:00100000:3.0:1788271973.030846:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590205440 00000100:00100000:3.0:1788271973.030851:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590205440 00000100:00100000:3.0:1788271973.031567:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788271973.031579:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+24:19534:x1875138590205440:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788271973.031734:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+24:19534:x1875138590205440:12345-0@lo:502:mount.lustre.0 Request processed in 158us (1341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271973.031752:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788271973.038730:0:19534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:19534:1875138590205440:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788271973.038961:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788271973.038992:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788271973.039008:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788271973.039023:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788271973.039038:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788271973.039053:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788271973.039068:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788271973.039081:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788271973.039094:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788271973.039108:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788271973.039122:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788271973.039138:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788271973.039152:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788271973.039166:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788271973.039192:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788271973.039204:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788271973.039215:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788271973.039300:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788271973.039320:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788271973.039333:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788271973.039346:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788271973.039357:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788271973.039368:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788271973.039380:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788271973.039391:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1788271973.039401:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1788271973.039414:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1788271973.039435:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1788271973.039448:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1788271973.039461:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1788271973.039489:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1788271973.039505:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1788271973.039520:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1788271973.039534:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1788271973.039548:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1788271973.039563:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788271973.039577:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1788271973.039591:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1788271973.039606:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1788271973.039654:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1788271973.039675:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1788271973.039692:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1788271973.039710:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1788271973.039725:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1788271973.039739:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1788271973.039754:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1788271973.039781:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1788271973.039798:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1788271973.039853:0:19534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:19534:1875138590205568:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788271973.039925:0:19534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271973.039972:0:19534:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb36a8000 going to sleep for 11 seconds 00000100:00100000:0.0:1788271973.040331:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590205568 00000100:00100000:0.0:1788271973.040338:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590205568 00000100:00100000:0.0:1788271973.040394:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788271973.040404:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+24:19534:x1875138590205568:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788271973.040614:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+24:19534:x1875138590205568:12345-0@lo:502:mount.lustre.0 Request processed in 211us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271973.040650:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788271973.040686:0:19534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:19534:1875138590205568:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788271973.040852:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1788271973.040877:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1788271973.040902:0:19534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:19534:1875138590205696:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788271973.040937:0:19534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271973.040970:0:19534:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb36a8000 going to sleep for 11 seconds 00000100:00100000:3.0:1788271973.041405:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590205696 00000100:00100000:3.0:1788271973.041411:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590205696 00000100:00100000:3.0:1788271973.041453:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788271973.041463:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+24:19534:x1875138590205696:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788271973.041692:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+24:19534:x1875138590205696:12345-0@lo:502:mount.lustre.0 Request processed in 229us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271973.041700:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788271973.041846:0:19534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:19534:1875138590205696:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788271973.041893:0:19534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1788271973.041902:0:19534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788271973.044574:0:19547:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788271973.044590:0:19547:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8f6eb3cd3370) 00000020:00000080:2.0:1788271973.044644:0:19547:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1788271973.044733:0:19547:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f6d81d68000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788271973.044738:0:19547:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f6d81d68000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788271973.044742:0:19547:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f6d81d68000 3 00010000:00080000:2.0:1788271973.044772:0:19547:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f6d81dd4000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.103@tcp at head 00010000:00010000:2.0:1788271973.048684:0:19547:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1788271973.048878:0:19547:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788271973.048924:0:19547:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788271973.048938:0:19547:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x99288105fd38fb45 00000100:00080000:2.0:1788271973.048948:0:19547:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788271973.048954:0:19547:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f6d81dd4000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:2.0:1788271973.048986:0:19547:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d83253b80 x1875138590205824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788271973.049008:0:19547:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788271973.050655:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3605:1875138590205824:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788271973.050731:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271973.050814:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590205824 00000100:00100000:2.0:1788271973.050822:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590205824 00000100:00080000:0.0:1788271973.050827:0:17749:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788271973.050832:0:17749:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788271973.050835:0:17749:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788271973.050839:0:17749:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788271973.050863:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788271973.050872:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3605:x1875138590205824:12345-0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788271973.050881:0:17749:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788271973.050885:0:17749:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788271973.050888:0:17749:0:(import.c:65:import_set_state_nolock()) ffff8f6e812ab000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788271973.050893:0:17749:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 532 00010000:00080000:2.0:1788271973.050896:0:17211:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 534 last 0 00000100:00080000:0.0:1788271973.050899:0:17749:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788271973.050907:0:17749:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f6e812ab000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:0.0:1788271973.050926:0:17749:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d839cdc00 x1875138590206464/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:2.0:1788271973.050956:0:17211:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x99288105fd38fb4c 00000004:00100000:2.0:1788271973.050973:0:17211:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788271973.051012:0:17211:0:(import.c:65:import_set_state_nolock()) ffff8f6d81e26800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788271973.051066:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3605:x1875138590205824:12345-0@lo:38:llog_process_th.0 Request processed in 195us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271973.051074:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000004:3.0:1788271973.051731:0:19547:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788271973.051746:0:19547:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8f6d82353370) 00000020:00000080:3.0:1788271973.051766:0:19547:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1788271973.051847:0:19547:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f6d81d68000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788271973.051852:0:19547:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f6d81d68000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788271973.051854:0:19547:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f6d81d68000 3 00010000:00080000:3.0:1788271973.051879:0:19547:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f6d81dd1000@lustre-MDT0001-lwp-OST0001: add connection 192.168.201.103@tcp at head 00000100:00100000:0.0:1788271973.054061:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d839cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590205952:0@lo:400:kworker.0 00000100:00100000:0.0:1788271973.054132:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271973.054169:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ecfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875138590206592:0@lo:400:kworker.0 00000100:00100000:0.0:1788271973.054195:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271973.054220:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788271973.056682:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d839cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875138590206080:0@lo:400:kworker.0 00000100:00100000:0.0:1788271973.056755:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271973.056796:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3606:1875138590206720:0@lo:400:kworker.0 00000100:00100000:0.0:1788271973.056818:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271973.056862:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d839cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590206208:0@lo:400:kworker.0 00000100:00100000:0.0:1788271973.056889:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271973.056908:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3608:1875138590206848:0@lo:400:kworker.0 00000100:00100000:0.0:1788271973.056929:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271973.056947:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788271973.056953:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d839cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590206336:0@lo:400:kworker.0 00000100:00100000:0.0:1788271973.056976:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271973.057010:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d839cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3605:1875138590206464:0@lo:8:kworker.0 00000100:00100000:0.0:1788271973.057036:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788271973.057081:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d83253b80 x1875138590205824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788271983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271973.057093:0:3605:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788271973.057103:0:3605:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788271973.057111:0:3605:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788271973.057116:0:3605:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788271973.057120:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6d81dd4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788271973.057127:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3605:1875138590205824:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788271973.057267:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590205952 00000100:00100000:0.0:1788271973.057273:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590205952 00000100:00100000:0.0:1788271973.057318:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590206208 00000100:00100000:0.0:1788271973.057321:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590206208 00000100:00100000:0.0:1788271973.057338:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788271973.057352:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590205952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271973.057408:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590205952:12345-0@lo:400:kworker.0 Request processed in 56us (3276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271973.057415:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788271973.057431:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788271973.057436:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590206208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271973.057467:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590206208:12345-0@lo:400:kworker.0 Request processed in 31us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271973.057472:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788271973.057488:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590206592 00000100:00100000:0.0:1788271973.057491:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590206592 00000100:00100000:0.0:1788271973.057508:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590206080 00000100:00100000:0.0:1788271973.057510:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590206080 00000100:00100000:0.0:1788271973.057520:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590206720 00000100:00100000:0.0:1788271973.057522:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590206720 00000100:00100000:0.0:1788271973.057543:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590206848 00000100:00100000:0.0:1788271973.057545:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590206848 00000100:00100000:0.0:1788271973.057558:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788271973.057564:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1875138590206592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271973.057595:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1875138590206592:12345-0@lo:400:kworker.0 Request processed in 31us (3399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271973.057600:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788271973.057612:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1788271973.057993:0:19547:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1788271973.058170:0:19547:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1788271973.058215:0:19547:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788271973.058227:0:19547:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x99288105fd38fb5a 00000100:00080000:3.0:1788271973.058239:0:19547:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788271973.058245:0:19547:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8f6d81dd1000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788271973.058283:0:19547:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d8313d500 x1875138590206976/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788271973.058304:0:19547:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788271973.058822:0:19409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590206336 00000100:00100000:1.0:1788271973.058829:0:19409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590206336 00000100:00100000:1.0:1788271973.058865:0:19409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590206464 00000100:00100000:1.0:1788271973.058869:0:19409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590206464 00000100:00100000:1.0:1788271973.058886:0:19409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788271973.058903:0:19409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82339180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590206336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271973.058958:0:19409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82339180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590206336:12345-0@lo:400:kworker.0 Request processed in 57us (1980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271973.058965:0:19409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788271973.058978:0:19409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788271973.058982:0:19409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3605:x1875138590206464:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788271973.059022:0:19409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3605:x1875138590206464:12345-0@lo:8:kworker.0 Request processed in 39us (1985us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788271973.059028:0:19409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788271973.060269:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875138590206080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271973.060327:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3606:x1875138590206080:12345-0@lo:400:kworker.0 Request processed in 2709us (3572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271973.060335:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788271973.060361:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788271973.060369:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8233b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1875138590206720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271973.060398:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8233b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3606:x1875138590206720:12345-0@lo:400:kworker.0 Request processed in 31us (3580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271973.060405:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788271973.060415:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788271973.060422:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8233b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875138590206848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271973.060449:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8233b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875138590206848:12345-0@lo:400:kworker.0 Request processed in 28us (3519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271973.060454:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1788271973.060484:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788271973.060489:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788271973.060491:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788271973.060504:0:17749:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788271973.060508:0:17749:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788271973.060511:0:17749:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788271973.060514:0:17749:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:0.0:1788271973.060854:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d839cd500 x1875138590206336/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271973.060869:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d839cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590206336:0@lo:400:kworker.0 00000100:00100000:0.0:1788271973.060883:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d839cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590206208:0@lo:400:kworker.0 00010000:00080000:0.0:1788271973.060893:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d82ecc380 x1875138590206848/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271973.060901:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3608:1875138590206848:0@lo:400:kworker.0 00000100:00100000:0.0:1788271973.060944:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3605:1875138590206976:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788271973.060987:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271973.061025:0:3605:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788271973.061031:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6e812ab000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788271973.061036:0:3605:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788271973.061040:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d839cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3605:1875138590206464:0@lo:8:kworker.0 00010000:00080000:0.0:1788271973.061070:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d839cc700 x1875138590206080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271973.061079:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d839cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3606:1875138590206080:0@lo:400:kworker.0 00010000:00080000:0.0:1788271973.061090:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d82ecd500 x1875138590206720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271973.061098:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ecd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3606:1875138590206720:0@lo:400:kworker.0 00000100:00100000:0.0:1788271973.061108:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d839cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590205952:0@lo:400:kworker.0 00010000:00080000:0.0:1788271973.061119:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d82ecfb80 x1875138590206592/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271973.061126:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ecfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875138590206592:0@lo:400:kworker.0 00000100:00100000:0.0:1788271973.061148:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590206976 00000100:00100000:0.0:1788271973.061153:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590206976 00000100:00100000:0.0:1788271973.061185:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788271973.061191:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3605:x1875138590206976:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788271973.061214:0:17213:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 534 last 0 00000020:00000080:0.0:1788271973.061245:0:17213:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x99288105fd38fb61 00000004:00100000:0.0:1788271973.061260:0:17213:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788271973.061297:0:17213:0:(import.c:65:import_set_state_nolock()) ffff8f6e983ba800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788271973.061340:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3605:x1875138590206976:12345-0@lo:38:llog_process_th.0 Request processed in 147us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271973.061347:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788271973.061371:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f6d8313d500 x1875138590206976/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788271983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271973.061379:0:3605:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788271973.061383:0:3605:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788271973.061390:0:3605:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788271973.061394:0:3605:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788271973.061396:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6d81dd1000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788271973.061401:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3605:1875138590206976:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788271973.061899:0:19547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1788271973.062685:0:19534:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788271973.062723:0:19534:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788271973.062841:0:19534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5800/0x99288105fd38fb30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fb37 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271973.062854:0:19534:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6eb4ed5800/0x99288105fd38fb30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fb37 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788271973.062907:0:19534:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788271973.062909:0:19534:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788271973.062910:0:19534:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788271973.062911:0:19534:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788271973.062913:0:19534:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788271973.062914:0:19534:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788271973.062916:0:19534:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788271973.062918:0:19534:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788271973.062920:0:19534:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788271973.062923:0:19534:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788271973.062930:0:19534:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788271973.062932:0:19534:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788271973.062933:0:19534:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788271973.062935:0:19534:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788271973.062936:0:19534:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788271973.062937:0:19534:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788271973.062938:0:19534:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788271973.062939:0:19534:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788271973.062940:0:19534:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788271973.062964:0:19534:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788271973.062983:0:19534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82339c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:19534:1875138590207104:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788271973.063042:0:19534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271973.063079:0:19534:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb3e87480 going to sleep for 11 seconds 00000100:00100000:3.0:1788271973.065769:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590207104 00000100:00100000:3.0:1788271973.065784:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590207104 00000100:00100000:3.0:1788271973.065842:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788271973.065853:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+24:19534:x1875138590207104:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788271973.065887:0:17205:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788271973.065901:0:17205:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788271973.073346:0:17205:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788271973.073393:0:17205:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788271973.073701:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+24:19534:x1875138590207104:12345-0@lo:253:mount.lustre.0 Request processed in 7845us (10655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271973.073714:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 20000000:01000000:3.0:1788271973.074066:0:17227:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788271973.074071:0:17227:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788271973.074094:0:17227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f6d830c4600/0x99288105fd38fb68 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271973.074111:0:17227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6eb4ed4400/0x99288105fd38fadc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38fad5 expref: 23 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271973.074119:0:17227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6e8511d400/0x99288105fd38faea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38fae3 expref: 23 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271973.074127:0:17227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f6d830c4600/0x99288105fd38fb68 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271973.074168:0:17227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6e8511d400/0x99288105fd38faea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38fae3 expref: 23 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271973.074183:0:17227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f6e8511d400/0x99288105fd38faea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38fae3 expref: 23 pid: 17204 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271973.074211:0:17227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1875138590207232:0@lo:104: 00000100:00100000:3.0:1788271973.074251:0:17227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788271973.074344:0:17227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6eb4ed4400/0x99288105fd38fadc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38fad5 expref: 23 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271973.074355:0:17227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f6eb4ed4400/0x99288105fd38fadc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38fad5 expref: 23 pid: 17205 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271973.074366:0:17227:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1875138590207360:0@lo:104: 00000100:00100000:3.0:1788271973.074393:0:17227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271973.074436:0:19534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82339c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08d4e6e3-b587-4543-a287-4a9ae9a31c24:19534:1875138590207104:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788271973.074450:0:19534:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788271973.074453:0:19534:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788271973.074455:0:19534:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788271973.074456:0:19534:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788271973.074457:0:19534:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788271973.074458:0:19534:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788271973.074460:0:19534:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788271973.074462:0:19534:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788271973.074464:0:19534:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788271973.074466:0:19534:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1788271973.074474:0:17227:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e84eb2240 going to sleep for 11 seconds 00000020:02000000:2.0:1788271973.074483:0:19534:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788271973.074548:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590207232 00000100:00100000:0.0:1788271973.074555:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590207232 00000100:00100000:0.0:1788271973.074590:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590207360 00000100:00100000:0.0:1788271973.074593:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590207360 00000100:00100000:0.0:1788271973.074606:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788271973.074615:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+4:17227:x1875138590207232:12345-0@lo:104: 00010000:00010000:0.0:1788271973.074660:0:17194:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5600/0x99288105fd38fae3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38faea expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271973.074715:0:17194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788271973.074721:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+4:17227:x1875138590207232:12345-0@lo:104: Request processed in 108us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271973.074727:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788271973.074740:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788271973.074754:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+3:17227:x1875138590207360:12345-0@lo:104: 00010000:00010000:0.0:1788271973.074761:0:17194:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7800/0x99288105fd38fad5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38fadc expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271973.074792:0:17194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788271973.074796:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+3:17227:x1875138590207360:12345-0@lo:104: Request processed in 44us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271973.074802:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788271973.074834:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788271973.074840:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5600/0x99288105fd38fae3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38faea expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271973.074847:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c5600 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:0.0:1788271973.074861:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5600/0x99288105fd38fae3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38faea expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271973.074876:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5600/0x99288105fd38fae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38faea expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788271973.074884:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5600/0x99288105fd38fae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38faea expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271973.074891:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788271973.074919:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5600/0x99288105fd38fae3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38faea expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271973.074926:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788271973.074944:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5600/0x99288105fd38fae3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38faea expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271973.074960:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5600/0x99288105fd38fae3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38faea expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271973.074972:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271973.074975:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7800/0x99288105fd38fad5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38fadc expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271973.074981:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f7800 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:0.0:1788271973.074984:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7800/0x99288105fd38fad5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38fadc expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271973.074991:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7800/0x99288105fd38fad5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38fadc expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788271973.074998:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7800/0x99288105fd38fad5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38fadc expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271973.075003:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788271973.075016:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7800/0x99288105fd38fad5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38fadc expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271973.075021:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788271973.075035:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7800/0x99288105fd38fad5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38fadc expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271973.075042:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6d833f7800/0x99288105fd38fad5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38fadc expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271973.075053:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271973.075060:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271973.075062:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271973.075075:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3609:1875138590207488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788271973.075105:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271973.075134:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590207488 00000100:00100000:0.0:1788271973.075138:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590207488 00010000:00010000:0.0:1788271973.075154:0:17197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6e8511d400/0x99288105fd38faea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38fae3 expref: 24 pid: 17204 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271973.075175:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788271973.075181:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8233aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+24:3609:x1875138590207488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788271973.075191:0:17197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271973.075196:0:17197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6e8511d400/0x99288105fd38faea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38fae3 expref: 24 pid: 17204 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271973.075206:0:17197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6e8511d400/0x99288105fd38faea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38fae3 expref: 24 pid: 17204 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271973.075219:0:17197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271973.075245:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8233aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+24:3609:x1875138590207488:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271973.075251:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788271973.075268:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788271973.075275:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8233bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3607:1875138590207616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788271973.075296:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271973.075318:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590207616 00000100:00100000:0.0:1788271973.075321:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590207616 00010000:00010000:0.0:1788271973.075332:0:17196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6eb4ed4400/0x99288105fd38fadc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38fad5 expref: 24 pid: 17205 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271973.075363:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788271973.075370:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8233a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+24:3607:x1875138590207616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788271973.075392:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271973.075398:0:17196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6eb4ed4400/0x99288105fd38fadc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38fad5 expref: 24 pid: 17205 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271973.075408:0:17196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6eb4ed4400/0x99288105fd38fadc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38fad5 expref: 24 pid: 17205 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271973.075420:0:17196:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f6d830c4600/0x99288105fd38fb68 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271973.075428:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6d830c4600/0x99288105fd38fb68 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788271973.075442:0:17196:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002501695s 00010000:00010000:0.0:1788271973.075446:0:17196:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f6d830c4600/0x99288105fd38fb68 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271973.075454:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f6d830c4600/0x99288105fd38fb68 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271973.075461:0:17196:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f6d830c4600/0x99288105fd38fb68 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271973.075467:0:17196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f6d830c4600/0x99288105fd38fb68 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271973.075473:0:17196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4600 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:0.0:1788271973.075483:0:17196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f6d830c4600/0x99288105fd38fb68 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271973.075491:0:17196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f6d830c4600/0x99288105fd38fb68 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271973.075500:0:17196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f6d830c4600/0x99288105fd38fb68 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271973.075509:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271973.075537:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8233a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+24:3607:x1875138590207616:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271973.075544:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788271973.075573:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8233bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3607:1875138590207616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788271973.075594:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3609:1875138590207488:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788271973.076009:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6e8511d400/0x99288105fd38faea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38fae3 expref: 23 pid: 17204 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271973.076020:0:17227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1875138590207232:0@lo:104: 00010000:00010000:3.0:1788271973.076031:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6eb4ed4400/0x99288105fd38fadc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38fad5 expref: 22 pid: 17205 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271973.076040:0:17227:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1875138590207360:0@lo:104: 00010000:00010000:3.0:1788271973.076055:0:17227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f6d830c4600/0x99288105fd38fb68 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271973.076064:0:17227:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f6d830c4600/0x99288105fd38fb68 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271973.076070:0:17227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f6d830c4600/0x99288105fd38fb68 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271973.076086:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6d830c4600/0x99288105fd38fb68 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271973.076378:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1788271973.090465:0:19534:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788271973.093938:0:19534:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788271973.093948:0:19534:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788271973.093994:0:19534:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788271973.094037:0:19534:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.103@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788271973.094066:0:19534:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1788271973.094086:0:19534:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1788271973.099251:0:19534:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788271973.099489:0:19534:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:2.0:1788271973.933048:0:19600:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788271973.933278:0:19600:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788271973.985494:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271975.006490:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788271975.070728:0:17208:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788271975.070737:0:17208:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f6d82344800 from 10 10000000:01000000:0.0:1788271975.070743:0:17208:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788271975.070792:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e8511da00/0x99288105fd38fb6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271975.070817:0:17208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6e8511da00/0x99288105fd38fb6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271975.070829:0:17208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6e8511da00/0x99288105fd38fb6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271975.070867:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82338700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590207744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788271975.070938:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271975.071560:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830e6480 going to sleep for 11 seconds 00000100:00100000:1.0:1788271975.077493:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590207744 00000100:00100000:1.0:1788271975.077507:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590207744 00000100:00100000:1.0:1788271975.077571:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788271975.077591:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+22:17208:x1875138590207744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788271975.077609:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271975.077653:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4ed4600/0x99288105fd38fb76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38fb6f expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271975.077683:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4ed4600/0x99288105fd38fb76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38fb6f expref: 23 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271975.077696:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4ed4600/0x99288105fd38fb76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38fb6f expref: 23 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271975.077706:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4ed4600, rc 0) 00000100:00100000:1.0:1788271975.077791:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+23:17208:x1875138590207744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 211us (6852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271975.077814:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788271975.078008:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82338700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590207744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788271975.078030:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6e8511da00/0x99288105fd38fb6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fb76 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271975.078040:0:17208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6e8511da00/0x99288105fd38fb6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38fb76 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271975.078103:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82338700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590207872:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788271975.078144:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271975.078173:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830e6480 going to sleep for 11 seconds 00000100:00100000:0.0:1788271975.078187:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590207872 00000100:00100000:0.0:1788271975.078191:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590207872 00000100:00100000:0.0:1788271975.078219:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788271975.078226:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+23:17208:x1875138590207872:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788271975.078240:0:17205:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788271975.078257:0:17205:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788271975.078260:0:17205:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1788271975.078340:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+23:17208:x1875138590207872:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 114us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271975.078348:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788271975.078376:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82338700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590207872:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788271975.078434:0:17208:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788271975.078441:0:17208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e8511da00/0x99288105fd38fb6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fb76 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271975.078449:0:17208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6e8511da00/0x99288105fd38fb6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fb76 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271975.078458:0:17208:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788271975.078460:0:17208:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f6e851db000 from 10 10000000:01000000:0.0:1788271975.078463:0:17208:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788271975.078482:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e8511ca00/0x99288105fd38fb7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271975.078490:0:17208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6e8511ca00/0x99288105fd38fb7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271975.078498:0:17208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6e8511ca00/0x99288105fd38fb7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271975.078511:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82338700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590208000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788271975.078535:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271975.078548:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830e6480 going to sleep for 11 seconds 00000100:00100000:0.0:1788271975.078558:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590208000 00000100:00100000:0.0:1788271975.078561:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590208000 00000100:00100000:0.0:1788271975.078593:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788271975.078601:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+23:17208:x1875138590208000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788271975.078614:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271975.078643:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6e8511c400/0x99288105fd38fb84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38fb7d expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271975.078657:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6e8511c400/0x99288105fd38fb84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38fb7d expref: 24 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271975.078665:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6e8511c400/0x99288105fd38fb84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38fb7d expref: 24 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271975.078673:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e8511c400, rc 0) 00000100:00100000:0.0:1788271975.078699:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+24:17208:x1875138590208000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271975.078705:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788271975.078732:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82338700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590208000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788271975.078741:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6e8511ca00/0x99288105fd38fb7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fb84 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271975.078748:0:17208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6e8511ca00/0x99288105fd38fb7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38fb84 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271975.078779:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82338700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590208128:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788271975.078805:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271975.078818:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830e6480 going to sleep for 11 seconds 00000100:00100000:0.0:1788271975.078829:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590208128 00000100:00100000:0.0:1788271975.078845:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590208128 00000100:00100000:0.0:1788271975.078866:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788271975.078872:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83260450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+24:17208:x1875138590208128:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788271975.078887:0:17205:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788271975.078898:0:17205:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788271975.078900:0:17205:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1788271975.078957:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83260450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+24:17208:x1875138590208128:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 84us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271975.078964:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788271975.078990:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82338700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590208128:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788271975.079023:0:17208:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788271975.079029:0:17208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e8511ca00/0x99288105fd38fb7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fb84 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271975.079036:0:17208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6e8511ca00/0x99288105fd38fb7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fb84 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788271975.399546:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788271976.029852:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271976.477817:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788271976.477847:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590208256:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788271976.477976:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271976.478128:0:18723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590208256 00000100:00100000:0.0:1788271976.478136:0:18723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590208256 00000100:00080000:1.0:1788271976.478258:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788271976.478362:0:18723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788271976.478383:0:18723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590208256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788271976.478414:0:18723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788271976.478576:0:18723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590208256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 196us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271976.478584:0:18723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788271976.478744:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82338700 x1875138590208256/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271992 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271976.478775:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82338700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590208256:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788271976.990941:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590208384:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788271976.991016:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271976.991075:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590208384 00000100:00100000:3.0:1788271976.991083:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590208384 00000100:00100000:3.0:1788271976.991129:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788271976.991140:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590208384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788271976.991172:0:17216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788271976.991215:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590208384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271976.991222:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788271976.991264:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590208384:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788271976.994403:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83393800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590208512:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788271976.994468:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271976.994530:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590208512 00000100:00100000:3.0:1788271976.994537:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590208512 00000100:00100000:3.0:1788271976.994609:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788271976.994634:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590208512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788271976.994669:0:17217:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788271976.994714:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590208512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271976.994721:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788271976.994762:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83393800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590208512:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788271977.053710:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271978.082213:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271978.215218:0:3605:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788271958/real 1788271958] req@ffff8f6d83250380 x1875138590194304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788271978 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271978.215249:0:3605:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f6d83250380 x1875138590194304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788271978 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271978.215258:0:3605:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788271958/real 1788271958] req@ffff8f6d83251180 x1875138590194432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788271978 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271978.215268:0:3605:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f6d83251180 x1875138590194432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788271978 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788271978.215285:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6e859c8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788271978.215306:0:3605:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788271978.215316:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83250380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3605:1875138590194304:0@lo:8:kworker.0 00000100:00080000:2.0:1788271978.215322:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6e8ac65000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788271978.215327:0:3605:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788271978.215330:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83251180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3605:1875138590194432:0@lo:8:kworker.0 00000100:00080000:3.0:1788271978.217066:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788271978.217071:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788271978.217075:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f6e859c8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788271978.217081:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 519 00000100:00080000:3.0:1788271978.217086:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788271978.217092:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f6e859c8800 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788271978.217114:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d8313c000 x1875138590208896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788271978.217130:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788271978.217133:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788271978.217134:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f6e8ac65000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788271978.217149:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 519 00000100:00080000:3.0:1788271978.217151:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788271978.217156:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f6e8ac65000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788271978.217167:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d8313d880 x1875138590209024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788271978.217178:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590208768:0@lo:400:kworker.0 00000100:00080000:3.0:1788271978.217200:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788271978.217208:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788271978.217209:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f6e812ab000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788271978.217213:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f6e812ab000 using connection 192.168.201.103@tcp/0@lo 00000100:00100000:3.0:1788271978.217224:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f6d816cdf80 x1875138590209536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788271978.217240:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271978.217281:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3605:1875138590208896:0@lo:8:kworker.0 00000100:00100000:2.0:1788271978.217285:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875138590209664:0@lo:400:kworker.0 00000100:00100000:3.0:1788271978.217307:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271978.217307:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271978.217322:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3607:1875138590210176:0@lo:400:kworker.0 00000100:00100000:3.0:1788271978.217327:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3605:1875138590209024:0@lo:8:kworker.0 00000100:00100000:3.0:1788271978.217344:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271978.217344:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271978.217358:0:3605:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3605:1875138590209536:0@lo:8:kworker.0 00000100:00100000:2.0:1788271978.217359:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788271978.217364:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3607:1875138590208640:0@lo:400:kworker.0 00000100:00100000:3.0:1788271978.217374:0:3605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271978.217385:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271978.217396:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590209408:0@lo:400:kworker.0 00000100:00100000:3.0:1788271978.217398:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875138590209152:0@lo:400:kworker.0 00000100:00100000:3.0:1788271978.217414:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271978.217414:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271978.217426:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3608:1875138590209792:0@lo:400:kworker.0 00000100:00100000:2.0:1788271978.217426:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3607:1875138590210048:0@lo:400:kworker.0 00000100:00100000:3.0:1788271978.217442:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271978.217457:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788271978.217457:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590209664 00000100:00100000:3.0:1788271978.217462:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590209280:0@lo:400:kworker.0 00000100:00100000:2.0:1788271978.217464:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590209664 00000100:00100000:3.0:1788271978.217479:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271978.217492:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3608:1875138590209920:0@lo:400:kworker.0 00000100:00100000:2.0:1788271978.217495:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590210176 00000100:00100000:2.0:1788271978.217497:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590210176 00000100:00100000:3.0:1788271978.217508:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271978.217519:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590209152 00000100:00100000:2.0:1788271978.217522:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590209152 00000100:00100000:3.0:1788271978.217540:0:17953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590208768 00000100:00100000:3.0:1788271978.217543:0:17953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590208768 00000100:00100000:2.0:1788271978.217544:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590209792 00000100:00100000:2.0:1788271978.217546:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590209792 00000100:00100000:2.0:1788271978.217556:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590209920 00000100:00100000:2.0:1788271978.217558:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590209920 00000100:00100000:3.0:1788271978.217564:0:17953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590209280 00000100:00100000:3.0:1788271978.217565:0:17953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590209280 00000100:00100000:3.0:1788271978.217579:0:17953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788271978.217579:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788271978.217585:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875138590209664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271978.217588:0:17953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590208768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271978.217648:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875138590209664:12345-0@lo:400:kworker.0 Request processed in 62us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271978.217655:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788271978.217660:0:17953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590208768:12345-0@lo:400:kworker.0 Request processed in 73us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271978.217665:0:17953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788271978.217670:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788271978.217676:0:17953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788271978.217676:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875138590210176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271978.217681:0:17953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590209280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271978.217702:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83253b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875138590210176:12345-0@lo:400:kworker.0 Request processed in 27us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271978.217703:0:17953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590209280:12345-0@lo:400:kworker.0 Request processed in 22us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271978.217708:0:17953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788271978.217708:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788271978.217718:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788271978.217723:0:19409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590208896 00000100:00100000:2.0:1788271978.217724:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875138590209152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271978.217726:0:19409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590208896 00000100:00100000:3.0:1788271978.217736:0:19409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590209024 00000100:00100000:3.0:1788271978.217738:0:19409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590209024 00000100:00100000:3.0:1788271978.217744:0:19409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590209536 00000100:00100000:3.0:1788271978.217746:0:19409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590209536 00000100:00100000:2.0:1788271978.217748:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3608:x1875138590209152:12345-0@lo:400:kworker.0 Request processed in 25us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271978.217753:0:19409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590209408 00000100:00100000:2.0:1788271978.217754:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788271978.217755:0:19409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590209408 00000100:00100000:2.0:1788271978.217763:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788271978.217768:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875138590209792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271978.217771:0:19409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788271978.217776:0:19409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590209408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271978.217790:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875138590209792:12345-0@lo:400:kworker.0 Request processed in 22us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271978.217796:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788271978.217797:0:19409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590209408:12345-0@lo:400:kworker.0 Request processed in 22us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271978.217803:0:19409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788271978.217806:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788271978.217811:0:19409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788271978.217811:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875138590209920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271978.217815:0:19409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3605:x1875138590208896:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788271978.217831:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875138590209920:12345-0@lo:400:kworker.0 Request processed in 21us (322us total) trans 0 rc 0/0 00010000:00080000:3.0:1788271978.217835:0:19409:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 539 last 0 00000100:00100000:2.0:1788271978.217836:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000020:00000080:3.0:1788271978.217875:0:19409:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x99288105fd38fb8b 00002000:00100000:3.0:1788271978.217891:0:19409:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8f6e84b00800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113940 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788271978.217900:0:19409:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788271978.217902:0:19409:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1788271978.217961:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590208640 00000100:00100000:0.0:1788271978.217965:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590208640 00002000:00080000:3.0:1788271978.217971:0:19409:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:0.0:1788271978.217988:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00080000:3.0:1788271978.217990:0:19409:0:(import.c:65:import_set_state_nolock()) ffff8f6e84b03800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788271978.217994:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83262850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+24:3607:x1875138590208640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271978.218022:0:19409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3605:x1875138590208896:12345-0@lo:8:kworker.0 Request processed in 206us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271978.218024:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83262850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+24:3607:x1875138590208640:12345-0@lo:400:kworker.0 Request processed in 31us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271978.218028:0:19409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788271978.218030:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788271978.218040:0:19409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788271978.218043:0:19409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3605:x1875138590209024:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788271978.218058:0:19409:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 539 last 0 00000020:00000080:3.0:1788271978.218072:0:19409:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x99288105fd38fb92 00002000:00100000:3.0:1788271978.218078:0:19409:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8f6e84b02000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113940 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788271978.218081:0:19409:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788271978.218083:0:19409:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:2.0:1788271978.218180:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788271978.218184:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788271978.218186:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00002000:00080000:3.0:1788271978.218225:0:19409:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788271978.218239:0:19409:0:(import.c:65:import_set_state_nolock()) ffff8f6e84b06000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788271978.218263:0:19409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3605:x1875138590209024:12345-0@lo:8:kworker.0 Request processed in 218us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271978.218269:0:19409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788271978.218280:0:19409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788271978.218284:0:19409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3605:x1875138590209536:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788271978.218296:0:19409:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 539 last 0 00000020:00000080:3.0:1788271978.218312:0:19409:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x99288105fd38fb99 00002000:00100000:3.0:1788271978.218317:0:19409:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8f6e84b04000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113940 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788271978.218321:0:19409:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1788271978.218326:0:19409:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788271978.218347:0:19409:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788271978.218359:0:19409:0:(import.c:65:import_set_state_nolock()) ffff8f6e84b05000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788271978.218382:0:19409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3605:x1875138590209536:12345-0@lo:8:kworker.0 Request processed in 96us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271978.218388:0:19409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788271978.218411:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788271978.218452:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d816cf480 x1875138590209664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271978.218466:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875138590209664:0@lo:400:kworker.0 00010000:00080000:3.0:1788271978.218481:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d816cd500 x1875138590210176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271978.218488:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3607:1875138590210176:0@lo:400:kworker.0 00000100:00100000:3.0:1788271978.218499:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590208768:0@lo:400:kworker.0 00000100:00100000:3.0:1788271978.218518:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3607:1875138590208640:0@lo:400:kworker.0 00010000:00080000:3.0:1788271978.218539:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d816ced80 x1875138590209408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788271994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271978.218548:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590209408:0@lo:400:kworker.0 00000100:00100000:2.0:1788271978.218560:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590210048 00000100:00100000:2.0:1788271978.218563:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590210048 00010000:00080000:3.0:1788271978.218581:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d8313c000 x1875138590208896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788272003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271978.218589:0:3605:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:2.0:1788271978.218590:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788271978.218595:0:3605:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00100000:2.0:1788271978.218595:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875138590210048:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788271978.218601:0:3605:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788271978.218606:0:3605:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788271978.218614:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6e859c8800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788271978.218644:0:3605:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788271978.218644:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875138590210048:12345-0@lo:400:kworker.0 Request processed in 49us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271978.218649:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3605:1875138590208896:0@lo:8:kworker.0 00000100:00100000:2.0:1788271978.218650:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1788271978.218662:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d8313d880 x1875138590209024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788272003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788271978.218663:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788271978.218669:0:3605:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788271978.218673:0:3605:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788271978.218677:0:3605:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788271978.218679:0:3605:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788271978.218681:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6e8ac65000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788271978.218692:0:3605:0:(osp_dev.c:1648:osp_import_event()) got connected 00000004:00080000:2.0:1788271978.218693:0:17236:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:3.0:1788271978.218695:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3605:1875138590209024:0@lo:8:kworker.0 00010000:00080000:3.0:1788271978.218705:0:3605:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d816cdf80 x1875138590209536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788272003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271978.218707:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17236:1875138590210432:0@lo:5:osp-pre-0-0.0 00000100:00080000:3.0:1788271978.218713:0:3605:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788271978.218717:0:3605:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788271978.218720:0:3605:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788271978.218722:0:3605:0:(import.c:65:import_set_state_nolock()) ffff8f6e812ab000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788271978.218729:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788271978.218732:0:3605:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788271978.218735:0:3605:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3605:1875138590209536:0@lo:8:kworker.0 00000100:00100000:2.0:1788271978.218743:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc98d600 going to sleep for 11 seconds 00000004:00080000:3.0:1788271978.218755:0:17235:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788271978.218755:0:17237:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1788271978.218829:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590210432 00000100:00100000:0.0:1788271978.218834:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590210432 00000100:00100000:0.0:1788271978.218930:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788271978.218937:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17236:x1875138590210432:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788271978.219192:0:17237:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 539308571601ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788271978.219198:0:17237:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788271978.219219:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788271978.219227:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83251f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590210304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788271978.219254:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788271978.219285:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d816cc700 x1875138590210048/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271978.219294:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3607:1875138590210048:0@lo:400:kworker.0 00000004:00080000:2.0:1788271978.220569:0:17238:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1788271978.220591:0:17238:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83ad0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17238:1875138590210688:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788271978.220647:0:17238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271978.220677:0:17238:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc98d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271978.220694:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590210560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788271978.220716:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271978.220762:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590209280:0@lo:400:kworker.0 00010000:00080000:2.0:1788271978.221640:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d816cf100 x1875138590209920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271978.221656:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3608:1875138590209920:0@lo:400:kworker.0 00010000:00080000:2.0:1788271978.221675:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d8313d500 x1875138590209152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271978.221682:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3608:1875138590209152:0@lo:400:kworker.0 00010000:00080000:2.0:1788271978.221694:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d816cce00 x1875138590209792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271978.221702:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3608:1875138590209792:0@lo:400:kworker.0 00002000:00080000:0.0:1788271978.221926:0:18720:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788271978.221933:0:18720:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788271978.221938:0:18720:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00000004:00080000:1.0:1788271978.224430:0:17956:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788271978.224542:0:17956:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 539313921451ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788271978.224550:0:17956:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1788271978.224610:0:17957:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788271978.224656:0:17957:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83393100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17957:1875138590210944:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1788271978.224671:0:17235:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 539314050811ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788271978.224676:0:17235:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788271978.224722:0:17957:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271978.224745:0:17957:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e870bcf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788271978.224771:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788271978.224780:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83393800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590210816:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788271978.224804:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271978.224838:0:18724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590210304 00000100:00100000:1.0:1788271978.224838:0:18723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590210560 00000100:00100000:3.0:1788271978.225764:0:18724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590210304 00000100:00100000:3.0:1788271978.225806:0:18724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590210816 00000100:00100000:3.0:1788271978.225809:0:18724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590210816 00000100:00100000:1.0:1788271978.226930:0:18723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590210560 00000100:00100000:1.0:1788271978.226974:0:18723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788271978.226985:0:18723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3609:x1875138590210304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788271978.227016:0:18723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788271978.227987:0:18723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3609:x1875138590210304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1002us (8729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271978.227997:0:18723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788271978.228022:0:18723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788271978.228031:0:18723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3609:x1875138590210560:12345-0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788271978.228209:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83251f80 x1875138590210304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271994 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271978.228229:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83251f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590210304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788271978.228550:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590210688 00000100:00100000:3.0:1788271978.228557:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590210688 00000100:00100000:3.0:1788271978.228578:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590210944 00000100:00100000:3.0:1788271978.228581:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590210944 00000100:00100000:3.0:1788271978.228593:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788271978.228601:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:17238:x1875138590210688:12345-0@lo:5:osp-pre-1-0.0 00002000:00000024:1.0:1788271978.228681:0:18723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788271978.228740:0:18723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3609:x1875138590210560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 711us (8022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271978.228747:0:18723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788271978.228770:0:18723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788271978.228840:0:18723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83392680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3607:x1875138590210816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788271978.228918:0:18723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788271978.228953:0:18723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83392680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3607:x1875138590210816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 116us (4148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271978.228959:0:18723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788271978.228979:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788271978.228983:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788271978.229004:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83393800 x1875138590210816/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271994 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271978.229018:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83393800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590210816:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1788271978.229629:0:3609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d83ad1c00 x1875138590210560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788271994 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271978.229647:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83ad1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590210560:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1788271978.231303:0:17945:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:3.0:1788271978.233426:0:18721:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788271978.233437:0:18721:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1788271978.233445:0:18721:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00002000:00010000:1.0:1788271978.242386:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788271978.242400:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090f72786/0x99288105fd38fba0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.242418:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=539s v=(0 0) 00010000:00010000:1.0:1788271978.242423:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271978.242430:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090f72786/0x99288105fd38fba0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.242447:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090f72786/0x99288105fd38fba0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.242457:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090f72786/0x99288105fd38fba0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.242474:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090f72786/0x99288105fd38fba0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.242504:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788271978.243023:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271978.243031:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090f72786/0x99288105fd38fba0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.243337:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4ed5e00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:0.0:1788271978.243343:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090f72786/0x99288105fd38fba0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.243353:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090f72786/0x99288105fd38fba0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.243373:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090f72786/0x99288105fd38fba0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.243380:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090f72786/0x99288105fd38fba0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.243412:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271978.243414:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271978.243417:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788271978.243517:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788271978.243523:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007af1040b/0x99288105fd38fba7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.243543:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=539s v=(0 0) 00010000:00010000:1.0:1788271978.243547:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271978.243552:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007af1040b/0x99288105fd38fba7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.243563:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007af1040b/0x99288105fd38fba7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.243571:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007af1040b/0x99288105fd38fba7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.243578:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007af1040b/0x99288105fd38fba7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.244050:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788271978.244962:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788271978.244971:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b65e1830/0x99288105fd38fbae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.244994:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788271978.244998:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271978.245003:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b65e1830/0x99288105fd38fbae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.245016:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b65e1830/0x99288105fd38fbae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.245025:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b65e1830/0x99288105fd38fbae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.245032:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b65e1830/0x99288105fd38fbae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.248195:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788271978.248210:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007af1040b/0x99288105fd38fba7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.248224:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4ed5200 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:0.0:1788271978.248230:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007af1040b/0x99288105fd38fba7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.248241:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007af1040b/0x99288105fd38fba7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.248261:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007af1040b/0x99288105fd38fba7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.248269:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007af1040b/0x99288105fd38fba7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.248307:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271978.248311:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b65e1830/0x99288105fd38fbae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.248317:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f7800 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:0.0:1788271978.248329:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b65e1830/0x99288105fd38fbae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.248337:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b65e1830/0x99288105fd38fbae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.248347:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b65e1830/0x99288105fd38fbae lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.248355:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271978.248357:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271978.248359:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788271978.250347:0:18721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788271978.250361:0:18721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b70fa8a2/0x99288105fd38fbb5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.250378:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1788271978.250383:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271978.250390:0:18721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b70fa8a2/0x99288105fd38fbb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.250409:0:18721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b70fa8a2/0x99288105fd38fbb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.250420:0:18721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b70fa8a2/0x99288105fd38fbb5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.250428:0:18721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b70fa8a2/0x99288105fd38fbb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.250451:0:18721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788271978.251517:0:18721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788271978.251538:0:18721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ca0a625/0x99288105fd38fbbc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.251553:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1788271978.251557:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271978.251563:0:18721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ca0a625/0x99288105fd38fbbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.251575:0:18721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ca0a625/0x99288105fd38fbbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.251583:0:18721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ca0a625/0x99288105fd38fbbc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.251592:0:18721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ca0a625/0x99288105fd38fbbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.251612:0:18721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788271978.252485:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788271978.252494:0:18720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b65e1830/0x99288105fd38fbae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.252550:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788271978.252558:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b70fa8a2/0x99288105fd38fbb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.252567:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4600 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:0.0:1788271978.252571:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b70fa8a2/0x99288105fd38fbb5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.252581:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b70fa8a2/0x99288105fd38fbb5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.252601:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b70fa8a2/0x99288105fd38fbb5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.252608:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b70fa8a2/0x99288105fd38fbb5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788271978.252739:0:17191:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1788271978.252936:0:17191:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:0.0:1788271978.253459:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271978.253465:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ca0a625/0x99288105fd38fbbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.253473:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c5600 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:0.0:1788271978.253477:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ca0a625/0x99288105fd38fbbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.253487:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ca0a625/0x99288105fd38fbbc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.253502:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ca0a625/0x99288105fd38fbbc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.253509:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ca0a625/0x99288105fd38fbbc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.253534:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271978.253537:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271978.253540:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788271978.253544:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788271978.253548:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271978.253554:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000faf53b37/0x99288105fd38fbc3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.253567:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1788271978.253571:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271978.253577:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000faf53b37/0x99288105fd38fbc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.253597:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000faf53b37/0x99288105fd38fbc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.253606:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000faf53b37/0x99288105fd38fbc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.253613:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000faf53b37/0x99288105fd38fbc3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.253652:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788271978.253816:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271978.253820:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000faf53b37/0x99288105fd38fbc3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.253828:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4000 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:0.0:1788271978.253837:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000faf53b37/0x99288105fd38fbc3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.253845:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000faf53b37/0x99288105fd38fbc3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.253856:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000faf53b37/0x99288105fd38fbc3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.253863:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000faf53b37/0x99288105fd38fbc3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.253876:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271978.253878:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271978.253880:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788271978.254009:0:18721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788271978.254015:0:18721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b02e9e2f/0x99288105fd38fbca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.254024:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788271978.254027:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271978.254032:0:18721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b02e9e2f/0x99288105fd38fbca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.254055:0:18721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b02e9e2f/0x99288105fd38fbca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.254064:0:18721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b02e9e2f/0x99288105fd38fbca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.254071:0:18721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b02e9e2f/0x99288105fd38fbca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788271978.254073:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788271978.254083:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc31f374/0x99288105fd38fbd1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.254092:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1788271978.254095:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271978.254099:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc31f374/0x99288105fd38fbd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.254099:0:18721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788271978.254111:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc31f374/0x99288105fd38fbd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.254116:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271978.254122:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b02e9e2f/0x99288105fd38fbca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.254130:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f6c00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:0.0:1788271978.254133:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b02e9e2f/0x99288105fd38fbca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.254141:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b02e9e2f/0x99288105fd38fbca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.254152:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b02e9e2f/0x99288105fd38fbca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.254166:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b02e9e2f/0x99288105fd38fbca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.254180:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271978.254183:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271978.254187:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271978.254190:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc31f374/0x99288105fd38fbd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.254209:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc31f374/0x99288105fd38fbd1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.254230:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788271978.254273:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271978.254278:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc31f374/0x99288105fd38fbd1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.254285:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c5e00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:0.0:1788271978.254289:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc31f374/0x99288105fd38fbd1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.254296:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc31f374/0x99288105fd38fbd1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.254306:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc31f374/0x99288105fd38fbd1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.254314:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc31f374/0x99288105fd38fbd1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.254326:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271978.254328:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271978.254329:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788271978.254484:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788271978.254492:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a908d89/0x99288105fd38fbd8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.254500:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1788271978.254502:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271978.254506:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a908d89/0x99288105fd38fbd8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.254513:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a908d89/0x99288105fd38fbd8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.254519:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a908d89/0x99288105fd38fbd8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.254537:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a908d89/0x99288105fd38fbd8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.254555:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788271978.254672:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271978.254677:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a908d89/0x99288105fd38fbd8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.254685:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4400 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:0.0:1788271978.254689:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a908d89/0x99288105fd38fbd8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.254697:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a908d89/0x99288105fd38fbd8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.254708:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a908d89/0x99288105fd38fbd8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.254716:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a908d89/0x99288105fd38fbd8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.254728:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271978.254730:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271978.254732:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788271978.255362:0:18721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:3.0:1788271978.255366:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788271978.255369:0:18721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000084b2589/0x99288105fd38fbdf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.255374:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ed65721/0x99288105fd38fbe6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.255380:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788271978.255388:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271978.255397:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788271978.255398:0:18721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000084b2589/0x99288105fd38fbdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.255404:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271978.255417:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ed65721/0x99288105fd38fbe6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.255418:0:18721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000084b2589/0x99288105fd38fbdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.255441:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ed65721/0x99288105fd38fbe6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.255441:0:18721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000084b2589/0x99288105fd38fbdf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.255462:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ed65721/0x99288105fd38fbe6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.255480:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ed65721/0x99288105fd38fbe6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.255484:0:18721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000084b2589/0x99288105fd38fbdf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.255513:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788271978.255587:0:18721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788271978.255726:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788271978.255732:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ed65721/0x99288105fd38fbe6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.255739:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c5c00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:0.0:1788271978.255742:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ed65721/0x99288105fd38fbe6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.255774:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ed65721/0x99288105fd38fbe6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.255792:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ed65721/0x99288105fd38fbe6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.255799:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ed65721/0x99288105fd38fbe6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.255819:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271978.255823:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000084b2589/0x99288105fd38fbdf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.255829:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f6800 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:0.0:1788271978.255832:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000084b2589/0x99288105fd38fbdf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.255840:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000084b2589/0x99288105fd38fbdf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.255851:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000084b2589/0x99288105fd38fbdf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.255858:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000084b2589/0x99288105fd38fbdf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.255883:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271978.255885:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271978.255887:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271978.255893:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788271978.257025:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788271978.257035:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e42238b/0x99288105fd38fbed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.257048:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1788271978.257052:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271978.257058:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e42238b/0x99288105fd38fbed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.257071:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e42238b/0x99288105fd38fbed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.257095:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e42238b/0x99288105fd38fbed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.257103:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e42238b/0x99288105fd38fbed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.257124:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788271978.257251:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271978.257257:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e42238b/0x99288105fd38fbed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.257267:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e21c00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:2.0:1788271978.257271:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e42238b/0x99288105fd38fbed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.257280:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e42238b/0x99288105fd38fbed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.257294:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e42238b/0x99288105fd38fbed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.257301:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e42238b/0x99288105fd38fbed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.257316:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271978.257318:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271978.257319:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788271978.257485:0:18721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788271978.257498:0:18721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008665f5ea/0x99288105fd38fbf4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.257506:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788271978.257509:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271978.257518:0:18721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008665f5ea/0x99288105fd38fbf4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.257538:0:18721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008665f5ea/0x99288105fd38fbf4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.257547:0:18721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008665f5ea/0x99288105fd38fbf4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.257554:0:18721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008665f5ea/0x99288105fd38fbf4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.257571:0:18721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788271978.257579:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271978.257583:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008665f5ea/0x99288105fd38fbf4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.257589:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f7e00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:2.0:1788271978.257592:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008665f5ea/0x99288105fd38fbf4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.257598:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008665f5ea/0x99288105fd38fbf4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.257615:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008665f5ea/0x99288105fd38fbf4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.257637:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008665f5ea/0x99288105fd38fbf4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.257652:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271978.257654:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271978.257656:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788271978.258017:0:18721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788271978.258023:0:18721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006aff2414/0x99288105fd38fbfb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.258033:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788271978.258036:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271978.258041:0:18721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006aff2414/0x99288105fd38fbfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.258051:0:18721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006aff2414/0x99288105fd38fbfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.258059:0:18721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006aff2414/0x99288105fd38fbfb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.258066:0:18721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006aff2414/0x99288105fd38fbfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.258094:0:18721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788271978.258103:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271978.258107:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006aff2414/0x99288105fd38fbfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.258114:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f7000 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:2.0:1788271978.258117:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006aff2414/0x99288105fd38fbfb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.258124:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006aff2414/0x99288105fd38fbfb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788271978.258228:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788271978.258234:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028df275f/0x99288105fd38fc02 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.258242:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1788271978.258245:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271978.258249:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028df275f/0x99288105fd38fc02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.258258:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028df275f/0x99288105fd38fc02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.258266:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028df275f/0x99288105fd38fc02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.258274:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028df275f/0x99288105fd38fc02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.258301:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788271978.258416:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006aff2414/0x99288105fd38fbfb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.258426:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006aff2414/0x99288105fd38fbfb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.258441:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271978.258444:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028df275f/0x99288105fd38fc02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.258451:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e21a00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:2.0:1788271978.258454:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028df275f/0x99288105fd38fc02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.258471:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028df275f/0x99288105fd38fc02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.258481:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028df275f/0x99288105fd38fc02 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.258488:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028df275f/0x99288105fd38fc02 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.258500:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271978.258501:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271978.258503:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271978.258509:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271978.259388:0:18721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788271978.259398:0:18721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002860b6b3/0x99288105fd38fc09 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.259409:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=539s v=(0 0) 00010000:00010000:0.0:1788271978.259413:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271978.259419:0:18721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002860b6b3/0x99288105fd38fc09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.259432:0:18721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002860b6b3/0x99288105fd38fc09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.259442:0:18721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002860b6b3/0x99288105fd38fc09 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.259450:0:18721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002860b6b3/0x99288105fd38fc09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.259471:0:18721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788271978.259474:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788271978.259480:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271978.259481:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a9f5cbf/0x99288105fd38fc10 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.259485:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002860b6b3/0x99288105fd38fc09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.259490:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1788271978.259493:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511c200 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:2.0:1788271978.259493:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271978.259497:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002860b6b3/0x99288105fd38fc09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.259498:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a9f5cbf/0x99288105fd38fc10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.259507:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002860b6b3/0x99288105fd38fc09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.259508:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a9f5cbf/0x99288105fd38fc10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.259517:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a9f5cbf/0x99288105fd38fc10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.259520:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002860b6b3/0x99288105fd38fc09 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.259538:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002860b6b3/0x99288105fd38fc09 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.259540:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a9f5cbf/0x99288105fd38fc10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.259556:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788271978.259557:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788271978.259560:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a9f5cbf/0x99288105fd38fc10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.259563:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271978.259567:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f7600 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:3.0:1788271978.259571:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a9f5cbf/0x99288105fd38fc10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.259590:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a9f5cbf/0x99288105fd38fc10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.259601:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a9f5cbf/0x99288105fd38fc10 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.259608:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a9f5cbf/0x99288105fd38fc10 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.259637:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271978.259639:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271978.259641:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788271978.261439:0:18721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788271978.261451:0:18721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000027fa5e3/0x99288105fd38fc17 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.261465:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788271978.261470:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271978.261476:0:18721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000027fa5e3/0x99288105fd38fc17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.261489:0:18721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000027fa5e3/0x99288105fd38fc17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.261498:0:18721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000027fa5e3/0x99288105fd38fc17 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.261506:0:18721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000027fa5e3/0x99288105fd38fc17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.261538:0:18721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788271978.262405:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271978.262414:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000027fa5e3/0x99288105fd38fc17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.262430:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6ec21dfe00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:1.0:1788271978.262435:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000027fa5e3/0x99288105fd38fc17 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.262444:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000027fa5e3/0x99288105fd38fc17 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.262463:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000027fa5e3/0x99288105fd38fc17 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.262470:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000027fa5e3/0x99288105fd38fc17 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.262489:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271978.262491:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271978.262493:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788271978.262599:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788271978.262606:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067bf92a6/0x99288105fd38fc1e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.262616:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1788271978.262942:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271978.262950:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067bf92a6/0x99288105fd38fc1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.262962:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067bf92a6/0x99288105fd38fc1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.262970:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067bf92a6/0x99288105fd38fc1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.262984:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067bf92a6/0x99288105fd38fc1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.263007:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788271978.263212:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271978.263221:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067bf92a6/0x99288105fd38fc1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.263238:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e20c00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:2.0:1788271978.263242:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067bf92a6/0x99288105fd38fc1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.263249:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067bf92a6/0x99288105fd38fc1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.263260:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067bf92a6/0x99288105fd38fc1e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.263268:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067bf92a6/0x99288105fd38fc1e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.263284:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271978.263286:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271978.263288:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788271978.263649:0:18721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788271978.263655:0:18721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3f57042/0x99288105fd38fc25 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.263664:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788271978.263668:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271978.263673:0:18721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3f57042/0x99288105fd38fc25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.263694:0:18721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3f57042/0x99288105fd38fc25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.263703:0:18721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3f57042/0x99288105fd38fc25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.263711:0:18721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3f57042/0x99288105fd38fc25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.263728:0:18721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788271978.264204:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271978.264210:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3f57042/0x99288105fd38fc25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.264219:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6ec21dfa00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:1.0:1788271978.264224:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3f57042/0x99288105fd38fc25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.264233:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3f57042/0x99288105fd38fc25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.264252:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3f57042/0x99288105fd38fc25 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.264259:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3f57042/0x99288105fd38fc25 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.264278:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271978.264281:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271978.264284:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788271978.264327:0:18721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788271978.264334:0:18721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e3869ec/0x99288105fd38fc2c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.264343:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788271978.264427:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271978.264433:0:18721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e3869ec/0x99288105fd38fc2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.264445:0:18721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e3869ec/0x99288105fd38fc2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.264455:0:18721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e3869ec/0x99288105fd38fc2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.264474:0:18721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e3869ec/0x99288105fd38fc2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.264501:0:18721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788271978.264553:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271978.264558:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e3869ec/0x99288105fd38fc2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.264566:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6ec21de200 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:1.0:1788271978.264569:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e3869ec/0x99288105fd38fc2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.264577:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e3869ec/0x99288105fd38fc2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.264587:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e3869ec/0x99288105fd38fc2c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.264595:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e3869ec/0x99288105fd38fc2c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.264636:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271978.264638:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271978.264639:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788271978.264945:0:18721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788271978.264951:0:18721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000630daea6/0x99288105fd38fc33 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.264959:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788271978.264962:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271978.264967:0:18721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000630daea6/0x99288105fd38fc33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.264977:0:18721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000630daea6/0x99288105fd38fc33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.264985:0:18721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000630daea6/0x99288105fd38fc33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.264993:0:18721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000630daea6/0x99288105fd38fc33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.265015:0:18721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788271978.265174:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271978.265179:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000630daea6/0x99288105fd38fc33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.265188:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6ec21dfc00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:1.0:1788271978.265192:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000630daea6/0x99288105fd38fc33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.265200:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000630daea6/0x99288105fd38fc33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.265211:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000630daea6/0x99288105fd38fc33 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.265219:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000630daea6/0x99288105fd38fc33 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.265232:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271978.265234:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271978.265236:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788271978.265475:0:18721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788271978.265481:0:18721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2c941f1/0x99288105fd38fc3a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.265496:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788271978.265500:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271978.265504:0:18721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2c941f1/0x99288105fd38fc3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.265515:0:18721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2c941f1/0x99288105fd38fc3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.265523:0:18721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2c941f1/0x99288105fd38fc3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.265543:0:18721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2c941f1/0x99288105fd38fc3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.265565:0:18721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788271978.265656:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271978.265662:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2c941f1/0x99288105fd38fc3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.265681:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6ec21de600 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:1.0:1788271978.265685:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2c941f1/0x99288105fd38fc3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.265692:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2c941f1/0x99288105fd38fc3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.265703:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2c941f1/0x99288105fd38fc3a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.265711:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2c941f1/0x99288105fd38fc3a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.265729:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271978.265731:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271978.265733:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788271978.265837:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788271978.266166:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003eeb634a/0x99288105fd38fc41 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.266176:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1788271978.266179:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271978.266183:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003eeb634a/0x99288105fd38fc41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.266194:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003eeb634a/0x99288105fd38fc41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.266203:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003eeb634a/0x99288105fd38fc41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.266211:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003eeb634a/0x99288105fd38fc41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788271978.266696:0:18721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788271978.266703:0:18721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a715506/0x99288105fd38fc48 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.266713:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788271978.266716:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271978.266721:0:18721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a715506/0x99288105fd38fc48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.266731:0:18721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a715506/0x99288105fd38fc48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.266750:0:18721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a715506/0x99288105fd38fc48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.266757:0:18721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a715506/0x99288105fd38fc48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.266801:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788271978.267356:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788271978.267363:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008c4401c/0x99288105fd38fc4f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.267378:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1788271978.267382:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271978.267386:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008c4401c/0x99288105fd38fc4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.267395:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008c4401c/0x99288105fd38fc4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.267404:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008c4401c/0x99288105fd38fc4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.267411:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008c4401c/0x99288105fd38fc4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.268245:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788271978.268294:0:18721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788271978.268519:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788271978.268535:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a715506/0x99288105fd38fc48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.268545:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6ec21de000 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:2.0:1788271978.268550:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a715506/0x99288105fd38fc48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.268560:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a715506/0x99288105fd38fc48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.268577:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a715506/0x99288105fd38fc48 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.268585:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a715506/0x99288105fd38fc48 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.268606:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271978.268631:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008c4401c/0x99288105fd38fc4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.268638:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e20000 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:2.0:1788271978.268641:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008c4401c/0x99288105fd38fc4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.268673:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008c4401c/0x99288105fd38fc4f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.268687:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008c4401c/0x99288105fd38fc4f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.268694:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271978.268697:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271978.268699:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788271978.268746:0:18721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788271978.268752:0:18721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043b12355/0x99288105fd38fc56 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.268761:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788271978.268764:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271978.268769:0:18721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043b12355/0x99288105fd38fc56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.268781:0:18721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043b12355/0x99288105fd38fc56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.268799:0:18721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043b12355/0x99288105fd38fc56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.268806:0:18721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043b12355/0x99288105fd38fc56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.268950:0:18721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788271978.270965:0:18721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788271978.270977:0:18721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051091a6a/0x99288105fd38fc5d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.270993:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788271978.270998:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271978.271004:0:18721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051091a6a/0x99288105fd38fc5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.271017:0:18721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051091a6a/0x99288105fd38fc5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.271028:0:18721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051091a6a/0x99288105fd38fc5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.271037:0:18721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051091a6a/0x99288105fd38fc5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.271064:0:18721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788271978.271666:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788271978.271673:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788271978.271674:0:18720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008c4401c/0x99288105fd38fc4f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.271679:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043b12355/0x99288105fd38fc56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.271686:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6ec21df800 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:2.0:1788271978.271691:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043b12355/0x99288105fd38fc56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.271700:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043b12355/0x99288105fd38fc56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.271715:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043b12355/0x99288105fd38fc56 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.271722:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043b12355/0x99288105fd38fc56 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.271735:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271978.271738:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051091a6a/0x99288105fd38fc5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.271770:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6ec21de800 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:2.0:1788271978.271773:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051091a6a/0x99288105fd38fc5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.271791:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051091a6a/0x99288105fd38fc5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.271802:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051091a6a/0x99288105fd38fc5d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.271809:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051091a6a/0x99288105fd38fc5d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788271978.272031:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788271978.272133:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a0e132a/0x99288105fd38fc64 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.272143:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1788271978.272147:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271978.272152:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a0e132a/0x99288105fd38fc64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.272174:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a0e132a/0x99288105fd38fc64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.272183:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a0e132a/0x99288105fd38fc64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.272191:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a0e132a/0x99288105fd38fc64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.272201:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788271978.272213:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271978.272217:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a0e132a/0x99288105fd38fc64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.272285:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e20800 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:2.0:1788271978.272290:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a0e132a/0x99288105fd38fc64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.272299:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a0e132a/0x99288105fd38fc64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.272311:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a0e132a/0x99288105fd38fc64 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.272318:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a0e132a/0x99288105fd38fc64 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788271978.272728:0:18721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788271978.272734:0:18721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c55ee22c/0x99288105fd38fc6b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.272743:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1788271978.272746:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271978.272751:0:18721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c55ee22c/0x99288105fd38fc6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.272761:0:18721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c55ee22c/0x99288105fd38fc6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.272769:0:18721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c55ee22c/0x99288105fd38fc6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.272788:0:18721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c55ee22c/0x99288105fd38fc6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.272797:0:18721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788271978.272932:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271978.272936:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271978.272939:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c55ee22c/0x99288105fd38fc6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.272947:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e21400 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:2.0:1788271978.272950:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c55ee22c/0x99288105fd38fc6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.272958:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c55ee22c/0x99288105fd38fc6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.272968:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c55ee22c/0x99288105fd38fc6b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788271978.272970:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788271978.272975:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000389cbd27/0x99288105fd38fc72 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.272977:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c55ee22c/0x99288105fd38fc6b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.272983:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1788271978.272986:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271978.272989:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271978.272991:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000389cbd27/0x99288105fd38fc72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.272991:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271978.272993:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271978.272999:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000389cbd27/0x99288105fd38fc72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.273007:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000389cbd27/0x99288105fd38fc72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.273014:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000389cbd27/0x99288105fd38fc72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.273033:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788271978.273065:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271978.273069:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000389cbd27/0x99288105fd38fc72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.273076:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e21800 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:2.0:1788271978.273085:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000389cbd27/0x99288105fd38fc72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.273093:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000389cbd27/0x99288105fd38fc72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.273104:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000389cbd27/0x99288105fd38fc72 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.273111:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000389cbd27/0x99288105fd38fc72 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.273123:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271978.273125:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271978.273127:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788271978.273308:0:18721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788271978.273314:0:18721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006aff2414/0x99288105fd38fc79 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.273322:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788271978.273325:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271978.273329:0:18721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006aff2414/0x99288105fd38fc79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.273338:0:18721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006aff2414/0x99288105fd38fc79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.273414:0:18721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006aff2414/0x99288105fd38fc79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788271978.273420:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788271978.273427:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e72a6e7/0x99288105fd38fc80 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.273429:0:18721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006aff2414/0x99288105fd38fc79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.273434:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=539s v=(0 0) 00010000:00010000:1.0:1788271978.273438:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271978.273442:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e72a6e7/0x99288105fd38fc80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.273450:0:18721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788271978.273461:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e72a6e7/0x99288105fd38fc80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.273469:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e72a6e7/0x99288105fd38fc80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.273477:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e72a6e7/0x99288105fd38fc80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.273485:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788271978.273553:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788271978.273558:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006aff2414/0x99288105fd38fc79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.273571:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f7000 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:3.0:1788271978.273575:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006aff2414/0x99288105fd38fc79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.273582:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006aff2414/0x99288105fd38fc79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.273594:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006aff2414/0x99288105fd38fc79 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.273601:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006aff2414/0x99288105fd38fc79 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.273637:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788271978.273642:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e72a6e7/0x99288105fd38fc80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.273648:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4ed4e00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:3.0:1788271978.273651:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e72a6e7/0x99288105fd38fc80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.273659:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e72a6e7/0x99288105fd38fc80 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.273669:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e72a6e7/0x99288105fd38fc80 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.273683:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e72a6e7/0x99288105fd38fc80 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.273703:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271978.273706:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271978.273709:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271978.273956:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271978.273958:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271978.273960:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271978.274151:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003eeb634a/0x99288105fd38fc41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.274160:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e20400 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:3.0:1788271978.274163:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003eeb634a/0x99288105fd38fc41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.274171:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003eeb634a/0x99288105fd38fc41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.274183:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003eeb634a/0x99288105fd38fc41 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.274190:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003eeb634a/0x99288105fd38fc41 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.274202:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271978.274203:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271978.274204:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788271978.276699:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788271978.276711:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d414979/0x99288105fd38fc87 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.276727:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=539s v=(0 0) 00010000:00010000:1.0:1788271978.276731:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271978.276736:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d414979/0x99288105fd38fc87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.276749:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d414979/0x99288105fd38fc87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.276759:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d414979/0x99288105fd38fc87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.276776:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d414979/0x99288105fd38fc87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.276792:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788271978.276919:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788271978.276931:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d414979/0x99288105fd38fc87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.276939:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4ed4400 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:3.0:1788271978.276943:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d414979/0x99288105fd38fc87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.276953:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d414979/0x99288105fd38fc87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.276968:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d414979/0x99288105fd38fc87 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.276975:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d414979/0x99288105fd38fc87 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.276991:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271978.276993:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271978.276994:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788271978.277432:0:18721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788271978.277439:0:18721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008665f5ea/0x99288105fd38fc8e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.277447:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788271978.277450:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271978.277454:0:18721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008665f5ea/0x99288105fd38fc8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.277463:0:18721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008665f5ea/0x99288105fd38fc8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.277470:0:18721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008665f5ea/0x99288105fd38fc8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.277476:0:18721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008665f5ea/0x99288105fd38fc8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.277491:0:18721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788271978.277653:0:19859:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271978.277658:0:19859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008665f5ea/0x99288105fd38fc8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.277666:0:19859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f7e00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:2.0:1788271978.277670:0:19859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008665f5ea/0x99288105fd38fc8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.277678:0:19859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008665f5ea/0x99288105fd38fc8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.277690:0:19859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008665f5ea/0x99288105fd38fc8e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.277697:0:19859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008665f5ea/0x99288105fd38fc8e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.277711:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271978.277713:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271978.277714:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788271978.278027:0:18721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788271978.278033:0:18721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b02e9e2f/0x99288105fd38fc95 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.278042:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788271978.278045:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271978.278049:0:18721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b02e9e2f/0x99288105fd38fc95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.278070:0:18721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b02e9e2f/0x99288105fd38fc95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.278078:0:18721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b02e9e2f/0x99288105fd38fc95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.278085:0:18721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b02e9e2f/0x99288105fd38fc95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.278099:0:18721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788271978.279242:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788271978.279253:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007af1040b/0x99288105fd38fc9c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.279265:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=539s v=(0 0) 00010000:00010000:1.0:1788271978.279269:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271978.279274:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007af1040b/0x99288105fd38fc9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.279285:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007af1040b/0x99288105fd38fc9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.279295:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007af1040b/0x99288105fd38fc9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.279304:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007af1040b/0x99288105fd38fc9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.279324:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788271978.279547:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788271978.279554:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b02e9e2f/0x99288105fd38fc95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.279562:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f6c00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:2.0:1788271978.279567:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b02e9e2f/0x99288105fd38fc95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.279575:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b02e9e2f/0x99288105fd38fc95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.279590:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b02e9e2f/0x99288105fd38fc95 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.279598:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b02e9e2f/0x99288105fd38fc95 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.279633:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271978.279637:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007af1040b/0x99288105fd38fc9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.279643:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4ed5200 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:2.0:1788271978.279647:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007af1040b/0x99288105fd38fc9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.279654:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007af1040b/0x99288105fd38fc9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788271978.279657:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788271978.279662:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090f72786/0x99288105fd38fca3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.279665:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007af1040b/0x99288105fd38fc9c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.279673:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007af1040b/0x99288105fd38fc9c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.279675:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=539s v=(0 0) 00010000:00010000:1.0:1788271978.279678:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271978.279682:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090f72786/0x99288105fd38fca3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.279685:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271978.279687:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271978.279689:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271978.279691:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090f72786/0x99288105fd38fca3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.279700:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090f72786/0x99288105fd38fca3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.279707:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090f72786/0x99288105fd38fca3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788271978.279727:0:18721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788271978.279732:0:18721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b65e1830/0x99288105fd38fcaa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.279741:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788271978.279750:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271978.279754:0:18721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b65e1830/0x99288105fd38fcaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.279762:0:18721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b65e1830/0x99288105fd38fcaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.279770:0:18721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b65e1830/0x99288105fd38fcaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.279776:0:18721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b65e1830/0x99288105fd38fcaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.279790:0:18721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788271978.279895:0:19859:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271978.279900:0:19859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b65e1830/0x99288105fd38fcaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.279907:0:19859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f7800 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:2.0:1788271978.279911:0:19859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b65e1830/0x99288105fd38fcaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.279919:0:19859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b65e1830/0x99288105fd38fcaa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.279930:0:19859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b65e1830/0x99288105fd38fcaa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.279948:0:19859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b65e1830/0x99288105fd38fcaa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.279962:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271978.279964:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271978.279966:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788271978.280342:0:18721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788271978.280348:0:18721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a9f5cbf/0x99288105fd38fcb1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.280356:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788271978.280359:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271978.280363:0:18721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a9f5cbf/0x99288105fd38fcb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.280371:0:18721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a9f5cbf/0x99288105fd38fcb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.280378:0:18721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a9f5cbf/0x99288105fd38fcb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.280384:0:18721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a9f5cbf/0x99288105fd38fcb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.280409:0:18721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788271978.280612:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788271978.280790:0:19859:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788271978.280802:0:19859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a9f5cbf/0x99288105fd38fcb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.280809:0:19859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f7600 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:2.0:1788271978.280813:0:19859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a9f5cbf/0x99288105fd38fcb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.280821:0:19859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a9f5cbf/0x99288105fd38fcb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.280832:0:19859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a9f5cbf/0x99288105fd38fcb1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.280839:0:19859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a9f5cbf/0x99288105fd38fcb1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.280908:0:19859:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271978.280912:0:19859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090f72786/0x99288105fd38fca3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.280918:0:19859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4ed5e00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:2.0:1788271978.280921:0:19859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090f72786/0x99288105fd38fca3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.280927:0:19859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090f72786/0x99288105fd38fca3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.280950:0:19859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090f72786/0x99288105fd38fca3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.280957:0:19859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090f72786/0x99288105fd38fca3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.280972:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271978.280974:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271978.280976:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788271978.281209:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788271978.281215:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000084b2589/0x99288105fd38fcb8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.281224:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788271978.281227:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271978.281231:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000084b2589/0x99288105fd38fcb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.281240:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000084b2589/0x99288105fd38fcb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.281249:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000084b2589/0x99288105fd38fcb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.281256:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000084b2589/0x99288105fd38fcb8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.281281:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788271978.281377:0:19859:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271978.281382:0:19859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000084b2589/0x99288105fd38fcb8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.281390:0:19859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f6800 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:2.0:1788271978.281393:0:19859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000084b2589/0x99288105fd38fcb8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.281400:0:19859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000084b2589/0x99288105fd38fcb8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.281410:0:19859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000084b2589/0x99288105fd38fcb8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.281417:0:19859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000084b2589/0x99288105fd38fcb8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.281430:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271978.281432:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271978.281433:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271978.281612:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788271978.282985:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788271978.282997:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000027fa5e3/0x99288105fd38fcbf lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.283010:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788271978.283020:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271978.283026:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000027fa5e3/0x99288105fd38fcbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788271978.283053:0:18721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788271978.283060:0:18721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c73f1f2e/0x99288105fd38fcc6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.283075:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=539s v=(0 0) 00010000:00010000:0.0:1788271978.283079:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271978.283083:0:18721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c73f1f2e/0x99288105fd38fcc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.283094:0:18721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c73f1f2e/0x99288105fd38fcc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.283104:0:18721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c73f1f2e/0x99288105fd38fcc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.283112:0:18721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c73f1f2e/0x99288105fd38fcc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.283130:0:18721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788271978.283243:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000027fa5e3/0x99288105fd38fcbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.283254:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000027fa5e3/0x99288105fd38fcbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.283262:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000027fa5e3/0x99288105fd38fcbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.283278:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788271978.283375:0:19859:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788271978.283381:0:19859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c73f1f2e/0x99288105fd38fcc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.283388:0:19859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511de00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:2.0:1788271978.283392:0:19859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c73f1f2e/0x99288105fd38fcc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.283401:0:19859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c73f1f2e/0x99288105fd38fcc6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.283416:0:19859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c73f1f2e/0x99288105fd38fcc6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.283434:0:19859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c73f1f2e/0x99288105fd38fcc6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.283452:0:19859:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271978.283456:0:19859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000027fa5e3/0x99288105fd38fcbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.283463:0:19859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6ec21dfe00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:2.0:1788271978.283466:0:19859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000027fa5e3/0x99288105fd38fcbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.283474:0:19859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000027fa5e3/0x99288105fd38fcbf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.283506:0:19859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000027fa5e3/0x99288105fd38fcbf lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.283513:0:19859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000027fa5e3/0x99288105fd38fcbf lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.283537:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271978.283539:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271978.283540:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788271978.283575:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788271978.283581:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a715506/0x99288105fd38fccd lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.283594:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788271978.283598:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271978.283602:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a715506/0x99288105fd38fccd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.283610:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a715506/0x99288105fd38fccd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.283632:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a715506/0x99288105fd38fccd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.283640:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a715506/0x99288105fd38fccd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.283653:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788271978.284704:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788271978.284712:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000987eb3bc/0x99288105fd38fcd4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.284722:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1788271978.284725:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788271978.284729:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000987eb3bc/0x99288105fd38fcd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.284739:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000987eb3bc/0x99288105fd38fcd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.284757:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000987eb3bc/0x99288105fd38fcd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.284764:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000987eb3bc/0x99288105fd38fcd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.284773:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788271978.285235:0:19859:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788271978.285241:0:19859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a715506/0x99288105fd38fccd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.285250:0:19859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6ec21de000 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:2.0:1788271978.285253:0:19859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a715506/0x99288105fd38fccd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.285261:0:19859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a715506/0x99288105fd38fccd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.285395:0:19859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a715506/0x99288105fd38fccd lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.285405:0:19859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a715506/0x99288105fd38fccd lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.285423:0:19859:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271978.285433:0:19859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000987eb3bc/0x99288105fd38fcd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.285440:0:19859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d81de5c00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:2.0:1788271978.285443:0:19859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000987eb3bc/0x99288105fd38fcd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.285450:0:19859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000987eb3bc/0x99288105fd38fcd4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.285460:0:19859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000987eb3bc/0x99288105fd38fcd4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.285467:0:19859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000987eb3bc/0x99288105fd38fcd4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.285479:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271978.285481:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271978.285482:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271978.285675:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271978.285716:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271978.286744:0:18721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788271978.286768:0:18721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8400575/0x99288105fd38fcdb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.286783:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=539s v=(0 0) 00010000:00010000:0.0:1788271978.286788:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271978.286793:0:18721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8400575/0x99288105fd38fcdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.286808:0:18721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8400575/0x99288105fd38fcdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.286831:0:18721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8400575/0x99288105fd38fcdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.286840:0:18721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8400575/0x99288105fd38fcdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.286863:0:18721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788271978.287189:0:19859:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788271978.287196:0:19859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8400575/0x99288105fd38fcdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.287205:0:19859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511c800 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:3.0:1788271978.287210:0:19859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8400575/0x99288105fd38fcdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.287231:0:19859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8400575/0x99288105fd38fcdb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.287246:0:19859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8400575/0x99288105fd38fcdb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.287255:0:19859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8400575/0x99288105fd38fcdb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.287273:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271978.287275:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271978.287277:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788271978.287408:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788271978.287415:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093608fa4/0x99288105fd38fce2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.287423:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=539s v=(0 0) 00010000:00010000:0.0:1788271978.287427:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271978.287431:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093608fa4/0x99288105fd38fce2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.287442:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093608fa4/0x99288105fd38fce2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.287450:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093608fa4/0x99288105fd38fce2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.287459:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093608fa4/0x99288105fd38fce2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.287495:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788271978.287993:0:18721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788271978.288001:0:18721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f94b99c/0x99288105fd38fce9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.288010:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=539s v=(0 0) 00010000:00010000:1.0:1788271978.288014:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271978.288018:0:18721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f94b99c/0x99288105fd38fce9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.288027:0:18721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f94b99c/0x99288105fd38fce9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.288044:0:18721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f94b99c/0x99288105fd38fce9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.288051:0:18721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f94b99c/0x99288105fd38fce9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.288074:0:18721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788271978.288083:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788271978.288090:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093608fa4/0x99288105fd38fce2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.288101:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511d800 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:2.0:1788271978.288105:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093608fa4/0x99288105fd38fce2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.288123:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093608fa4/0x99288105fd38fce2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.288205:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093608fa4/0x99288105fd38fce2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.288213:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093608fa4/0x99288105fd38fce2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.288320:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271978.288325:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f94b99c/0x99288105fd38fce9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.288332:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d81728200 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:2.0:1788271978.288335:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f94b99c/0x99288105fd38fce9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.288341:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271978.288343:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f94b99c/0x99288105fd38fce9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.288363:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f94b99c/0x99288105fd38fce9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.288370:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f94b99c/0x99288105fd38fce9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.288392:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271978.288394:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271978.288395:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788271978.289587:0:18721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788271978.289598:0:18721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae6f1e41/0x99288105fd38fcf0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.289611:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=539s v=(0 0) 00010000:00010000:1.0:1788271978.289614:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271978.289644:0:18721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae6f1e41/0x99288105fd38fcf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.289657:0:18721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae6f1e41/0x99288105fd38fcf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.289666:0:18721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae6f1e41/0x99288105fd38fcf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.289673:0:18721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae6f1e41/0x99288105fd38fcf0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.289703:0:18721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788271978.289981:0:19859:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788271978.289988:0:19859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae6f1e41/0x99288105fd38fcf0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.289996:0:19859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d81729a00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:3.0:1788271978.290001:0:19859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae6f1e41/0x99288105fd38fcf0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.290010:0:19859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae6f1e41/0x99288105fd38fcf0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.290023:0:19859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae6f1e41/0x99288105fd38fcf0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.290041:0:19859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae6f1e41/0x99288105fd38fcf0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.290057:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271978.290059:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271978.290060:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788271978.290566:0:18721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788271978.290572:0:18721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009fd4b65/0x99288105fd38fcf7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.290583:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=539s v=(0 0) 00010000:00010000:1.0:1788271978.290586:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271978.290590:0:18721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009fd4b65/0x99288105fd38fcf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.290600:0:18721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009fd4b65/0x99288105fd38fcf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.290609:0:18721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009fd4b65/0x99288105fd38fcf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.290629:0:18721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009fd4b65/0x99288105fd38fcf7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.290645:0:18721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788271978.291076:0:18721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788271978.291081:0:18721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5327ffd/0x99288105fd38fcfe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.291090:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=539s v=(0 0) 00010000:00010000:1.0:1788271978.291097:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788271978.291102:0:18721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5327ffd/0x99288105fd38fcfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.291112:0:18721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5327ffd/0x99288105fd38fcfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.291119:0:18721:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5327ffd/0x99288105fd38fcfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.291126:0:18721:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5327ffd/0x99288105fd38fcfe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271978.291146:0:18721:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:1.0:1788271978.291177:0:18721:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:1.0:1788271978.291269:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17238:x1875138590210688:12345-0@lo:5:osp-pre-1-0.0 Request processed in 62665us (70617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271978.291280:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1788271978.291334:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1788271978.291338:0:17238:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83ad0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17238:1875138590210688:0@lo:5:osp-pre-1-0.0 00010000:00010000:2.0:1788271978.291342:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009fd4b65/0x99288105fd38fcf7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788271978.291352:0:17238:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:1.0:1788271978.291396:0:17238:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83393800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17238:1875138590211072:0@lo:5:osp-pre-1-0.0 00010000:00010000:2.0:1788271978.291415:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d81728600 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:2.0:1788271978.291420:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009fd4b65/0x99288105fd38fcf7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271978.291428:0:17238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788271978.291429:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009fd4b65/0x99288105fd38fcf7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.291441:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009fd4b65/0x99288105fd38fcf7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.291448:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009fd4b65/0x99288105fd38fcf7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271978.291449:0:17238:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc98d3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788271978.291462:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271978.291465:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5327ffd/0x99288105fd38fcfe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271978.291465:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590211072 00000100:00100000:1.0:1788271978.291470:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590211072 00010000:00010000:2.0:1788271978.291471:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d81729e00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:2.0:1788271978.291479:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5327ffd/0x99288105fd38fcfe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.291486:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5327ffd/0x99288105fd38fcfe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.291495:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5327ffd/0x99288105fd38fcfe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271978.291502:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5327ffd/0x99288105fd38fcfe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271978.291503:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788271978.291511:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83390380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17957:x1875138590210944:12345-0@lo:7:osp-pre-1-1.0 00010000:00010000:2.0:1788271978.291514:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271978.291516:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271978.291517:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271978.291916:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788271978.293212:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788271978.293222:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003eeb634a/0x99288105fd38fd05 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.293238:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1788271978.293242:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271978.293248:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003eeb634a/0x99288105fd38fd05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.293260:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003eeb634a/0x99288105fd38fd05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.293269:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003eeb634a/0x99288105fd38fd05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.293276:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003eeb634a/0x99288105fd38fd05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.293338:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788271978.293840:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788271978.293846:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008c4401c/0x99288105fd38fd0c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.293857:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1788271978.293860:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271978.293864:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008c4401c/0x99288105fd38fd0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.293873:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008c4401c/0x99288105fd38fd0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.293880:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008c4401c/0x99288105fd38fd0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.293885:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008c4401c/0x99288105fd38fd0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.294894:0:19859:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788271978.294905:0:19859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003eeb634a/0x99288105fd38fd05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.294916:0:19859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e20400 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:0.0:1788271978.294920:0:19859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003eeb634a/0x99288105fd38fd05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.294929:0:19859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003eeb634a/0x99288105fd38fd05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.295013:0:19859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003eeb634a/0x99288105fd38fd05 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.295024:0:19859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003eeb634a/0x99288105fd38fd05 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.295042:0:19859:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271978.295046:0:19859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008c4401c/0x99288105fd38fd0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.295052:0:19859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e20000 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:0.0:1788271978.295055:0:19859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008c4401c/0x99288105fd38fd0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.295075:0:19859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008c4401c/0x99288105fd38fd0c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.295086:0:19859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008c4401c/0x99288105fd38fd0c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.295094:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271978.295096:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271978.295098:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271978.295187:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788271978.295194:0:18720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008c4401c/0x99288105fd38fd0c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.295355:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788271978.295481:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788271978.295488:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091e6764f/0x99288105fd38fd13 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.295500:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=539s v=(0 0) 00010000:00010000:3.0:1788271978.295511:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271978.295516:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091e6764f/0x99288105fd38fd13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.295545:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091e6764f/0x99288105fd38fd13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.295555:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091e6764f/0x99288105fd38fd13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.295563:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091e6764f/0x99288105fd38fd13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.295588:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788271978.296013:0:18722:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788271978.296020:0:18722:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788271978.296222:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83390380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17957:x1875138590210944:12345-0@lo:7:osp-pre-1-1.0 Request processed in 4707us (71494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271978.296233:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788271978.296266:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788271978.296278:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83392a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17238:x1875138590211072:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788271978.296317:0:18722:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:0.0:1788271978.299283:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788271978.299297:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091e6764f/0x99288105fd38fd13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.299314:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e20600 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:0.0:1788271978.299320:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091e6764f/0x99288105fd38fd13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.299332:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091e6764f/0x99288105fd38fd13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.299355:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091e6764f/0x99288105fd38fd13 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.299364:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091e6764f/0x99288105fd38fd13 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.299404:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271978.299406:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271978.299408:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271978.299895:0:17957:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83393100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17957:1875138590210944:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1788271978.299915:0:17957:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788271978.300030:0:17957:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8233bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17957:1875138590211200:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788271978.300100:0:17957:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271978.300141:0:17957:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb3ded540 going to sleep for 11 seconds 00000100:00100000:3.0:1788271978.300265:0:19409:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788271978.300274:0:19409:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00002000:00010000:0.0:1788271978.301376:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788271978.301387:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8400575/0x99288105fd38fd1a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.301405:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=539s v=(0 0) 00010000:00010000:0.0:1788271978.301409:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271978.301417:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8400575/0x99288105fd38fd1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.301430:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8400575/0x99288105fd38fd1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.301439:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8400575/0x99288105fd38fd1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271978.301447:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8400575/0x99288105fd38fd1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271978.301670:0:19409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590211200 00000100:00100000:1.0:1788271978.301679:0:19409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590211200 00010000:00010000:0.0:1788271978.301807:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788271978.301892:0:18720:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:0.0:1788271978.301985:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17236:x1875138590210432:12345-0@lo:5:osp-pre-0-0.0 Request processed in 83045us (83252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271978.301993:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788271978.302013:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788271978.302022:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17957:x1875138590211200:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788271978.302050:0:18720:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1788271978.302083:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17957:x1875138590211200:12345-0@lo:5:osp-pre-1-1.0 Request processed in 63us (1984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271978.302089:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788271978.302125:0:17957:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8233bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17957:1875138590211200:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788271978.302137:0:17957:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788271978.302179:0:17957:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8233bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17957:1875138590211328:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788271978.302206:0:17957:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271978.302228:0:17957:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb3ded540 going to sleep for 11 seconds 00000100:00100000:0.0:1788271978.302239:0:19409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590211328 00000100:00100000:0.0:1788271978.302242:0:19409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590211328 00000100:00100000:0.0:1788271978.302263:0:19409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788271978.302268:0:19409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8233ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17957:x1875138590211328:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788271978.302291:0:19409:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00000100:00100000:2.0:1788271978.303091:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17236:1875138590210432:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788271978.303104:0:17236:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:2.0:1788271978.303208:0:17236:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83ad1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17236:1875138590211456:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788271978.303248:0:17236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271978.303277:0:17236:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e856fb3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271978.304342:0:19862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590211456 00000100:00100000:2.0:1788271978.304353:0:19862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590211456 00000100:00100000:2.0:1788271978.304393:0:19862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788271978.304409:0:19862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17236:x1875138590211456:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788271978.304448:0:19862:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:3.0:1788271978.306451:0:19859:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788271978.306465:0:19859:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8400575/0x99288105fd38fd1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.306480:0:19859:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511c800 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:3.0:1788271978.306487:0:19859:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8400575/0x99288105fd38fd1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.306498:0:19859:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8400575/0x99288105fd38fd1a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.306522:0:19859:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8400575/0x99288105fd38fd1a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.306548:0:19859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8400575/0x99288105fd38fd1a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271978.306569:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271978.306572:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788271978.306574:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788271978.308945:0:19535:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1788271978.309132:0:19535:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788271978.309138:0:19535:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788271978.310122:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83392a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17238:x1875138590211072:12345-0@lo:5:osp-pre-1-0.0 Request processed in 13841us (18686us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788271978.310128:0:17238:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788271978.310140:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788271978.310140:0:17238:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83393800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17238:1875138590211072:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788271978.310162:0:17238:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000001:00080000:2.0:1788271978.311493:0:18716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1788271978.311546:0:18716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788271978.313879:0:19862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:17236:x1875138590211456:12345-0@lo:5:osp-pre-0-0.0 Request processed in 9469us (10622us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788271978.313894:0:19862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788271978.313902:0:17236:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1788271978.313912:0:17236:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83ad1c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17236:1875138590211456:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788271978.313931:0:17236:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000100:00100000:1.0:1788271978.322004:0:19409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8233ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17957:x1875138590211328:12345-0@lo:5:osp-pre-1-1.0 Request processed in 19728us (19790us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788271978.322017:0:19409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788271978.322664:0:17957:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8233bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17957:1875138590211328:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788271978.322685:0:17957:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788271978.322727:0:17957:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82339500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17957:1875138590211584:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788271978.322766:0:17957:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271978.322810:0:17957:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb3ded540 going to sleep for 11 seconds 00000100:00100000:2.0:1788271978.323026:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590211584 00000100:00100000:2.0:1788271978.323034:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590211584 00000100:00100000:2.0:1788271978.323086:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788271978.323097:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8233b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17957:x1875138590211584:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788271978.323157:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8233b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17957:x1875138590211584:12345-0@lo:900:osp-pre-1-1.0 Request processed in 62us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271978.323165:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788271978.323182:0:17957:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d82339500 x1875138590211584/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788271994 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271978.323194:0:17957:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82339500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17957:1875138590211584:0@lo:900:osp-pre-1-1.0 00000001:02000400:2.0:1788271978.541979:0:19891:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg103-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:0.0:1788271978.928369:0:17972:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788271979.101831:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788271979.332940:0:19944:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788271979.333156:0:19944:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788271980.132341:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788271980.193846:0:19994:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788271980.194049:0:19994:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788271980.385755:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271980.385858:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577548544 00000100:00100000:3.0:1788271980.385868:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577548544 00000100:00100000:3.0:1788271980.385923:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 114 00000100:00100000:3.0:1788271980.385932:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83260050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2394:x1875138577548544:12345-192.168.201.3@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788271980.385969:0:17206:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 1104fde8-2866-41ec-bd9b-e310797010eb@192.168.201.3@tcp t0 exp 0000000000000000 cur 541 last 0 00000020:00000080:3.0:1788271980.385998:0:17206:0:(genops.c:1385:class_connect()) connect: client 1104fde8-2866-41ec-bd9b-e310797010eb, cookie 0x99288105fd38fd21 00000100:00080000:3.0:1788271980.386143:0:17206:0:(import.c:65:import_set_state_nolock()) ffff8f6e84b06800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788271980.386235:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83260050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1104fde8-2866-41ec-bd9b-e310797010eb+5:2394:x1875138577548544:12345-192.168.201.3@tcp:250:mount.lustre.0 Request processed in 295us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271980.386245:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 114 00000100:00100000:2.0:1788271980.392708:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271980.392890:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577548672 00000100:00100000:1.0:1788271980.392900:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577548672 00000100:00100000:1.0:1788271980.392958:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 115 00000100:00100000:1.0:1788271980.392968:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83262050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1104fde8-2866-41ec-bd9b-e310797010eb+5:14910:x1875138577548672:12345-192.168.201.3@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788271980.392985:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271980.393012:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6d81728c00/0x99288105fd38fd28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd7d9 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271980.393060:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6d81728c00/0x99288105fd38fd28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd7d9 expref: 6 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271980.393073:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6d81728c00/0x99288105fd38fd28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd7d9 expref: 6 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271980.393082:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d81728c00, rc 0) 00000100:00100000:1.0:1788271980.393144:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83262050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1104fde8-2866-41ec-bd9b-e310797010eb+6:14910:x1875138577548672:12345-192.168.201.3@tcp:101:mount.lustre.0 Request processed in 177us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271980.393151:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 115 00000100:00100000:1.0:1788271980.401885:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271980.401960:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577548800 00000100:00100000:0.0:1788271980.401970:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577548800 00000100:00100000:0.0:1788271980.402022:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 116 00000100:00100000:0.0:1788271980.402030:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83261850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1104fde8-2866-41ec-bd9b-e310797010eb+6:14910:x1875138577548800:12345-192.168.201.3@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788271980.402141:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83261850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1104fde8-2866-41ec-bd9b-e310797010eb+6:14910:x1875138577548800:12345-192.168.201.3@tcp:501:mount.lustre.0 Request processed in 111us (265us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788271980.402149:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 116 00000100:00100000:2.0:1788271980.404575:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271980.404669:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577548928 00000100:00100000:3.0:1788271980.404679:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577548928 00000100:00100000:3.0:1788271980.404731:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 117 00000100:00100000:3.0:1788271980.404844:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83260c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1104fde8-2866-41ec-bd9b-e310797010eb+6:14910:x1875138577548928:12345-192.168.201.3@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788271980.404862:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271980.404879:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4e20000/0x99288105fd38fd2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd7e0 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271980.404923:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4e20000/0x99288105fd38fd2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd7e0 expref: 7 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271980.404935:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4e20000/0x99288105fd38fd2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd7e0 expref: 7 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271980.404945:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e20000, rc 0) 00000100:00100000:3.0:1788271980.405002:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83260c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1104fde8-2866-41ec-bd9b-e310797010eb+7:14910:x1875138577548928:12345-192.168.201.3@tcp:101:mount.lustre.0 Request processed in 262us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271980.405016:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 117 00000100:00100000:2.0:1788271980.412571:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271980.414440:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577549056 00000100:00100000:1.0:1788271980.414453:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577549056 00000100:00100000:1.0:1788271980.414532:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 118 00000100:00100000:1.0:1788271980.414542:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83263450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1104fde8-2866-41ec-bd9b-e310797010eb+7:14910:x1875138577549056:12345-192.168.201.3@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788271980.414728:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83263450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1104fde8-2866-41ec-bd9b-e310797010eb+8:14910:x1875138577549056:12345-192.168.201.3@tcp:501:mount.lustre.0 Request processed in 187us (2165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271980.414737:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 118 00000100:00100000:1.0:1788271980.426393:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271980.426653:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577549184 00000100:00100000:3.0:1788271980.426663:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577549184 00000100:00100000:3.0:1788271980.426715:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 119 00000100:00100000:3.0:1788271980.426727:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83261050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1104fde8-2866-41ec-bd9b-e310797010eb+8:14910:x1875138577549184:12345-192.168.201.3@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788271980.426938:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83261050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1104fde8-2866-41ec-bd9b-e310797010eb+8:14910:x1875138577549184:12345-192.168.201.3@tcp:503:mount.lustre.0 Request processed in 213us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271980.426946:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 119 00000100:00100000:2.0:1788271980.445839:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271980.446844:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577549312 00000100:00100000:1.0:1788271980.446855:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577549312 00000100:00100000:1.0:1788271980.446920:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 120 00000100:00100000:1.0:1788271980.446930:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83263850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1104fde8-2866-41ec-bd9b-e310797010eb+8:14928:x1875138577549312:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788271980.447085:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83263850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1104fde8-2866-41ec-bd9b-e310797010eb+8:14928:x1875138577549312:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 156us (1258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271980.447101:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 120 00000100:00100000:2.0:1788271980.471208:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271980.471317:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577549440 00000100:00100000:3.0:1788271980.471327:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577549440 00000100:00100000:3.0:1788271980.471434:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 121 00000100:00100000:3.0:1788271980.471445:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1104fde8-2866-41ec-bd9b-e310797010eb+8:14928:x1875138577549440:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788271980.471613:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83128450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1104fde8-2866-41ec-bd9b-e310797010eb+8:14928:x1875138577549440:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 169us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271980.471648:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 121 00000100:00100000:2.0:1788271980.482832:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271980.482892:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577549568 00000100:00100000:0.0:1788271980.482901:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577549568 00000100:00100000:0.0:1788271980.482998:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 122 00000100:00100000:0.0:1788271980.483007:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1104fde8-2866-41ec-bd9b-e310797010eb+8:14928:x1875138577549568:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788271980.483146:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83129450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1104fde8-2866-41ec-bd9b-e310797010eb+8:14928:x1875138577549568:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 140us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271980.483161:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 122 00000100:00100000:2.0:1788271980.492341:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271980.492496:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577549696 00000100:00100000:3.0:1788271980.492520:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577549696 00000100:00100000:3.0:1788271980.492576:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 123 00000100:00100000:3.0:1788271980.492586:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1104fde8-2866-41ec-bd9b-e310797010eb+8:14910:x1875138577549696:12345-192.168.201.3@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788271980.492603:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271980.492654:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4e21600/0x99288105fd38fd36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd811 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271980.492683:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4e21600/0x99288105fd38fd36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd811 expref: 9 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271980.492694:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4e21600/0x99288105fd38fd36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd811 expref: 9 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271980.492704:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e21600, rc 0) 00000100:00100000:3.0:1788271980.492762:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1104fde8-2866-41ec-bd9b-e310797010eb+9:14910:x1875138577549696:12345-192.168.201.3@tcp:101:mount.lustre.0 Request processed in 177us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271980.492768:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 123 00000100:00100000:2.0:1788271980.496386:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271980.496495:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577549824 00000100:00100000:0.0:1788271980.496506:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577549824 00000100:00100000:0.0:1788271980.496566:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 124 00000100:00100000:0.0:1788271980.496577:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8312a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1104fde8-2866-41ec-bd9b-e310797010eb+9:14910:x1875138577549824:12345-192.168.201.3@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788271980.496604:0:17205:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788271980.496659:0:17205:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788271980.496664:0:17205:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788271980.496667:0:17205:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788271980.496669:0:17205:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788271980.496671:0:17205:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1788271980.504577:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8312a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1104fde8-2866-41ec-bd9b-e310797010eb+9:14910:x1875138577549824:12345-192.168.201.3@tcp:256:mount.lustre.0 Request processed in 7990us (8188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271980.504592:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 124 00000100:00100000:2.0:1788271980.510774:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271980.514291:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577549952 00000100:00100000:1.0:1788271980.514305:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577549952 00000100:00100000:1.0:1788271980.514433:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 125 00000100:00100000:1.0:1788271980.514444:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1104fde8-2866-41ec-bd9b-e310797010eb+9:14910:x1875138577549952:12345-192.168.201.3@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788271980.514460:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271980.514476:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6d81728a00/0x99288105fd38fd3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd818 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271980.514528:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6d81728a00/0x99288105fd38fd3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd818 expref: 10 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271980.514540:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6d81728a00/0x99288105fd38fd3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd818 expref: 10 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271980.514548:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d81728a00, rc 0) 00000100:00100000:1.0:1788271980.514635:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1104fde8-2866-41ec-bd9b-e310797010eb+10:14910:x1875138577549952:12345-192.168.201.3@tcp:101:mount.lustre.0 Request processed in 175us (3853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271980.514644:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 125 00000100:00100000:2.0:1788271980.520505:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271980.520753:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577550080 00000100:00100000:0.0:1788271980.520763:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577550080 00000100:00100000:0.0:1788271980.520820:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 126 00000100:00100000:0.0:1788271980.520830:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1104fde8-2866-41ec-bd9b-e310797010eb+10:14910:x1875138577550080:12345-192.168.201.3@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788271980.521062:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1104fde8-2866-41ec-bd9b-e310797010eb+10:14910:x1875138577550080:12345-192.168.201.3@tcp:501:mount.lustre.0 Request processed in 232us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271980.521070:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 126 00000100:00100000:2.0:1788271980.524139:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271980.524254:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577550208 00000100:00100000:1.0:1788271980.524265:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577550208 00000100:00100000:1.0:1788271980.524319:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 127 00000100:00100000:1.0:1788271980.524329:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8312b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1104fde8-2866-41ec-bd9b-e310797010eb+10:14910:x1875138577550208:12345-192.168.201.3@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788271980.524478:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8312b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1104fde8-2866-41ec-bd9b-e310797010eb+10:14910:x1875138577550208:12345-192.168.201.3@tcp:503:mount.lustre.0 Request processed in 150us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271980.524495:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 127 00000100:00100000:2.0:1788271980.529250:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271980.529613:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577550336 00000100:00100000:0.0:1788271980.529648:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577550336 00000100:00100000:0.0:1788271980.529711:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 128 00000100:00100000:0.0:1788271980.529748:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1104fde8-2866-41ec-bd9b-e310797010eb+10:14933:x1875138577550336:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788271980.529902:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc816c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1104fde8-2866-41ec-bd9b-e310797010eb+10:14933:x1875138577550336:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 164us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271980.529910:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 128 00000100:00100000:2.0:1788271980.538148:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271980.538860:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577550464 00000100:00100000:3.0:1788271980.538874:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577550464 00000100:00100000:3.0:1788271980.538940:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 129 00000100:00100000:3.0:1788271980.538951:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc816450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1104fde8-2866-41ec-bd9b-e310797010eb+10:14933:x1875138577550464:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788271980.539131:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc816450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1104fde8-2866-41ec-bd9b-e310797010eb+10:14933:x1875138577550464:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 181us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271980.539139:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 129 00000100:00100000:2.0:1788271980.555086:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271980.555179:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271980.557299:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577550592 00000100:00100000:3.0:1788271980.557372:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577550592 00000100:00100000:3.0:1788271980.557421:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577550848 00000100:00100000:3.0:1788271980.557425:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577550848 00000100:00100000:3.0:1788271980.557469:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:3.0:1788271980.557479:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1875138577550592:12345-192.168.201.3@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788271980.557522:0:17212:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 8f7552d3-578c-40be-b601-54fb5b48de11@192.168.201.3@tcp t0 exp 0000000000000000 cur 541 last 0 00000020:00000080:3.0:1788271980.557587:0:17212:0:(genops.c:1385:class_connect()) connect: client 8f7552d3-578c-40be-b601-54fb5b48de11, cookie 0x99288105fd38fd44 00000004:00100000:3.0:1788271980.558002:0:17212:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788271980.558433:0:17212:0:(import.c:65:import_set_state_nolock()) ffff8f6d81e23800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788271980.558565:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f7552d3-578c-40be-b601-54fb5b48de11+6:2394:x1875138577550592:12345-192.168.201.3@tcp:38:mount.lustre.0 Request processed in 1086us (3488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271980.558574:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:2.0:1788271980.558598:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 8 00000100:00100000:2.0:1788271980.558604:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1875138577550848:12345-192.168.201.3@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788271980.558650:0:17212:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 8f7552d3-578c-40be-b601-54fb5b48de11@192.168.201.3@tcp t0 exp 0000000000000000 cur 541 last 0 00000020:00000080:2.0:1788271980.558686:0:17212:0:(genops.c:1385:class_connect()) connect: client 8f7552d3-578c-40be-b601-54fb5b48de11, cookie 0x99288105fd38fd4b 00000004:00100000:2.0:1788271980.558700:0:17212:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788271980.559038:0:17212:0:(import.c:65:import_set_state_nolock()) ffff8f6d81e24000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788271980.559066:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f7552d3-578c-40be-b601-54fb5b48de11+6:2394:x1875138577550848:12345-192.168.201.3@tcp:38:mount.lustre.0 Request processed in 460us (3886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271980.559073:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 8 00000100:00100000:3.0:1788271980.564233:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271980.564344:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271980.564418:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271980.564475:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577550976 00000100:00100000:3.0:1788271980.564497:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577550976 00000100:00100000:3.0:1788271980.564546:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577550720 00000100:00100000:3.0:1788271980.564550:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577550720 00000100:00100000:3.0:1788271980.564564:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577551104 00000100:00100000:3.0:1788271980.564567:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577551104 00000100:00100000:3.0:1788271980.564580:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 9 00000100:00100000:3.0:1788271980.564588:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f7552d3-578c-40be-b601-54fb5b48de11+6:0:x1875138577550976:12345-192.168.201.3@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788271980.564650:0:17211:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00080000:1.0:1788271980.565119:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788271980.565124:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788271980.565537:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f7552d3-578c-40be-b601-54fb5b48de11+6:0:x1875138577550976:12345-192.168.201.3@tcp:41:mount.lustre.0 Request processed in 946us (1325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271980.565547:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 9 00000100:00100000:3.0:1788271980.565572:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 10 00000100:00100000:3.0:1788271980.565582:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f7552d3-578c-40be-b601-54fb5b48de11+7:0:x1875138577550720:12345-192.168.201.3@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788271980.565603:0:17211:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788271980.566463:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f7552d3-578c-40be-b601-54fb5b48de11+7:0:x1875138577550720:12345-192.168.201.3@tcp:41:mount.lustre.0 Request processed in 880us (2115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271980.566472:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 10 00000100:00100000:0.0:1788271980.566567:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 11 00000100:00100000:0.0:1788271980.566578:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f7552d3-578c-40be-b601-54fb5b48de11+6:14910:x1875138577551104:12345-192.168.201.3@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788271980.566595:0:17211:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788271980.566659:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f7552d3-578c-40be-b601-54fb5b48de11+6:14910:x1875138577551104:12345-192.168.201.3@tcp:41:mount.lustre.0 Request processed in 85us (2240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271980.566666:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 11 00000100:00100000:1.0:1788271980.580900:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271980.581015:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577551232 00000100:00100000:0.0:1788271980.581025:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577551232 00000100:00100000:0.0:1788271980.581085:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 12 00000100:00100000:0.0:1788271980.581096:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83393b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f7552d3-578c-40be-b601-54fb5b48de11+6:14910:x1875138577551232:12345-192.168.201.3@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788271980.581182:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83393b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f7552d3-578c-40be-b601-54fb5b48de11+6:14910:x1875138577551232:12345-192.168.201.3@tcp:40:mount.lustre.0 Request processed in 88us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271980.581190:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 12 00000100:00100000:0.0:1788271980.584125:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271980.584162:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271980.584194:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271980.584330:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577551360 00000100:00100000:2.0:1788271980.584340:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577551360 00000100:00100000:2.0:1788271980.584373:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577551488 00000100:00100000:2.0:1788271980.584375:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577551488 00000100:00100000:2.0:1788271980.584406:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 16 00000100:00100000:2.0:1788271980.584414:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8233a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2394:x1875138577551360:12345-192.168.201.3@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788271980.584447:0:18721:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 8f7552d3-578c-40be-b601-54fb5b48de11@192.168.201.3@tcp t0 exp 0000000000000000 cur 541 last 0 00000020:00000080:2.0:1788271980.584482:0:18721:0:(genops.c:1385:class_connect()) connect: client 8f7552d3-578c-40be-b601-54fb5b48de11, cookie 0x99288105fd38fd52 00002000:00100000:2.0:1788271980.584505:0:18721:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8f7552d3-578c-40be-b601-54fb5b48de11/ffff8f6d81e25000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788271980.584524:0:18721:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788271980.584725:0:18721:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788271980.584981:0:18721:0:(import.c:65:import_set_state_nolock()) ffff8f6d81e25800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788271980.585046:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8233a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8f7552d3-578c-40be-b601-54fb5b48de11+6:2394:x1875138577551360:12345-192.168.201.3@tcp:8:mount.lustre.0 Request processed in 630us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271980.585055:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 16 00000100:00100000:2.0:1788271980.585072:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 17 00000100:00100000:2.0:1788271980.585077:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82339c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2394:x1875138577551488:12345-192.168.201.3@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788271980.585093:0:18721:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 8f7552d3-578c-40be-b601-54fb5b48de11@192.168.201.3@tcp t0 exp 0000000000000000 cur 541 last 0 00000020:00000080:2.0:1788271980.585109:0:18721:0:(genops.c:1385:class_connect()) connect: client 8f7552d3-578c-40be-b601-54fb5b48de11, cookie 0x99288105fd38fd59 00002000:00100000:2.0:1788271980.585114:0:18721:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8f7552d3-578c-40be-b601-54fb5b48de11/ffff8f6eb4b8e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788271980.585125:0:18721:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788271980.585250:0:18721:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788271980.585266:0:18721:0:(import.c:65:import_set_state_nolock()) ffff8f6eb4b89000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788271980.585288:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82339c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8f7552d3-578c-40be-b601-54fb5b48de11+6:2394:x1875138577551488:12345-192.168.201.3@tcp:8:mount.lustre.0 Request processed in 210us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271980.585293:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 17 00000100:00100000:1.0:1788271980.587066:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577551616 00000100:00100000:1.0:1788271980.587078:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577551616 00000100:00100000:1.0:1788271980.587139:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 3 00000100:00100000:1.0:1788271980.587149:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8f7552d3-578c-40be-b601-54fb5b48de11+6:14910:x1875138577551616:12345-192.168.201.3@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788271980.587231:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8f7552d3-578c-40be-b601-54fb5b48de11+6:14910:x1875138577551616:12345-192.168.201.3@tcp:900:mount.lustre.0 Request processed in 75us (3060us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271980.587239:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 3 00000100:00100000:0.0:1788271980.591475:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271980.591597:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577551744 00000100:00100000:1.0:1788271980.591607:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577551744 00000100:00100000:1.0:1788271980.591686:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 0 00000100:00100000:1.0:1788271980.591696:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8f7552d3-578c-40be-b601-54fb5b48de11+6:14910:x1875138577551744:12345-192.168.201.3@tcp:33:mount.lustre.0 00000004:00080000:1.0:1788271980.598790:0:17214:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 7000us 00000004:00200000:1.0:1788271980.609935:0:17214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788271980.610104:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8f7552d3-578c-40be-b601-54fb5b48de11+6:14910:x1875138577551744:12345-192.168.201.3@tcp:33:mount.lustre.0 Request processed in 18404us (18631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271980.610116:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 0 00000100:00100000:0.0:1788271980.737197:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271980.737477:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577551872 00000100:00100000:2.0:1788271980.737498:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577551872 00000100:00100000:2.0:1788271980.737712:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 13 00000100:00100000:2.0:1788271980.737723:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f7552d3-578c-40be-b601-54fb5b48de11+6:14956:x1875138577551872:12345-192.168.201.3@tcp:101:mkdir.0 00010000:00010000:2.0:1788271980.737744:0:17211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271980.737808:0:17211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4600/0x99288105fd38fd60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd849 expref: -99 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271980.738959:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5a00/0x99288105fd38fd67 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271980.738995:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5a00/0x99288105fd38fd67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271980.739011:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5a00/0x99288105fd38fd67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271980.739066:0:17211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788271980.739070:0:17211:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788271980.739106:0:17211:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5a00/0x99288105fd38fd67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271980.739136:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4600/0x99288105fd38fd60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd849 expref: 8 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271980.739156:0:17211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5a00/0x99288105fd38fd67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd849 expref: 7 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271980.739165:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6e88835600) 00010000:00010000:2.0:1788271980.739167:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788271980.739171:0:17211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d81de5a00, rc 0) 00000100:00100000:2.0:1788271980.739246:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f7552d3-578c-40be-b601-54fb5b48de11+7:14956:x1875138577551872:12345-192.168.201.3@tcp:101:mkdir.0 Request processed in 1524us (2059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271980.739253:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 13 00010000:00010000:3.0:1788271981.150023:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271981.598334:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788271981.598358:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590211712:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788271981.598432:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271981.598612:0:18724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590211712 00000100:00100000:3.0:1788271981.598656:0:18724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590211712 00000100:00100000:3.0:1788271981.598729:0:18724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788271981.598740:0:18724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590211712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788271981.598764:0:18724:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788271981.598833:0:18724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590211712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271981.598840:0:18724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788271981.599232:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ecc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590211712:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788271981.599314:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788271982.110303:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788271982.110340:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590211840:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788271982.110411:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271982.111362:0:17953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590211840 00000100:00100000:3.0:1788271982.111372:0:17953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590211840 00000100:00100000:3.0:1788271982.111433:0:17953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788271982.111444:0:17953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590211840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788271982.111490:0:17953:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788271982.111553:0:17953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590211840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271982.111561:0:17953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788271982.115678:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590211840:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788271982.123078:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83392d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590211968:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788271982.123155:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271982.124865:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590211968 00000100:00100000:3.0:1788271982.124876:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590211968 00000100:00100000:3.0:1788271982.124943:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788271982.124953:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590211968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788271982.124987:0:17216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788271982.127065:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590211968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2107us (3902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271982.127077:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788271982.129958:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83392d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590211968:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788271982.174951:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271982.666153:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271982.666437:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577552000 00000100:00100000:0.0:1788271982.666447:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577552000 00000100:00100000:0.0:1788271982.666540:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 14 00000100:00100000:0.0:1788271982.666552:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f7552d3-578c-40be-b601-54fb5b48de11+7:15008:x1875138577552000:12345-192.168.201.3@tcp:41:lfs.0 00000004:00000024:0.0:1788271982.666583:0:17212:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788271982.666943:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f7552d3-578c-40be-b601-54fb5b48de11+7:15008:x1875138577552000:12345-192.168.201.3@tcp:41:lfs.0 Request processed in 392us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271982.666951:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 14 00000100:00080000:1.0:1788271982.667223:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271982.671615:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271982.672682:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577552128 00000100:00100000:2.0:1788271982.672698:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577552128 00000100:00100000:2.0:1788271982.672800:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 15 00000100:00080000:1.0:1788271982.672815:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788271982.672817:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83391f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f7552d3-578c-40be-b601-54fb5b48de11+6:15008:x1875138577552128:12345-192.168.201.3@tcp:41:lfs.0 00000004:00000024:2.0:1788271982.672863:0:17211:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788271982.672964:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83391f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f7552d3-578c-40be-b601-54fb5b48de11+6:15008:x1875138577552128:12345-192.168.201.3@tcp:41:lfs.0 Request processed in 154us (1366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271982.672971:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 15 00000100:00100000:2.0:1788271982.677716:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271982.677887:0:18724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577552256 00000100:00100000:3.0:1788271982.677911:0:18724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577552256 00000100:00100000:3.0:1788271982.678003:0:18724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 6 00000100:00100000:3.0:1788271982.678016:0:18724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8f7552d3-578c-40be-b601-54fb5b48de11+6:15008:x1875138577552256:12345-192.168.201.3@tcp:13:lfs.0 00002000:00000024:3.0:1788271982.678086:0:18724:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788271982.678214:0:18724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8f7552d3-578c-40be-b601-54fb5b48de11+6:15008:x1875138577552256:12345-192.168.201.3@tcp:13:lfs.0 Request processed in 200us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271982.678223:0:18724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 6 00000100:00080000:1.0:1788271982.679247:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788271982.681891:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271982.682142:0:18724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577552384 00000100:00100000:3.0:1788271982.682233:0:18724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577552384 00000100:00100000:3.0:1788271982.682376:0:18724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:3.0:1788271982.682390:0:18724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83390a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8f7552d3-578c-40be-b601-54fb5b48de11+6:15008:x1875138577552384:12345-192.168.201.3@tcp:13:lfs.0 00002000:00000024:3.0:1788271982.682439:0:18724:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788271982.682613:0:18724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83390a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8f7552d3-578c-40be-b601-54fb5b48de11+6:15008:x1875138577552384:12345-192.168.201.3@tcp:13:lfs.0 Request processed in 226us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271982.682660:0:18724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00080000:1.0:1788271982.683250:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788271982.878067:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271982.881580:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577552512 00000100:00100000:1.0:1788271982.881642:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577552512 00000100:00100000:1.0:1788271982.881838:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 130 00000100:00100000:1.0:1788271982.881851:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc815450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1104fde8-2866-41ec-bd9b-e310797010eb+10:15040:x1875138577552512:12345-192.168.201.3@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788271982.881871:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271982.881893:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6d81729000/0x99288105fd38fd6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd850 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271982.881932:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6d81729000/0x99288105fd38fd6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd850 expref: 11 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271982.881946:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6d81729000/0x99288105fd38fd6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd850 expref: 11 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271982.882008:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d81729000, rc 0) 00000100:00100000:1.0:1788271982.882094:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc815450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1104fde8-2866-41ec-bd9b-e310797010eb+11:15040:x1875138577552512:12345-192.168.201.3@tcp:101:mount.lustre.0 Request processed in 246us (4046us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271982.882100:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 130 00000100:00100000:2.0:1788271982.885501:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271982.885691:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577552640 00000100:00100000:0.0:1788271982.885838:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577552640 00000100:00100000:0.0:1788271982.885975:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 131 00000100:00100000:0.0:1788271982.885989:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1104fde8-2866-41ec-bd9b-e310797010eb+11:15040:x1875138577552640:12345-192.168.201.3@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788271982.886229:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc814850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1104fde8-2866-41ec-bd9b-e310797010eb+11:15040:x1875138577552640:12345-192.168.201.3@tcp:501:mount.lustre.0 Request processed in 243us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271982.886252:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 131 00000100:00100000:2.0:1788271982.888582:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271982.892138:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577552768 00000100:00100000:1.0:1788271982.892159:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577552768 00000100:00100000:1.0:1788271982.892237:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 132 00000100:00100000:1.0:1788271982.892260:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc815850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1104fde8-2866-41ec-bd9b-e310797010eb+11:15040:x1875138577552768:12345-192.168.201.3@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788271982.892496:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc815850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1104fde8-2866-41ec-bd9b-e310797010eb+11:15040:x1875138577552768:12345-192.168.201.3@tcp:503:mount.lustre.0 Request processed in 237us (3925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271982.892504:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 132 00000100:00100000:2.0:1788271982.898113:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271982.898230:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577552896 00000100:00100000:1.0:1788271982.898245:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577552896 00000100:00100000:1.0:1788271982.898332:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 133 00000100:00100000:1.0:1788271982.898345:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1104fde8-2866-41ec-bd9b-e310797010eb+11:15046:x1875138577552896:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788271982.898567:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc816050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1104fde8-2866-41ec-bd9b-e310797010eb+11:15046:x1875138577552896:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 223us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271982.898575:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 133 00000100:00100000:2.0:1788271982.936490:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271982.940176:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577553024 00000100:00100000:3.0:1788271982.940202:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577553024 00000100:00100000:3.0:1788271982.940360:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 134 00000100:00100000:3.0:1788271982.940375:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1104fde8-2866-41ec-bd9b-e310797010eb+11:15046:x1875138577553024:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788271982.940704:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc817850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1104fde8-2866-41ec-bd9b-e310797010eb+11:15046:x1875138577553024:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 321us (4221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271982.940714:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 134 00000100:00100000:3.0:1788271982.954293:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271982.954388:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577553152 00000100:00100000:0.0:1788271982.954402:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577553152 00000100:00100000:0.0:1788271982.954486:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 135 00000100:00100000:0.0:1788271982.954515:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc815c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1104fde8-2866-41ec-bd9b-e310797010eb+11:15046:x1875138577553152:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788271982.954907:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc815c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1104fde8-2866-41ec-bd9b-e310797010eb+11:15046:x1875138577553152:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 394us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271982.954917:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 135 00000100:00100000:3.0:1788271982.957152:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271982.957440:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577553280 00000100:00100000:0.0:1788271982.957463:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577553280 00000100:00100000:0.0:1788271982.957586:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 136 00000100:00100000:0.0:1788271982.957598:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1104fde8-2866-41ec-bd9b-e310797010eb+11:15040:x1875138577553280:12345-192.168.201.3@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788271982.957640:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271982.957664:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6e8511c200/0x99288105fd38fd75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd881 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271982.957711:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6e8511c200/0x99288105fd38fd75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd881 expref: 12 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271982.957723:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6e8511c200/0x99288105fd38fd75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd881 expref: 12 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271982.957734:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e8511c200, rc 0) 00000100:00100000:0.0:1788271982.957794:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc817050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1104fde8-2866-41ec-bd9b-e310797010eb+12:15040:x1875138577553280:12345-192.168.201.3@tcp:101:mount.lustre.0 Request processed in 198us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271982.957801:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 136 00000100:00100000:2.0:1788271982.959893:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271982.960041:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577553408 00000100:00100000:0.0:1788271982.960054:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577553408 00000100:00100000:0.0:1788271982.960137:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 137 00000100:00100000:0.0:1788271982.960147:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1104fde8-2866-41ec-bd9b-e310797010eb+12:15040:x1875138577553408:12345-192.168.201.3@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788271982.960176:0:17205:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788271982.960213:0:17205:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788271982.960217:0:17205:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788271982.960219:0:17205:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788271982.960222:0:17205:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788271982.960225:0:17205:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1788271982.962359:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc816850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1104fde8-2866-41ec-bd9b-e310797010eb+12:15040:x1875138577553408:12345-192.168.201.3@tcp:256:mount.lustre.0 Request processed in 2196us (2460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271982.962377:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 137 00000100:00100000:3.0:1788271982.964351:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271982.964430:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577553536 00000100:00100000:0.0:1788271982.964474:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577553536 00000100:00100000:0.0:1788271982.964548:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 138 00000100:00100000:0.0:1788271982.964561:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1104fde8-2866-41ec-bd9b-e310797010eb+12:15040:x1875138577553536:12345-192.168.201.3@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788271982.964586:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271982.964611:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6e8511de00/0x99288105fd38fd7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd888 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271982.964688:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6e8511de00/0x99288105fd38fd7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd888 expref: 13 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271982.964701:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6e8511de00/0x99288105fd38fd7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd888 expref: 13 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271982.964713:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e8511de00, rc 0) 00000100:00100000:0.0:1788271982.964776:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc814c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1104fde8-2866-41ec-bd9b-e310797010eb+13:15040:x1875138577553536:12345-192.168.201.3@tcp:101:mount.lustre.0 Request processed in 217us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271982.964784:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 138 00000100:00100000:2.0:1788271982.966379:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271982.966571:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577553664 00000100:00100000:0.0:1788271982.966583:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577553664 00000100:00100000:0.0:1788271982.966798:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 139 00000100:00100000:0.0:1788271982.966831:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e83ea2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1104fde8-2866-41ec-bd9b-e310797010eb+13:15040:x1875138577553664:12345-192.168.201.3@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788271982.967430:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e83ea2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1104fde8-2866-41ec-bd9b-e310797010eb+13:15040:x1875138577553664:12345-192.168.201.3@tcp:501:mount.lustre.0 Request processed in 597us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271982.967441:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 139 00000100:00100000:1.0:1788271982.969565:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271982.969974:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577553792 00000100:00100000:0.0:1788271982.969988:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577553792 00000100:00100000:0.0:1788271982.970485:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 140 00000100:00100000:0.0:1788271982.970500:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1104fde8-2866-41ec-bd9b-e310797010eb+13:15040:x1875138577553792:12345-192.168.201.3@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788271982.970722:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87094850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1104fde8-2866-41ec-bd9b-e310797010eb+13:15040:x1875138577553792:12345-192.168.201.3@tcp:503:mount.lustre.0 Request processed in 225us (1168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271982.970731:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 140 00000100:00100000:3.0:1788271982.973229:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271982.973828:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577553920 00000100:00100000:1.0:1788271982.973842:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577553920 00000100:00100000:1.0:1788271982.974114:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 141 00000100:00100000:1.0:1788271982.974126:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1104fde8-2866-41ec-bd9b-e310797010eb+13:15052:x1875138577553920:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788271982.974351:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87095850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1104fde8-2866-41ec-bd9b-e310797010eb+13:15052:x1875138577553920:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 226us (1132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271982.974361:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 141 00000100:00100000:2.0:1788271982.981016:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271982.981133:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577554048 00000100:00100000:3.0:1788271982.981228:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577554048 00000100:00100000:3.0:1788271982.981304:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 142 00000100:00100000:3.0:1788271982.981334:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1104fde8-2866-41ec-bd9b-e310797010eb+13:15052:x1875138577554048:12345-192.168.201.3@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788271982.981602:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87095c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1104fde8-2866-41ec-bd9b-e310797010eb+13:15052:x1875138577554048:12345-192.168.201.3@tcp:502:llog_process_th.0 Request processed in 269us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271982.981612:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 142 00000100:00100000:0.0:1788271982.992276:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271982.992333:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271982.992376:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271982.992416:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271982.992439:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271982.992514:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577554432 00000100:00100000:0.0:1788271982.992515:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271982.992528:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577554432 00000100:00100000:3.0:1788271982.992585:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577554560 00000100:00100000:3.0:1788271982.992589:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577554560 00000100:00100000:3.0:1788271982.992600:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577554176 00000100:00100000:3.0:1788271982.992602:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577554176 00000100:00100000:3.0:1788271982.992611:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577554944 00000100:00100000:3.0:1788271982.992612:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577554944 00000100:00100000:2.0:1788271982.992662:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577554688 00000100:00100000:2.0:1788271982.992668:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577554688 00000100:00100000:3.0:1788271982.992674:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 32 00000100:00100000:3.0:1788271982.992688:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f7552d3-578c-40be-b601-54fb5b48de11+7:2398:x1875138577554432:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271982.992785:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f7552d3-578c-40be-b601-54fb5b48de11+7:2398:x1875138577554432:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 100us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271982.992793:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 32 00000100:00100000:3.0:1788271982.992814:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 33 00000100:00100000:3.0:1788271982.992820:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f7552d3-578c-40be-b601-54fb5b48de11+6:2398:x1875138577554560:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271982.992843:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f7552d3-578c-40be-b601-54fb5b48de11+6:2398:x1875138577554560:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 24us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271982.992850:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 33 00000100:00100000:3.0:1788271982.992860:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 16 00000100:00100000:3.0:1788271982.992864:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2394:x1875138577554176:12345-192.168.201.3@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788271982.992890:0:17213:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 8a6e7813-b915-4224-95b8-fa91b7ad9b79@192.168.201.3@tcp t0 exp 0000000000000000 cur 544 last 0 00000020:00000080:3.0:1788271982.992956:0:17213:0:(genops.c:1385:class_connect()) connect: client 8a6e7813-b915-4224-95b8-fa91b7ad9b79, cookie 0x99288105fd38fd83 00000100:00100000:1.0:1788271982.992961:0:19409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577554816 00000100:00100000:1.0:1788271982.992967:0:19409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577554816 00000004:00100000:3.0:1788271982.993002:0:17213:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788271982.993003:0:19409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 2 00000100:00100000:1.0:1788271982.993014:0:19409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8f7552d3-578c-40be-b601-54fb5b48de11+6:2398:x1875138577554816:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271982.993048:0:19409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8f7552d3-578c-40be-b601-54fb5b48de11+6:2398:x1875138577554816:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 35us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271982.993055:0:19409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 2 00000100:00080000:3.0:1788271982.993127:0:17213:0:(import.c:65:import_set_state_nolock()) ffff8f6e84b02800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788271982.993163:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a6e7813-b915-4224-95b8-fa91b7ad9b79+6:2394:x1875138577554176:12345-192.168.201.3@tcp:38:mount.lustre.0 Request processed in 296us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271982.993171:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 16 00000100:00100000:3.0:1788271982.993190:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 17 00000100:00100000:3.0:1788271982.993196:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2394:x1875138577554944:12345-192.168.201.3@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788271982.993213:0:17213:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 8a6e7813-b915-4224-95b8-fa91b7ad9b79@192.168.201.3@tcp t0 exp 0000000000000000 cur 544 last 0 00000020:00000080:3.0:1788271982.993238:0:17213:0:(genops.c:1385:class_connect()) connect: client 8a6e7813-b915-4224-95b8-fa91b7ad9b79, cookie 0x99288105fd38fd8a 00000004:00100000:3.0:1788271982.993263:0:17213:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788271982.993429:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 3 00000100:00100000:2.0:1788271982.993438:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d839cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8f7552d3-578c-40be-b601-54fb5b48de11+6:2398:x1875138577554688:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788271982.993483:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d839cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8f7552d3-578c-40be-b601-54fb5b48de11+6:2398:x1875138577554688:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 46us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271982.993490:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 3 00000100:00080000:3.0:1788271982.995903:0:17213:0:(import.c:65:import_set_state_nolock()) ffff8f6ebc266800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788271982.996322:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a6e7813-b915-4224-95b8-fa91b7ad9b79+6:2394:x1875138577554944:12345-192.168.201.3@tcp:38:mount.lustre.0 Request processed in 3116us (3799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271982.996336:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 17 00000100:00100000:0.0:1788271983.000414:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271983.000873:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577555200 00000100:00100000:2.0:1788271983.000888:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577555200 00000100:00100000:2.0:1788271983.001009:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 18 00000100:00100000:2.0:1788271983.001040:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a6e7813-b915-4224-95b8-fa91b7ad9b79+6:15040:x1875138577555200:12345-192.168.201.3@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788271983.001093:0:17212:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788271983.001196:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a6e7813-b915-4224-95b8-fa91b7ad9b79+6:15040:x1875138577555200:12345-192.168.201.3@tcp:41:mount.lustre.0 Request processed in 159us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271983.001204:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 18 00000100:00100000:2.0:1788271983.002757:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271983.002876:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577554304 00000100:00100000:3.0:1788271983.002886:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577554304 00000100:00100000:3.0:1788271983.002945:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 19 00000100:00100000:3.0:1788271983.002963:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a6e7813-b915-4224-95b8-fa91b7ad9b79+6:0:x1875138577554304:12345-192.168.201.3@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788271983.002999:0:17213:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788271983.003087:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a6e7813-b915-4224-95b8-fa91b7ad9b79+6:0:x1875138577554304:12345-192.168.201.3@tcp:41:mount.lustre.0 Request processed in 133us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271983.003096:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 19 00000100:00080000:1.0:1788271983.003564:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788271983.008999:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271983.009107:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271983.009470:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577555328 00000100:00100000:2.0:1788271983.009489:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577555328 00000100:00100000:2.0:1788271983.009557:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577555072 00000100:00100000:2.0:1788271983.009560:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577555072 00000100:00100000:2.0:1788271983.009598:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 20 00000100:00100000:2.0:1788271983.009609:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a6e7813-b915-4224-95b8-fa91b7ad9b79+6:15040:x1875138577555328:12345-192.168.201.3@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788271983.009756:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a6e7813-b915-4224-95b8-fa91b7ad9b79+6:15040:x1875138577555328:12345-192.168.201.3@tcp:40:mount.lustre.0 Request processed in 148us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271983.009764:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 20 00000100:00100000:2.0:1788271983.009784:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 21 00000100:00100000:2.0:1788271983.009790:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a6e7813-b915-4224-95b8-fa91b7ad9b79+6:0:x1875138577555072:12345-192.168.201.3@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788271983.009816:0:17213:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788271983.009861:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a6e7813-b915-4224-95b8-fa91b7ad9b79+6:0:x1875138577555072:12345-192.168.201.3@tcp:41:mount.lustre.0 Request processed in 71us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271983.009868:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 21 00000100:00080000:2.0:1788271983.009887:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788271983.012546:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271983.012591:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271983.012662:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271983.012839:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577555712 00000100:00100000:1.0:1788271983.012851:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577555712 00000100:00100000:1.0:1788271983.012935:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 4 00000100:00100000:1.0:1788271983.012947:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8a6e7813-b915-4224-95b8-fa91b7ad9b79+6:15040:x1875138577555712:12345-192.168.201.3@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788271983.013051:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:8a6e7813-b915-4224-95b8-fa91b7ad9b79+6:15040:x1875138577555712:12345-192.168.201.3@tcp:900:mount.lustre.0 Request processed in 106us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271983.013081:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 4 00000100:00100000:3.0:1788271983.013661:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577555456 00000100:00100000:3.0:1788271983.013669:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577555456 00000100:00100000:3.0:1788271983.013715:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577555584 00000100:00100000:3.0:1788271983.013719:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577555584 00000100:00100000:3.0:1788271983.013738:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 18 00000100:00100000:3.0:1788271983.013745:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2394:x1875138577555456:12345-192.168.201.3@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788271983.013781:0:18720:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 8a6e7813-b915-4224-95b8-fa91b7ad9b79@192.168.201.3@tcp t0 exp 0000000000000000 cur 544 last 0 00000020:00000080:3.0:1788271983.013827:0:18720:0:(genops.c:1385:class_connect()) connect: client 8a6e7813-b915-4224-95b8-fa91b7ad9b79, cookie 0x99288105fd38fd91 00002000:00100000:3.0:1788271983.013842:0:18720:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8a6e7813-b915-4224-95b8-fa91b7ad9b79/ffff8f6ebc261800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788271983.013858:0:18720:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788271983.013970:0:18720:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788271983.014008:0:18720:0:(import.c:65:import_set_state_nolock()) ffff8f6ebc263000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788271983.014055:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a6e7813-b915-4224-95b8-fa91b7ad9b79+6:2394:x1875138577555456:12345-192.168.201.3@tcp:8:mount.lustre.0 Request processed in 309us (1463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271983.014064:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 18 00000100:00100000:3.0:1788271983.014080:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 19 00000100:00100000:3.0:1788271983.014085:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2394:x1875138577555584:12345-192.168.201.3@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788271983.014104:0:18720:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 8a6e7813-b915-4224-95b8-fa91b7ad9b79@192.168.201.3@tcp t0 exp 0000000000000000 cur 544 last 0 00000020:00000080:3.0:1788271983.014122:0:18720:0:(genops.c:1385:class_connect()) connect: client 8a6e7813-b915-4224-95b8-fa91b7ad9b79, cookie 0x99288105fd38fd98 00002000:00100000:3.0:1788271983.014127:0:18720:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8a6e7813-b915-4224-95b8-fa91b7ad9b79/ffff8f6ebc264800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113940 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788271983.014134:0:18720:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788271983.014180:0:18720:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788271983.014198:0:18720:0:(import.c:65:import_set_state_nolock()) ffff8f6ebc267800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788271983.014221:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8a6e7813-b915-4224-95b8-fa91b7ad9b79+6:2394:x1875138577555584:12345-192.168.201.3@tcp:8:mount.lustre.0 Request processed in 135us (1558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271983.014228:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 19 00000100:00100000:0.0:1788271983.018780:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271983.019364:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577555840 00000100:00100000:1.0:1788271983.019382:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577555840 00000100:00100000:1.0:1788271983.019465:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 1 00000100:00100000:1.0:1788271983.019479:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a6e7813-b915-4224-95b8-fa91b7ad9b79+6:15040:x1875138577555840:12345-192.168.201.3@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788271983.019612:0:17215:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788271983.020165:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a6e7813-b915-4224-95b8-fa91b7ad9b79+6:15040:x1875138577555840:12345-192.168.201.3@tcp:33:mount.lustre.0 Request processed in 686us (1398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271983.020301:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 1 00010000:00010000:1.0:1788271983.198017:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271983.210944:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271983.211025:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577555968 00000100:00100000:3.0:1788271983.211038:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577555968 00000100:00100000:3.0:1788271983.211102:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 22 00000100:00100000:3.0:1788271983.211112:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a6e7813-b915-4224-95b8-fa91b7ad9b79+6:15075:x1875138577555968:12345-192.168.201.3@tcp:101:mkdir.0 00010000:00010000:3.0:1788271983.211138:0:17213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271983.211169:0:17213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21200/0x99288105fd38fd9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd8b9 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271983.211245:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38fda6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271983.211262:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38fda6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271983.211277:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38fda6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271983.211342:0:17213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788271983.211345:0:17213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788271983.211369:0:17213:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38fda6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271983.211395:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21200/0x99288105fd38fd9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd8b9 expref: 8 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271983.211412:0:17213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38fda6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd8b9 expref: 7 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271983.211419:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6e88835600) 00010000:00010000:3.0:1788271983.211422:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788271983.211457:0:17213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e20a00, rc 0) 00000100:00100000:3.0:1788271983.211846:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a6e7813-b915-4224-95b8-fa91b7ad9b79+7:15075:x1875138577555968:12345-192.168.201.3@tcp:101:mkdir.0 Request processed in 734us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271983.211853:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 22 00000100:00100000:3.0:1788271983.647135:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83390e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3607:1875138590212224:0@lo:400:kworker.0 00000100:00100000:1.0:1788271983.647230:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83390000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590212352:0@lo:400:kworker.0 00000100:00100000:3.0:1788271983.647240:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271983.647279:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271983.647313:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83392d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590212864:0@lo:400:kworker.0 00000100:00100000:3.0:1788271983.647319:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83390700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875138590212736:0@lo:400:kworker.0 00000100:00100000:3.0:1788271983.647356:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271983.647370:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271983.647383:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875138590213248:0@lo:400:kworker.0 00000100:00100000:1.0:1788271983.647407:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3608:1875138590213376:0@lo:400:kworker.0 00000100:00100000:3.0:1788271983.647416:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271983.647455:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3607:1875138590213760:0@lo:400:kworker.0 00000100:00100000:1.0:1788271983.647461:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271983.647495:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271983.647500:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590213888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788271983.647522:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1788271983.647533:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590212096:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788271983.647541:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271983.647570:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788271983.647575:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271983.647579:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83391880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590212480:0@lo:400:kworker.0 00000100:00100000:3.0:1788271983.647602:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83393480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590212608:0@lo:400:kworker.0 00000100:00100000:1.0:1788271983.647616:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271983.647671:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590212736 00000100:00100000:3.0:1788271983.647681:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590212736 00000100:00100000:3.0:1788271983.647738:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590213248 00000100:00100000:3.0:1788271983.647742:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590213248 00000100:00100000:3.0:1788271983.647757:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590213376 00000100:00100000:3.0:1788271983.647760:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590213376 00000100:00100000:2.0:1788271983.647761:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590213760 00000100:00100000:2.0:1788271983.647765:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590213760 00000100:00100000:3.0:1788271983.647793:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788271983.647804:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875138590212736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271983.647865:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875138590212736:12345-0@lo:400:kworker.0 Request processed in 64us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271983.647883:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788271983.647903:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788271983.647909:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875138590213248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271983.647937:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875138590213248:12345-0@lo:400:kworker.0 Request processed in 28us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271983.647943:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788271983.647953:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788271983.647960:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875138590213376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271983.647986:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3608:x1875138590213376:12345-0@lo:400:kworker.0 Request processed in 28us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271983.647992:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788271983.648011:0:18724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590213888 00000100:00100000:3.0:1788271983.648014:0:18724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590213888 00000100:00100000:0.0:1788271983.648100:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590212352 00000100:00100000:0.0:1788271983.648106:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590212352 00000100:00100000:0.0:1788271983.648143:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590212864 00000100:00100000:0.0:1788271983.648146:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590212864 00000100:00100000:0.0:1788271983.648162:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788271983.648170:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590212352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271983.648292:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590212352:12345-0@lo:400:kworker.0 Request processed in 122us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271983.648300:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788271983.648315:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788271983.648322:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590212864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271983.648764:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590212864:12345-0@lo:400:kworker.0 Request processed in 442us (1394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271983.648771:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788271983.649543:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83393800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590212992:0@lo:400:kworker.0 00000100:00100000:1.0:1788271983.649592:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271983.649609:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3608:1875138590213504:0@lo:400:kworker.0 00000001:00100000:0.0:1788271983.649711:0:19535:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8a6e7813-b915-4224-95b8-fa91b7ad9b79 00000001:00100000:0.0:1788271983.649726:0:19535:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8f7552d3-578c-40be-b601-54fb5b48de11 00000001:00080000:0.0:1788271983.649738:0:19535:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:0.0:1788271983.649765:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83ad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590214016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788271983.649808:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271983.649918:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271983.649967:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83390000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590212352:0@lo:400:kworker.0 00000100:00100000:0.0:1788271983.650195:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590212224 00000100:00100000:0.0:1788271983.650202:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590212224 00000100:00100000:0.0:1788271983.650271:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788271983.650281:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+24:3607:x1875138590212224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271983.650331:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87095450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+24:3607:x1875138590212224:12345-0@lo:400:kworker.0 Request processed in 51us (3093us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271983.650355:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788271983.650418:0:19862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590212480 00000100:00100000:0.0:1788271983.650423:0:19862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590212480 00000100:00100000:1.0:1788271983.650441:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83392d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590212864:0@lo:400:kworker.0 00000100:00100000:1.0:1788271983.650472:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3608:1875138590213376:0@lo:400:kworker.0 00000100:00100000:1.0:1788271983.650514:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590212992 00000100:00100000:1.0:1788271983.650519:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590212992 00000100:00100000:2.0:1788271983.652192:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590213504 00000100:00100000:2.0:1788271983.652222:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590213504 00000100:00100000:2.0:1788271983.652259:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788271983.652684:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875138590213760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271983.652802:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875138590213760:12345-0@lo:400:kworker.0 Request processed in 533us (5308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271983.652811:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788271983.652833:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788271983.652840:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875138590213504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271983.653551:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875138590213504:12345-0@lo:400:kworker.0 Request processed in 708us (3630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271983.653561:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1788271983.653691:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788271983.653698:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788271983.653702:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788271983.653706:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788271983.655323:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788271983.655418:0:19862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788271983.655447:0:19862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590212480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271983.655554:0:19862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590212480:12345-0@lo:400:kworker.0 Request processed in 127us (7938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271983.655561:0:19862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788271983.655604:0:18723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590212096 00000100:00100000:0.0:1788271983.655613:0:18723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590212096 00000100:00100000:0.0:1788271983.655661:0:18723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590214016 00000100:00100000:0.0:1788271983.655665:0:18723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590214016 00000100:00100000:0.0:1788271983.655678:0:18723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788271983.655693:0:18723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590212096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788271983.655720:0:18723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788271983.655750:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590212992:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788271983.655752:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788271983.655761:0:18723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590212096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (8187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271983.655768:0:18723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788271983.655781:0:18723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788271983.655788:0:18723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590214016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788271983.655802:0:18723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788271983.655849:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271983.657119:0:18723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590214016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1324us (7302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271983.657132:0:18723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788271983.657230:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83ad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590214016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788271983.657300:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83391880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590212480:0@lo:400:kworker.0 00000100:00100000:0.0:1788271983.657335:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83393800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590212992:0@lo:400:kworker.0 00010000:00080000:0.0:1788271983.657354:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d8406f100 x1875138590213504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271983.657367:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3608:1875138590213504:0@lo:400:kworker.0 00000100:00100000:0.0:1788271983.657406:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590212608 00000100:00100000:0.0:1788271983.657411:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590212608 00000100:00100000:0.0:1788271983.657466:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788271983.657475:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3607:x1875138590212608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271983.657534:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3607:x1875138590212608:12345-0@lo:400:kworker.0 Request processed in 60us (1685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271983.657540:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788271983.659319:0:18724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788271983.659344:0:18724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590213888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788271983.659662:0:18724:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788271983.659821:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83393480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590212608:0@lo:400:kworker.0 00000100:00100000:2.0:1788271983.659838:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83393100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590213120:0@lo:400:kworker.0 00000100:00100000:1.0:1788271983.665656:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590212992:12345-0@lo:400:kworker.0 Request processed in 9896us (16047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271983.665680:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788271983.669852:0:18724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590213888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10483us (22279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271983.669873:0:18724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788271983.670334:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590213888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788271983.672254:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271983.672339:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8406e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3607:1875138590213632:0@lo:400:kworker.0 00000100:00100000:0.0:1788271983.672371:0:19409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590213120 00000100:00100000:0.0:1788271983.672383:0:19409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590213120 00000100:00100000:2.0:1788271983.672480:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271983.672589:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83390700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875138590212736:0@lo:400:kworker.0 00000100:00100000:2.0:1788271983.672605:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875138590213248:0@lo:400:kworker.0 00010000:00080000:2.0:1788271983.672652:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d8406ed80 x1875138590213760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788271999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788271983.672689:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3607:1875138590213760:0@lo:400:kworker.0 00000100:00100000:2.0:1788271983.672703:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83390e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3607:1875138590212224:0@lo:400:kworker.0 00000100:00100000:2.0:1788271983.672749:0:3607:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1788271983.672770:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590212096:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788271983.672950:0:19409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788271983.672967:0:19409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590213120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271983.673047:0:19409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590213120:12345-0@lo:400:kworker.0 Request processed in 85us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271983.673055:0:19409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788271983.673102:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83393100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590213120:0@lo:400:kworker.0 00000100:00100000:3.0:1788271983.673641:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590213632 00000100:00100000:3.0:1788271983.673649:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590213632 00000100:00080000:3.0:1788271983.673683:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788271983.673723:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788271983.673785:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875138590213632:12345-0@lo:400:kworker.0 00000001:00100000:2.0:1788271983.673956:0:18716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8a6e7813-b915-4224-95b8-fa91b7ad9b79 00000001:00100000:2.0:1788271983.673969:0:18716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8f7552d3-578c-40be-b601-54fb5b48de11 00000100:00100000:3.0:1788271983.674145:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3607:x1875138590213632:12345-0@lo:400:kworker.0 Request processed in 362us (1664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271983.674167:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788271983.674206:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8406e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3607:1875138590213632:0@lo:400:kworker.0 00010000:00010000:3.0:1788271984.222568:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271985.247651:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788271985.631778:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:1.0:1788271985.696337:0:17191:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8a6e7813-b915-4224-95b8-fa91b7ad9b79 00000001:00100000:1.0:1788271985.696350:0:17191:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8f7552d3-578c-40be-b601-54fb5b48de11 00000001:00100000:0.0:1788271985.698737:0:17945:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8a6e7813-b915-4224-95b8-fa91b7ad9b79 00000001:00100000:0.0:1788271985.698753:0:17945:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 8f7552d3-578c-40be-b601-54fb5b48de11 00000001:02000400:2.0:1788271985.851174:0:20092:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788271986.270026:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271986.717946:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83ad1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590214144:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788271986.718048:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271986.718286:0:18723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590214144 00000100:00100000:1.0:1788271986.718297:0:18723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590214144 00000100:00080000:3.0:1788271986.718395:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788271986.718429:0:18723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788271986.718442:0:18723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590214144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788271986.718481:0:18723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788271986.718545:0:18723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590214144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271986.718553:0:18723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788271986.718658:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83ad1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590214144:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788271987.231126:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788271987.231155:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590214272:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788271987.231246:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271987.231300:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788271987.231310:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590214400:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788271987.231342:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271987.231403:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590214272 00000100:00100000:3.0:1788271987.231412:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590214272 00000100:00100000:3.0:1788271987.231468:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590214400 00000100:00100000:3.0:1788271987.231471:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590214400 00000100:00100000:3.0:1788271987.231489:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788271987.231499:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590214272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788271987.231543:0:17217:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788271987.231613:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590214272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271987.231648:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788271987.231670:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788271987.231678:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590214400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788271987.231698:0:17217:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788271987.231734:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590214400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271987.231753:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788271987.231942:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590214400:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788271987.231985:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590214272:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788271987.294875:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271988.125086:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271988.125135:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271988.125167:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577556096 00000100:00100000:2.0:1788271988.125184:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577556096 00000100:00100000:1.0:1788271988.125226:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271988.125260:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271988.125298:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 144 00000100:00100000:2.0:1788271988.125312:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1104fde8-2866-41ec-bd9b-e310797010eb+13:2396:x1875138577556096:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788271988.125430:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87097450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1104fde8-2866-41ec-bd9b-e310797010eb+13:2396:x1875138577556096:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 120us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271988.125439:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 144 00000040:00080000:2.0:1788271988.128995:0:17972:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788271988.129393:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271988.129436:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271988.129547:0:19862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577556608 00000100:00100000:0.0:1788271988.129566:0:19862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577556608 00000100:00100000:0.0:1788271988.129682:0:19862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577557120 00000100:00100000:0.0:1788271988.129686:0:19862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577557120 00000100:00100000:0.0:1788271988.129734:0:19862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 8 00000100:00100000:0.0:1788271988.129747:0:19862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8f7552d3-578c-40be-b601-54fb5b48de11+5:2396:x1875138577556608:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271988.129794:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577556352 00000100:00100000:3.0:1788271988.129806:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577556352 00000100:00100000:0.0:1788271988.129855:0:19862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8f7552d3-578c-40be-b601-54fb5b48de11+5:2396:x1875138577556608:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 108us (4627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271988.129869:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577556864 00000100:00100000:3.0:1788271988.129874:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577556864 00000100:00100000:3.0:1788271988.129893:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 40 00000100:00100000:3.0:1788271988.129902:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d832bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f7552d3-578c-40be-b601-54fb5b48de11+5:2396:x1875138577556352:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271988.129969:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d832bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f7552d3-578c-40be-b601-54fb5b48de11+5:2396:x1875138577556352:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 68us (4835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271988.129977:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 40 00000100:00100000:3.0:1788271988.129994:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 41 00000100:00100000:3.0:1788271988.130001:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a6e7813-b915-4224-95b8-fa91b7ad9b79+5:2396:x1875138577556864:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271988.130025:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a6e7813-b915-4224-95b8-fa91b7ad9b79+5:2396:x1875138577556864:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 24us (4766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271988.130030:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 41 00000100:00100000:0.0:1788271988.130308:0:19862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 8 00000100:00100000:1.0:1788271988.130345:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271988.130351:0:19862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 9 00000100:00100000:0.0:1788271988.130373:0:19862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8a6e7813-b915-4224-95b8-fa91b7ad9b79+5:2396:x1875138577557120:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:0.0:1788271988.130412:0:19862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8a6e7813-b915-4224-95b8-fa91b7ad9b79+5:2396:x1875138577557120:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 42us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271988.130419:0:19862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 9 00000100:00100000:3.0:1788271988.130490:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577556224 00000100:00100000:3.0:1788271988.130497:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577556224 00000100:00100000:3.0:1788271988.130530:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 42 00000100:00100000:3.0:1788271988.130539:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f7552d3-578c-40be-b601-54fb5b48de11+6:2396:x1875138577556224:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271988.130579:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f7552d3-578c-40be-b601-54fb5b48de11+6:2396:x1875138577556224:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 42us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271988.130586:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 42 00000100:00100000:1.0:1788271988.132700:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271988.132763:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271988.132846:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577556736 00000100:00100000:2.0:1788271988.132856:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577556736 00000100:00100000:2.0:1788271988.132920:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 43 00000100:00100000:2.0:1788271988.132931:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83393100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a6e7813-b915-4224-95b8-fa91b7ad9b79+6:2396:x1875138577556736:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788271988.132991:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83393100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a6e7813-b915-4224-95b8-fa91b7ad9b79+6:2396:x1875138577556736:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 62us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271988.133009:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 43 00000100:00100000:0.0:1788271988.135676:0:19862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577556480 00000100:00100000:0.0:1788271988.135700:0:19862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577556480 00000100:00100000:0.0:1788271988.135769:0:19862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577556992 00000100:00100000:0.0:1788271988.135774:0:19862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577556992 00000100:00100000:0.0:1788271988.135810:0:19862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 10 00000100:00100000:0.0:1788271988.135823:0:19862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8406dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8f7552d3-578c-40be-b601-54fb5b48de11+5:2396:x1875138577556480:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788271988.135991:0:19409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 11 00000100:00100000:2.0:1788271988.136011:0:19409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83390e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a6e7813-b915-4224-95b8-fa91b7ad9b79+5:2396:x1875138577556992:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:2.0:1788271988.136250:0:19409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83390e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8a6e7813-b915-4224-95b8-fa91b7ad9b79+5:2396:x1875138577556992:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 245us (3485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271988.136259:0:19409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 11 00000100:00080000:2.0:1788271988.143285:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788271988.143296:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788271988.143299:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788271988.143301:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788271988.152076:0:19862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8406dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8f7552d3-578c-40be-b601-54fb5b48de11+5:2396:x1875138577556480:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 16236us (21721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271988.152098:0:19862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 10 00010000:00010000:0.0:1788271988.318055:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271988.766297:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788271988.766321:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590214528:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788271988.766412:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271988.766507:0:18724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590214528 00000100:00100000:0.0:1788271988.766515:0:18724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590214528 00000100:00100000:0.0:1788271988.766579:0:18724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788271988.766589:0:18724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83ad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590214528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788271988.766653:0:18724:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788271988.766704:0:18724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83ad1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590214528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 116us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271988.766719:0:18724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788271988.766803:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788271988.766836:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6eb3d2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590214784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788271988.766863:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271988.766926:0:18723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590214784 00000100:00100000:2.0:1788271988.766930:0:18723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590214784 00000100:00100000:2.0:1788271988.766959:0:18723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788271988.766966:0:18723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590214784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788271988.766976:0:18723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788271988.769780:0:18723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590214784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2809us (2910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271988.769793:0:18723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1788271988.769823:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788271988.769901:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590214784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788271988.769921:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83392d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875138590215296:0@lo:400:kworker.0 00000100:00100000:0.0:1788271988.769969:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271988.770026:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebc2be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3607:1875138590215808:0@lo:400:kworker.0 00000100:00100000:0.0:1788271988.770049:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271988.770117:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83393480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3608:1875138590214912:0@lo:400:kworker.0 00000100:00100000:0.0:1788271988.770148:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271988.770174:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83390000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590215424:0@lo:400:kworker.0 00000100:00100000:0.0:1788271988.770198:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271988.770215:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebc2bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3608:1875138590215936:0@lo:400:kworker.0 00000100:00100000:0.0:1788271988.770233:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271988.770294:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590215296 00000100:00100000:2.0:1788271988.770300:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590215296 00000100:00100000:2.0:1788271988.770338:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590215808 00000100:00100000:2.0:1788271988.770351:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590215808 00000100:00100000:2.0:1788271988.770399:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788271988.770407:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875138590215296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271988.770452:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875138590215296:12345-0@lo:400:kworker.0 Request processed in 46us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271988.770459:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788271988.770473:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788271988.770478:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875138590215808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271988.770503:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875138590215808:12345-0@lo:400:kworker.0 Request processed in 25us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271988.770509:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1788271988.770526:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788271988.770687:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590215424 00000100:00100000:2.0:1788271988.770691:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590215424 00000100:00100000:2.0:1788271988.770716:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788271988.770723:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590215424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788271988.770756:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590215424:12345-0@lo:400:kworker.0 Request processed in 34us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271988.770762:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788271988.770870:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83390700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590214656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788271988.770909:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271988.770948:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83391880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590215168:0@lo:400:kworker.0 00000100:00100000:1.0:1788271988.770978:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271988.770985:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6eb3d2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590214528:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788271988.771005:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebc2bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875138590215680:0@lo:400:kworker.0 00000100:00100000:0.0:1788271988.771013:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83390000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590215424:0@lo:400:kworker.0 00000100:00100000:0.0:1788271988.771026:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788271988.771032:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271988.771039:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83393800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590215040:0@lo:400:kworker.0 00000100:00100000:1.0:1788271988.771048:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebc2bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3606:1875138590216192:0@lo:400:kworker.0 00000100:00100000:0.0:1788271988.771073:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271988.771085:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271988.771098:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebc2bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590215552:0@lo:400:kworker.0 00000100:00100000:1.0:1788271988.771121:0:19409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590215168 00000100:00100000:1.0:1788271988.771127:0:19409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590215168 00000100:00100000:0.0:1788271988.771127:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271988.771149:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebc2bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3608:1875138590216064:0@lo:400:kworker.0 00000100:00100000:0.0:1788271988.771184:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271988.771206:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590214912 00000100:00100000:0.0:1788271988.771210:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590214912 00000100:00100000:0.0:1788271988.771239:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788271988.771246:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87096c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+24:3608:x1875138590214912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271988.771279:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87096c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+24:3608:x1875138590214912:12345-0@lo:400:kworker.0 Request processed in 33us (1130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271988.771284:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788271988.771308:0:17953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590215040 00000100:00100000:0.0:1788271988.771312:0:17953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590215040 00000100:00100000:0.0:1788271988.771332:0:17953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788271988.771338:0:17953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590215040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271988.771443:0:17953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590215040:12345-0@lo:400:kworker.0 Request processed in 104us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271988.771451:0:17953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788271988.771454:0:19409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590215552 00000100:00100000:1.0:1788271988.771460:0:19409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590215552 00000100:00100000:0.0:1788271988.771486:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83393800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590215040:0@lo:400:kworker.0 00000100:00100000:1.0:1788271988.771494:0:19409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788271988.771500:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83393480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3608:1875138590214912:0@lo:400:kworker.0 00000100:00100000:1.0:1788271988.771505:0:19409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc2bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590215168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271988.771526:0:18724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590214656 00000100:00100000:0.0:1788271988.771530:0:18724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590214656 00000100:00100000:0.0:1788271988.771546:0:18724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788271988.771552:0:18724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc2bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3606:x1875138590214656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788271988.771570:0:18724:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788271988.771608:0:18724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc2bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3606:x1875138590214656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271988.771614:0:18724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788271988.771653:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590215936 00000100:00100000:0.0:1788271988.771657:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590215936 00000100:00100000:0.0:1788271988.771677:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590215680 00000100:00100000:0.0:1788271988.771681:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590215680 00000100:00100000:0.0:1788271988.771698:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590216192 00000100:00100000:0.0:1788271988.771701:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590216192 00000100:00100000:1.0:1788271988.771703:0:19409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc2bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590215168:12345-0@lo:400:kworker.0 Request processed in 200us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271988.771713:0:19409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788271988.771717:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590216064 00000100:00100000:0.0:1788271988.771721:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590216064 00000100:00100000:0.0:1788271988.771740:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788271988.771745:0:19409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788271988.771748:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875138590215936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271988.771757:0:19409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590215552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271988.771785:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875138590215936:12345-0@lo:400:kworker.0 Request processed in 38us (1549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271988.771792:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788271988.771809:0:19409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590215552:12345-0@lo:400:kworker.0 Request processed in 54us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271988.771810:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788271988.771821:0:19409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788271988.771823:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc2bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1875138590215680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271988.771853:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc2bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3606:x1875138590215680:12345-0@lo:400:kworker.0 Request processed in 34us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271988.771859:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788271988.771870:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788271988.771875:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc2bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1875138590216192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271988.771898:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc2bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3606:x1875138590216192:12345-0@lo:400:kworker.0 Request processed in 23us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271988.771904:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788271988.771913:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788271988.771919:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875138590216064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271988.771942:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3608:x1875138590216064:12345-0@lo:400:kworker.0 Request processed in 24us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271988.771955:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788271988.771981:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebc2bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590215552:0@lo:400:kworker.0 00000100:00100000:0.0:1788271988.771990:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebc2bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3608:1875138590216064:0@lo:400:kworker.0 00010000:00080000:0.0:1788271988.772002:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6ebc2bf480 x1875138590215936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788272004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271988.772014:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebc2bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3608:1875138590215936:0@lo:400:kworker.0 00000100:00080000:1.0:1788271988.772031:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788271988.772035:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788271988.772038:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788271988.772068:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83390700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590214656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788271988.772080:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83391880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590215168:0@lo:400:kworker.0 00000100:00100000:1.0:1788271988.772096:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebc2bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3606:1875138590215680:0@lo:400:kworker.0 00000100:00100000:0.0:1788271988.772104:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83392d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875138590215296:0@lo:400:kworker.0 00010000:00080000:1.0:1788271988.772114:0:3606:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6ebc2bfb80 x1875138590216192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788272004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788271988.772122:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebc2be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3607:1875138590215808:0@lo:400:kworker.0 00000100:00100000:1.0:1788271988.772127:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebc2bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3606:1875138590216192:0@lo:400:kworker.0 00000020:00000080:0.0:1788271989.013162:0:20239:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec1541df0 20000000:00000080:0.0:1788271989.013179:0:20239:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f6e84b47000 uarg=0000000000000000 20000000:01000000:0.0:1788271989.013220:0:20239:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788271989.013227:0:20239:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788271989.013232:0:20239:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788271989.013818:0:20240:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1788271989.014084:0:20239:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788271989.020244:0:20239:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788271989.020278:0:20239:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f6d81729600/0x99288105fd38fdad lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271989.020297:0:20239:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6d833f6000/0x99288105fd38fa42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38fa3b expref: 23 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271989.020305:0:20239:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6d830c4c00/0x99288105fd38fa50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38fa49 expref: 23 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271989.020311:0:20239:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6e8511c600/0x99288105fd38fa8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38fa88 expref: 23 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271989.020317:0:20239:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6e8511d000/0x99288105fd38fb29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38fb22 expref: 23 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271989.020326:0:20239:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6d81728a00/0x99288105fd38fd3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd818 expref: 12 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271989.020362:0:20239:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f6e8511de00/0x99288105fd38fd7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd888 expref: 12 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271989.020369:0:20239:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f6d81729600/0x99288105fd38fdad lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271989.020511:0:20239:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6e8511de00/0x99288105fd38fd7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd888 expref: 12 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271989.020528:0:20239:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f6e8511de00/0x99288105fd38fd7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd888 expref: 12 pid: 17204 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271989.020543:0:20239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebc2bfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20239:1875138590216320:192.168.201.3@tcp:104: 00010000:00010000:1.0:1788271989.020848:0:20239:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6d81728a00/0x99288105fd38fd3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd818 expref: 12 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271989.020926:0:20239:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f6d81728a00/0x99288105fd38fd3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd818 expref: 12 pid: 17204 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271989.020936:0:20239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebc2bea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20239:1875138590216448:192.168.201.3@tcp:104: 00010000:00010000:1.0:1788271989.020982:0:20239:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6e8511d000/0x99288105fd38fb29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38fb22 expref: 23 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271989.020991:0:20239:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f6e8511d000/0x99288105fd38fb29 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38fb22 expref: 23 pid: 17206 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271989.021000:0:20239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebc2bc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20239:1875138590216576:0@lo:104: 00000100:00100000:1.0:1788271989.021038:0:20239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788271989.021079:0:20239:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6e8511c600/0x99288105fd38fa8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38fa88 expref: 23 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271989.021087:0:20239:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f6e8511c600/0x99288105fd38fa8f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38fa88 expref: 23 pid: 17204 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271989.021095:0:20239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebc2be300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20239:1875138590216704:0@lo:104: 00000100:00100000:1.0:1788271989.021114:0:20239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788271989.021133:0:20239:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6d830c4c00/0x99288105fd38fa50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38fa49 expref: 23 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271989.021140:0:20239:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f6d830c4c00/0x99288105fd38fa50 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38fa49 expref: 23 pid: 17204 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271989.021146:0:20239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebc2bed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20239:1875138590216832:0@lo:104: 00000100:00100000:1.0:1788271989.021164:0:20239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788271989.021178:0:20239:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f6d833f6000/0x99288105fd38fa42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x99288105fd38fa3b expref: 23 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271989.021185:0:20239:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f6d833f6000/0x99288105fd38fa42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x99288105fd38fa3b expref: 23 pid: 17206 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271989.021193:0:20239:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebc2bf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20239:1875138590216960:0@lo:104: 00000100:00100000:1.0:1788271989.021213:0:20239:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271989.021223:0:20239:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d816230c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788271989.023017:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590216576 00000100:00100000:2.0:1788271989.023029:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590216576 00000100:00100000:2.0:1788271989.023079:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590216704 00000100:00100000:2.0:1788271989.023082:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590216704 00000100:00100000:2.0:1788271989.023094:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590216832 00000100:00100000:2.0:1788271989.023097:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590216832 00000100:00100000:2.0:1788271989.023106:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590216960 00000100:00100000:2.0:1788271989.023109:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590216960 00000100:00100000:2.0:1788271989.023124:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788271989.023134:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc2bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+6:20239:x1875138590216576:12345-0@lo:104: 00010000:00010000:2.0:1788271989.023166:0:17195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4200/0x99288105fd38fb22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38fb29 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271989.023256:0:17195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788271989.023262:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc2bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+6:20239:x1875138590216576:12345-0@lo:104: Request processed in 130us (2224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271989.023270:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788271989.023285:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788271989.023291:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc2bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+5:20239:x1875138590216704:12345-0@lo:104: 00010000:00010000:2.0:1788271989.023299:0:17195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5000/0x99288105fd38fa88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38fa8f expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271989.023330:0:17195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788271989.023335:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc2bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+5:20239:x1875138590216704:12345-0@lo:104: Request processed in 45us (2220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271989.023354:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788271989.023365:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788271989.023370:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc2bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+4:20239:x1875138590216832:12345-0@lo:104: 00010000:00010000:2.0:1788271989.023378:0:17195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6600/0x99288105fd38fa49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38fa50 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271989.023415:0:17195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788271989.023421:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc2bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+4:20239:x1875138590216832:12345-0@lo:104: Request processed in 51us (2256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271989.023426:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788271989.023436:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788271989.023441:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc2bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+3:20239:x1875138590216960:12345-0@lo:104: 00010000:00010000:2.0:1788271989.023453:0:17195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d200/0x99288105fd38fa3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38fa42 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271989.023478:0:17195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788271989.023483:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc2bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+3:20239:x1875138590216960:12345-0@lo:104: Request processed in 42us (2270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271989.023488:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788271989.023508:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788271989.023513:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4200/0x99288105fd38fb22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38fb29 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271989.023520:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4200 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:2.0:1788271989.023524:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4200/0x99288105fd38fb22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38fb29 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271989.023533:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4200/0x99288105fd38fb22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38fb29 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788271989.023539:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4200/0x99288105fd38fb22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38fb29 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271989.023545:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788271989.023576:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4200/0x99288105fd38fb22 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38fb29 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271989.023583:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788271989.023612:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4200/0x99288105fd38fb22 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38fb29 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271989.023640:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6d830c4200/0x99288105fd38fb22 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38fb29 expref: -99 pid: 19534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271989.023662:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788271989.023665:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5000/0x99288105fd38fa88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38fa8f expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271989.023671:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c5000 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:2.0:1788271989.023674:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5000/0x99288105fd38fa88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38fa8f expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271989.023681:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5000/0x99288105fd38fa88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38fa8f expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788271989.023686:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5000/0x99288105fd38fa88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38fa8f expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271989.023691:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788271989.023704:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5000/0x99288105fd38fa88 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38fa8f expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271989.023709:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788271989.023723:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5000/0x99288105fd38fa88 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38fa8f expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271989.023730:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6d830c5000/0x99288105fd38fa88 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38fa8f expref: -99 pid: 18715 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271989.023738:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788271989.023740:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6600/0x99288105fd38fa49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38fa50 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271989.023757:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d833f6600 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:2.0:1788271989.023760:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6600/0x99288105fd38fa49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38fa50 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271989.023767:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6600/0x99288105fd38fa49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38fa50 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788271989.023773:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6600/0x99288105fd38fa49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38fa50 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271989.023778:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788271989.023790:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6600/0x99288105fd38fa49 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38fa50 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271989.023796:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788271989.023802:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6600/0x99288105fd38fa49 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38fa50 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271989.023809:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6d833f6600/0x99288105fd38fa49 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38fa50 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271989.023818:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788271989.023821:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d200/0x99288105fd38fa3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x99288105fd38fa42 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271989.023826:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511d200 already unused, calling callback (ffffffffc113ac20) 10000000:00010000:2.0:1788271989.023829:0:17200:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d200/0x99288105fd38fa3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x99288105fd38fa42 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271989.023844:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d200/0x99288105fd38fa3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x99288105fd38fa42 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788271989.024099:0:17200:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d200/0x99288105fd38fa3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x99288105fd38fa42 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788271989.024107:0:17200:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788271989.024122:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d200/0x99288105fd38fa3b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38fa42 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271989.024127:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788271989.024134:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d200/0x99288105fd38fa3b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38fa42 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271989.024141:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d200/0x99288105fd38fa3b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x99288105fd38fa42 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271989.024155:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271989.024157:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271989.024159:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788271989.024166:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788271989.024180:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83253100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3606:1875138590217472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788271989.024220:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271989.024260:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788271989.024266:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83ad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3606:1875138590217088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788271989.024285:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271989.024306:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8233bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3609:1875138590217344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788271989.024325:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271989.024358:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788271989.024363:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3609:1875138590217216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788271989.024382:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788271989.024491:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271989.024524:0:18367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590217472 00000100:00100000:0.0:1788271989.024530:0:18367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590217472 00010000:00010000:0.0:1788271989.024554:0:18367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6d833f6000/0x99288105fd38fa42 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38fa3b expref: 24 pid: 17206 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271989.024577:0:18367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590217088 00000100:00100000:0.0:1788271989.024579:0:18367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590217088 00010000:00010000:0.0:1788271989.024601:0:18367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6e8511d000/0x99288105fd38fb29 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38fb22 expref: 25 pid: 17206 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271989.024611:0:18367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590217344 00000100:00100000:0.0:1788271989.024635:0:18367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590217344 00010000:00010000:0.0:1788271989.024648:0:18367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6d830c4c00/0x99288105fd38fa50 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38fa49 expref: 26 pid: 17204 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271989.024661:0:18367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788271989.024667:0:18367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83251f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08d4e6e3-b587-4543-a287-4a9ae9a31c24+26:3606:x1875138590217472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788271989.024677:0:18367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271989.024682:0:18367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6d833f6000/0x99288105fd38fa42 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38fa3b expref: 26 pid: 17206 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271989.024692:0:18367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6d833f6000/0x99288105fd38fa42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38fa3b expref: 26 pid: 17206 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271989.024707:0:18367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271989.024738:0:18367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83251f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08d4e6e3-b587-4543-a287-4a9ae9a31c24+26:3606:x1875138590217472:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271989.024745:0:18367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788271989.024759:0:18367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788271989.024765:0:18367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08d4e6e3-b587-4543-a287-4a9ae9a31c24+25:3606:x1875138590217088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788271989.024771:0:18367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271989.024775:0:18367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6e8511d000/0x99288105fd38fb29 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38fb22 expref: 25 pid: 17206 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271989.024784:0:18367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6e8511d000/0x99288105fd38fb29 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38fb22 expref: 25 pid: 17206 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271989.024794:0:18367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271989.024813:0:18367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08d4e6e3-b587-4543-a287-4a9ae9a31c24+25:3606:x1875138590217088:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271989.024818:0:18367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788271989.024835:0:18367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788271989.024840:0:18367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08d4e6e3-b587-4543-a287-4a9ae9a31c24+24:3609:x1875138590217344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788271989.024870:0:18367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271989.024875:0:18367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6d830c4c00/0x99288105fd38fa50 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38fa49 expref: 24 pid: 17204 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271989.024883:0:18367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6d830c4c00/0x99288105fd38fa50 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38fa49 expref: 24 pid: 17204 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271989.024892:0:18367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271989.024911:0:18367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08d4e6e3-b587-4543-a287-4a9ae9a31c24+24:3609:x1875138590217344:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271989.024917:0:18367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788271989.024978:0:20239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6e8511d000/0x99288105fd38fb29 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38fb22 expref: 23 pid: 17206 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271989.024990:0:20239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebc2bc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20239:1875138590216576:0@lo:104: 00000100:00100000:0.0:1788271989.025001:0:20239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebc2be300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20239:1875138590216704:0@lo:104: 00010000:00010000:0.0:1788271989.025009:0:20239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6d830c4c00/0x99288105fd38fa50 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38fa49 expref: 22 pid: 17204 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271989.025017:0:20239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebc2bed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20239:1875138590216832:0@lo:104: 00010000:00010000:0.0:1788271989.025026:0:20239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6d833f6000/0x99288105fd38fa42 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38fa3b expref: 21 pid: 17206 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271989.025035:0:20239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebc2bf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20239:1875138590216960:0@lo:104: 00000100:00100000:2.0:1788271989.025321:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8233bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3609:1875138590217344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788271989.025362:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83ad1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3606:1875138590217088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788271989.025369:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83253100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3606:1875138590217472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788271989.025455:0:18367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590217216 00000100:00100000:2.0:1788271989.025460:0:18367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590217216 00010000:00010000:2.0:1788271989.025477:0:18367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6e8511c600/0x99288105fd38fa8f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38fa88 expref: 21 pid: 17204 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271989.025497:0:18367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788271989.025503:0:18367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08d4e6e3-b587-4543-a287-4a9ae9a31c24+21:3609:x1875138590217216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788271989.025511:0:18367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271989.025517:0:18367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6e8511c600/0x99288105fd38fa8f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x99288105fd38fa88 expref: 21 pid: 17204 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271989.025525:0:18367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6e8511c600/0x99288105fd38fa8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x99288105fd38fa88 expref: 21 pid: 17204 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271989.025534:0:18367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6e8511c600/0x99288105fd38fa8f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x99288105fd38fa88 expref: 21 pid: 17204 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271989.025542:0:18367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271989.025570:0:18367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08d4e6e3-b587-4543-a287-4a9ae9a31c24+20:3609:x1875138590217216:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (1186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271989.025576:0:18367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788271989.027152:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83ad0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3609:1875138590217216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788271989.033810:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271989.033877:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271989.033969:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577557248 00000100:00100000:1.0:1788271989.033980:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577557248 00010000:00010000:1.0:1788271989.034021:0:17197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6e8511de00/0x99288105fd38fd7c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd888 expref: 13 pid: 17204 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271989.034057:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577557376 00000100:00100000:1.0:1788271989.034071:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577557376 00010000:00010000:1.0:1788271989.034086:0:17197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f6d81728a00/0x99288105fd38fd3d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd818 expref: 14 pid: 17204 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271989.034110:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 13 00000100:00100000:1.0:1788271989.034119:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8312a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1104fde8-2866-41ec-bd9b-e310797010eb+14:2398:x1875138577557248:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271989.034133:0:17197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271989.034139:0:17197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6e8511de00/0x99288105fd38fd7c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd888 expref: 14 pid: 17204 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271989.034152:0:17197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6e8511de00/0x99288105fd38fd7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd888 expref: 14 pid: 17204 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271989.034171:0:17197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271989.034217:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8312a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1104fde8-2866-41ec-bd9b-e310797010eb+14:2398:x1875138577557248:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 98us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271989.034224:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 13 00000100:00100000:1.0:1788271989.034270:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 14 00000100:00100000:1.0:1788271989.034276:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1104fde8-2866-41ec-bd9b-e310797010eb+13:2398:x1875138577557376:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271989.034283:0:17197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271989.034287:0:17197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f6d81728a00/0x99288105fd38fd3d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd818 expref: 13 pid: 17204 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271989.034296:0:17197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f6d81728a00/0x99288105fd38fd3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd818 expref: 13 pid: 17204 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271989.034308:0:17197:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f6d81729600/0x99288105fd38fdad lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271989.034326:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6d81729600/0x99288105fd38fdad lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271989.034353:0:17197:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f6d81729600/0x99288105fd38fdad lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271989.034361:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f6d81729600/0x99288105fd38fdad lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271989.034367:0:17197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f6d81729600/0x99288105fd38fdad lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271989.034373:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f6d81729600/0x99288105fd38fdad lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271989.034378:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d81729600 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:1.0:1788271989.034383:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f6d81729600/0x99288105fd38fdad lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271989.034401:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f6d81729600/0x99288105fd38fdad lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271989.034411:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f6d81729600/0x99288105fd38fdad lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271989.034421:0:17197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271989.034439:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1104fde8-2866-41ec-bd9b-e310797010eb+13:2398:x1875138577557376:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 163us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271989.034445:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 14 00010000:00010000:0.0:1788271989.034823:0:20239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6e8511de00/0x99288105fd38fd7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd888 expref: 12 pid: 17204 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271989.034861:0:20239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebc2bfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20239:1875138590216320:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788271989.034878:0:20239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6d81728a00/0x99288105fd38fd3d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd818 expref: 11 pid: 17204 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271989.034886:0:20239:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebc2bea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20239:1875138590216448:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788271989.034918:0:20239:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f6d81729600/0x99288105fd38fdad lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271989.034927:0:20239:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f6d81729600/0x99288105fd38fdad lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271989.034933:0:20239:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f6d81729600/0x99288105fd38fdad lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271989.034938:0:20239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f6d81729600/0x99288105fd38fdad lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20239 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271989.341798:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788271990.376167:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788271990.493122:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271990.493225:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577557504 00000100:00100000:2.0:1788271990.493234:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577557504 00000100:00100000:2.0:1788271990.493402:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 146 00000100:00100000:2.0:1788271990.493412:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1104fde8-2866-41ec-bd9b-e310797010eb+11:14924:x1875138577557504:12345-192.168.201.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788271990.493429:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271990.493447:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6d81de5e00/0x99288105fd38fdb4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd8c0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271990.493473:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6d81de5e00/0x99288105fd38fdb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd8c0 expref: 12 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271990.493483:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6d81de5e00/0x99288105fd38fdb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd8c0 expref: 12 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271990.493493:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d81de5e00, rc 0) 00000100:00100000:2.0:1788271990.493538:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87096450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1104fde8-2866-41ec-bd9b-e310797010eb+12:14924:x1875138577557504:12345-192.168.201.3@tcp:101:ll_cfg_requeue.0 Request processed in 127us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271990.493545:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 146 00000100:00100000:2.0:1788271990.502031:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271990.502123:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577557632 00000100:00100000:0.0:1788271990.502132:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577557632 00000100:00100000:0.0:1788271990.502210:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 147 00000100:00100000:0.0:1788271990.502220:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1104fde8-2866-41ec-bd9b-e310797010eb+12:14924:x1875138577557632:12345-192.168.201.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271990.502375:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87097850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1104fde8-2866-41ec-bd9b-e310797010eb+12:14924:x1875138577557632:12345-192.168.201.3@tcp:501:ll_cfg_requeue.0 Request processed in 156us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271990.502383:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 147 00000100:00100000:3.0:1788271990.504402:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271990.504737:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577557760 00000100:00100000:2.0:1788271990.504747:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577557760 00000100:00100000:2.0:1788271990.504789:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 148 00000100:00100000:2.0:1788271990.504799:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1104fde8-2866-41ec-bd9b-e310797010eb+12:14924:x1875138577557760:12345-192.168.201.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788271990.504963:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87094c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1104fde8-2866-41ec-bd9b-e310797010eb+12:14924:x1875138577557760:12345-192.168.201.3@tcp:503:ll_cfg_requeue.0 Request processed in 164us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271990.504972:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 148 00000100:00100000:3.0:1788271990.517962:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271990.518049:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577557888 00000100:00100000:2.0:1788271990.518060:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577557888 00000100:00100000:2.0:1788271990.518109:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 149 00000100:00100000:2.0:1788271990.518119:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87094050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1104fde8-2866-41ec-bd9b-e310797010eb+12:14924:x1875138577557888:12345-192.168.201.3@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788271990.518136:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271990.518153:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6d81de4200/0x99288105fd38fdbb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd8c7 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271990.518181:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6d81de4200/0x99288105fd38fdbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd8c7 expref: 13 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271990.518192:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6d81de4200/0x99288105fd38fdbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd8c7 expref: 13 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271990.518202:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d81de4200, rc 0) 00000100:00100000:2.0:1788271990.518260:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87094050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1104fde8-2866-41ec-bd9b-e310797010eb+13:14924:x1875138577557888:12345-192.168.201.3@tcp:101:ll_cfg_requeue.0 Request processed in 142us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271990.518267:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 149 00000100:00100000:3.0:1788271990.522487:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271990.527054:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577558016 00000100:00100000:2.0:1788271990.527070:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577558016 00000100:00100000:3.0:1788271990.528424:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 150 00000100:00100000:3.0:1788271990.528437:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87094450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1104fde8-2866-41ec-bd9b-e310797010eb+13:14924:x1875138577558016:12345-192.168.201.3@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788271990.528614:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87094450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1104fde8-2866-41ec-bd9b-e310797010eb+13:14924:x1875138577558016:12345-192.168.201.3@tcp:501:ll_cfg_requeue.0 Request processed in 180us (6138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271990.528646:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 150 00000100:00100000:3.0:1788271990.534756:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271990.536353:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577558144 00000100:00100000:0.0:1788271990.536366:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577558144 00000100:00100000:0.0:1788271990.536514:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 151 00000100:00100000:0.0:1788271990.536524:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1104fde8-2866-41ec-bd9b-e310797010eb+13:14924:x1875138577558144:12345-192.168.201.3@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788271990.536690:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87096050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1104fde8-2866-41ec-bd9b-e310797010eb+13:14924:x1875138577558144:12345-192.168.201.3@tcp:503:ll_cfg_requeue.0 Request processed in 167us (1944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271990.536698:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 151 10000000:01000000:0.0:1788271990.750709:0:17208:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788271990.750718:0:17208:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f6d81d68000 from 13 10000000:01000000:0.0:1788271990.750726:0:17208:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788271990.750779:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d000/0x99288105fd38fdc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271990.750795:0:17208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d000/0x99288105fd38fdc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271990.750809:0:17208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d000/0x99288105fd38fdc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271990.750835:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83391880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590217600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788271990.750914:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271990.750955:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d88240 going to sleep for 11 seconds 00000100:00100000:3.0:1788271990.751066:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590217600 00000100:00100000:3.0:1788271990.751076:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590217600 00000100:00100000:3.0:1788271990.751133:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788271990.751142:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+20:17208:x1875138590217600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788271990.751157:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271990.751173:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6eb4e21200/0x99288105fd38fdc9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38fdc2 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271990.751199:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6eb4e21200/0x99288105fd38fdc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38fdc2 expref: 21 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271990.751209:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6eb4e21200/0x99288105fd38fdc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38fdc2 expref: 21 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271990.751228:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e21200, rc 0) 00000100:00100000:3.0:1788271990.751275:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87097c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+21:17208:x1875138590217600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271990.751285:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788271990.751355:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83391880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590217600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788271990.751371:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d000/0x99288105fd38fdc2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fdc9 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271990.751380:0:17208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d000/0x99288105fd38fdc2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38fdc9 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271990.751456:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590217728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788271990.751494:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271990.751514:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc98d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271990.751682:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590217728 00000100:00100000:0.0:1788271990.751689:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590217728 00000100:00100000:0.0:1788271990.751717:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788271990.751723:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e87095050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+21:17208:x1875138590217728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271990.751836:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e87095050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+21:17208:x1875138590217728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271990.751846:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788271990.751881:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816ced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590217728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271990.751918:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83390700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590217856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788271990.751958:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271990.751972:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d88e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788271990.751983:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590217856 00000100:00100000:0.0:1788271990.751990:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590217856 00000100:00100000:0.0:1788271990.752008:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788271990.752018:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e8528c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+21:17208:x1875138590217856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788271990.752092:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e8528c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+21:17208:x1875138590217856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271990.752099:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788271990.752142:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83390700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590217856:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788271990.753967:0:20313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788271990.754032:0:17208:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788271990.754047:0:17208:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788271990.754056:0:17208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d000/0x99288105fd38fdc2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fdc9 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271990.754063:0:17208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d000/0x99288105fd38fdc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fdc9 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271990.754071:0:17208:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788271990.754073:0:17208:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f6ebfb71000 from 13 10000000:01000000:0.0:1788271990.754074:0:17208:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788271990.754101:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e8511de00/0x99288105fd38fdd0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271990.754107:0:17208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6e8511de00/0x99288105fd38fdd0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271990.754124:0:17208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6e8511de00/0x99288105fd38fdd0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271990.754137:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83390700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590217984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788271990.754175:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271990.754191:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d88f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788271990.754203:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590217984 00000100:00100000:0.0:1788271990.754207:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590217984 00000100:00100000:0.0:1788271990.758564:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788271990.758585:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e8528d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+21:17208:x1875138590217984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788271990.758604:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271990.758639:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6e8511c600/0x99288105fd38fdd7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38fdd0 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271990.758668:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6e8511c600/0x99288105fd38fdd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38fdd0 expref: 22 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271990.758679:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6e8511c600/0x99288105fd38fdd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38fdd0 expref: 22 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271990.758689:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e8511c600, rc 0) 00000100:00100000:0.0:1788271990.758767:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e8528d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08d4e6e3-b587-4543-a287-4a9ae9a31c24+22:17208:x1875138590217984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 192us (4589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271990.758776:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788271990.758844:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83390700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590217984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788271990.758862:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6e8511de00/0x99288105fd38fdd0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fdd7 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271990.758880:0:17208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6e8511de00/0x99288105fd38fdd0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38fdd7 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271990.758952:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83390700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590218112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271990.758983:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271990.759014:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d82d88f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788271990.759028:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590218112 00000100:00100000:0.0:1788271990.759034:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590218112 00000100:00100000:0.0:1788271990.759059:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788271990.759065:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e8528fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+22:17208:x1875138590218112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271990.759167:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e8528fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+22:17208:x1875138590218112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271990.759173:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788271990.759200:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83390700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590218112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271990.759225:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83390700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590218240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788271990.759261:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271990.759275:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9828e180 going to sleep for 11 seconds 00000100:00100000:0.0:1788271990.759286:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590218240 00000100:00100000:0.0:1788271990.759289:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590218240 00000100:00100000:0.0:1788271990.759322:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788271990.759332:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e8528f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+22:17208:x1875138590218240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788271990.759415:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e8528f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+22:17208:x1875138590218240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271990.759424:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788271990.759489:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83390700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590218240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788271990.763379:0:20314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788271990.763968:0:17208:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788271990.763994:0:17208:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788271990.764005:0:17208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e8511de00/0x99288105fd38fdd0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fdd7 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271990.764019:0:17208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6e8511de00/0x99288105fd38fdd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fdd7 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788271990.764031:0:17208:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788271990.764034:0:17208:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f6d82344800 from 13 10000000:01000000:0.0:1788271990.764037:0:17208:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788271990.764420:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d200/0x99288105fd38fdde lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271990.764430:0:17208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d200/0x99288105fd38fdde lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271990.764441:0:17208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d200/0x99288105fd38fdde lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271990.764813:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83390700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590218368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788271990.764881:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271990.764972:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e9828e540 going to sleep for 11 seconds 00000100:00100000:1.0:1788271990.767594:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590218368 00000100:00100000:1.0:1788271990.767766:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590218368 00000100:00100000:0.0:1788271990.769371:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788271990.769385:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e8528ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+22:17208:x1875138590218368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788271990.769403:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271990.769421:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6e8511d400/0x99288105fd38fde5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38fdde expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271990.769523:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6e8511d400/0x99288105fd38fde5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38fdde expref: 23 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271990.769538:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6e8511d400/0x99288105fd38fde5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38fdde expref: 23 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271990.769547:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e8511d400, rc 0) 00000100:00100000:0.0:1788271990.769906:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e8528ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+23:17208:x1875138590218368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 524us (5024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271990.769914:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788271990.770127:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83390700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590218368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788271990.770147:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d200/0x99288105fd38fdde lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fde5 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271990.770158:0:17208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d200/0x99288105fd38fdde lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38fde5 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271990.770232:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d816cc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590218496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788271990.770274:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271990.770326:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc98db40 going to sleep for 11 seconds 00000100:00100000:1.0:1788271990.770371:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590218496 00000100:00100000:1.0:1788271990.770377:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590218496 00000100:00100000:1.0:1788271990.770415:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788271990.770423:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e8528d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+23:17208:x1875138590218496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271990.770550:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e8528d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+23:17208:x1875138590218496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271990.770557:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788271990.770722:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d816cc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590218496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271990.770753:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebc2bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590218624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271990.770790:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271990.770804:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e870bc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271990.770827:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590218624 00000100:00100000:1.0:1788271990.770831:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590218624 00000100:00100000:1.0:1788271990.770847:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788271990.770853:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e8528c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+23:17208:x1875138590218624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271990.770923:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e8528c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+23:17208:x1875138590218624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271990.770931:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788271990.770971:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebc2bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590218624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788271990.772044:0:20315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788271990.772111:0:17208:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788271990.772127:0:17208:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788271990.772136:0:17208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d200/0x99288105fd38fdde lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fde5 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271990.772159:0:17208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6e8511d200/0x99288105fd38fdde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fde5 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788271990.772170:0:17208:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788271990.772173:0:17208:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f6e851db000 from 13 10000000:01000000:1.0:1788271990.772175:0:17208:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788271990.772199:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d81729200/0x99288105fd38fdec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271990.772208:0:17208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.103@tcp lock: ffff8f6d81729200/0x99288105fd38fdec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271990.772218:0:17208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.103@tcp lock: ffff8f6d81729200/0x99288105fd38fdec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271990.772236:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebc2bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590218752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788271990.772281:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271990.772302:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e870bc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271990.772332:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590218752 00000100:00100000:1.0:1788271990.772338:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590218752 00000100:00100000:1.0:1788271990.772735:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788271990.772746:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e851a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+23:17208:x1875138590218752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788271990.772758:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271990.772769:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f6d81729c00/0x99288105fd38fdf3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x99288105fd38fdec expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271990.772789:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f6d81729c00/0x99288105fd38fdf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x99288105fd38fdec expref: 24 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271990.772814:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f6d81729c00/0x99288105fd38fdf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x99288105fd38fdec expref: 24 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271990.772822:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d81729c00, rc 0) 00000100:00100000:1.0:1788271990.772856:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e851a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+24:17208:x1875138590218752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271990.773070:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788271990.773118:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebc2bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590218752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788271990.773133:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.103@tcp lock: ffff8f6d81729200/0x99288105fd38fdec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fdf3 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271990.773144:0:17208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.103@tcp lock: ffff8f6d81729200/0x99288105fd38fdec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x99288105fd38fdf3 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271990.773192:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebc2bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590218880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271990.773218:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271990.773282:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e870bc3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788271990.773384:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590218880 00000100:00100000:0.0:1788271990.773389:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590218880 00000100:00100000:0.0:1788271990.773457:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788271990.773541:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e851a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+24:17208:x1875138590218880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788271990.774000:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e851a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+24:17208:x1875138590218880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 462us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271990.774009:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788271990.774163:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebc2bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590218880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788271990.774193:0:17208:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebc2bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590219008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271990.774232:0:17208:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271990.774254:0:17208:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e870bc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271990.774279:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590219008 00000100:00100000:1.0:1788271990.774283:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590219008 00000100:00100000:1.0:1788271990.774319:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788271990.774327:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e851a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+24:17208:x1875138590219008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788271990.774405:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e851a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08d4e6e3-b587-4543-a287-4a9ae9a31c24+24:17208:x1875138590219008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271990.774413:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788271990.774449:0:17208:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebc2bea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08d4e6e3-b587-4543-a287-4a9ae9a31c24:17208:1875138590219008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788271990.776544:0:20317:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788271990.778555:0:17208:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788271990.778589:0:17208:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.103@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788271990.778608:0:17208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.103@tcp lock: ffff8f6d81729200/0x99288105fd38fdec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fdf3 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271990.778653:0:17208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.103@tcp lock: ffff8f6d81729200/0x99288105fd38fdec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x99288105fd38fdf3 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271991.389897:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271991.837940:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfc76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590219136:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788271991.838016:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271991.840850:0:18724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590219136 00000100:00100000:1.0:1788271991.840865:0:18724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590219136 00000100:00100000:1.0:1788271991.840962:0:18724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788271991.840977:0:18724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83392d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590219136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788271991.841013:0:18724:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00080000:2.0:1788271991.841067:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788271991.841104:0:18724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83392d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3607:x1875138590219136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 132us (3087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271991.841112:0:18724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788271991.841170:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfc76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3607:1875138590219136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788271992.208958:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271992.209076:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577558272 00000100:00100000:0.0:1788271992.209087:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577558272 00000100:00100000:0.0:1788271992.209186:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 23 00000100:00100000:0.0:1788271992.209197:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc2bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f7552d3-578c-40be-b601-54fb5b48de11+6:15591:x1875138577558272:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788271992.209237:0:17213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271992.209259:0:17213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38fdfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd8ce expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.209337:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c800/0x99288105fd38fe01 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.209353:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c800/0x99288105fd38fe01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.209368:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c800/0x99288105fd38fe01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.209383:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38fe08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.209390:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38fe08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.209397:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38fe08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.209751:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38fe0f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.209760:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38fe0f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.209769:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38fe0f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271992.209803:0:17213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788271992.209813:0:17213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788271992.209857:0:17213:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38fe0f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.209869:0:17213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c800/0x99288105fd38fe01 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.209875:0:17213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c800/0x99288105fd38fe01 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.209882:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c800/0x99288105fd38fe01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.209888:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511c800 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271992.209892:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c800/0x99288105fd38fe01 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.209900:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c800/0x99288105fd38fe01 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.209913:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6e88835600) 00010000:00010000:0.0:1788271992.209916:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271992.209922:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c800/0x99288105fd38fe01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.209928:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511c800/0x99288105fd38fe01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.209943:0:17213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38fe08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.209949:0:17213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38fe08 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.209964:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38fe08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.209970:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511dc00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271992.209973:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38fe08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.209978:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38fe08 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.209986:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8f6d8305a400) 00010000:00010000:0.0:1788271992.209988:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271992.209991:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38fe08 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.209996:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd38fe08 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.210032:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd38fdfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd8ce expref: 8 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.210046:0:17213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5000/0x99288105fd38fe0f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd8ce expref: 7 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.210053:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f6d8305ac00) 00010000:00010000:0.0:1788271992.210056:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788271992.210059:0:17213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c5000, rc 0) 00000100:00100000:0.0:1788271992.210201:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc2bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f7552d3-578c-40be-b601-54fb5b48de11+7:15591:x1875138577558272:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 1006us (1254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271992.210220:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 23 00000100:00080000:2.0:1788271992.210994:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788271992.220047:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271992.226058:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577558400 00000100:00100000:1.0:1788271992.226074:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577558400 00000100:00100000:1.0:1788271992.226151:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 5 00000100:00100000:1.0:1788271992.226162:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8f7552d3-578c-40be-b601-54fb5b48de11+7:15591:x1875138577558400:12345-192.168.201.3@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788271992.226262:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8f7552d3-578c-40be-b601-54fb5b48de11+7:15591:x1875138577558400:12345-192.168.201.3@tcp:900:lhsmtool_posix.0 Request processed in 102us (6226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271992.226271:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 5 00000100:00100000:3.0:1788271992.232035:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271992.232162:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577558656 00000100:00100000:0.0:1788271992.232173:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577558656 00000100:00100000:0.0:1788271992.232234:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 24 00000100:00100000:0.0:1788271992.232244:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d816ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f7552d3-578c-40be-b601-54fb5b48de11+7:15591:x1875138577558656:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788271992.232265:0:17211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271992.232294:0:17211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38fe16 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd8d5 expref: -99 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.232371:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5c00/0x99288105fd38fe1d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.232385:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5c00/0x99288105fd38fe1d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.232396:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5c00/0x99288105fd38fe1d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.232448:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38fe24 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.232828:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38fe24 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.232839:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38fe24 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.233121:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5e00/0x99288105fd38fe2b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.233148:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5e00/0x99288105fd38fe2b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.233156:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5e00/0x99288105fd38fe2b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271992.233167:0:17211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788271992.233331:0:17211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5c00/0x99288105fd38fe1d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.233339:0:17211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5c00/0x99288105fd38fe1d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.233346:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5c00/0x99288105fd38fe1d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.233352:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c5c00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271992.233356:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5c00/0x99288105fd38fe1d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.233363:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5c00/0x99288105fd38fe1d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.233374:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f6d8305ac00) 00010000:00010000:0.0:1788271992.233377:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271992.233381:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5c00/0x99288105fd38fe1d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.233387:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5c00/0x99288105fd38fe1d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.233399:0:17211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38fe24 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.233411:0:17211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38fe24 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.233417:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38fe24 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.233423:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4400 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271992.233426:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38fe24 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.233433:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38fe24 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.233440:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8f6d8305a400) 00010000:00010000:0.0:1788271992.233442:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271992.233444:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38fe24 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.233450:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38fe24 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.241352:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38fe16 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd8d5 expref: 10 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.241381:0:17211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5e00/0x99288105fd38fe2b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd8d5 expref: 9 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.241391:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f6d8305a200) 00010000:00010000:0.0:1788271992.241394:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271992.241411:0:17211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c5e00, rc 0) 00000100:00100000:0.0:1788271992.241494:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d816ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f7552d3-578c-40be-b601-54fb5b48de11+9:15591:x1875138577558656:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 9251us (9468us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788271992.241503:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 24 00000100:00100000:0.0:1788271992.257687:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271992.257798:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577558784 00000100:00100000:2.0:1788271992.257807:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577558784 00000100:00100000:2.0:1788271992.257871:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 25 00000100:00100000:2.0:1788271992.257882:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83393480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f7552d3-578c-40be-b601-54fb5b48de11+9:15591:x1875138577558784:12345-192.168.201.3@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788271992.258015:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83393480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f7552d3-578c-40be-b601-54fb5b48de11+9:15591:x1875138577558784:12345-192.168.201.3@tcp:59:lhsmtool_posix.0 Request processed in 134us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271992.258023:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 25 00000100:00100000:1.0:1788271992.274870:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271992.275768:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577558912 00000100:00100000:0.0:1788271992.275780:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577558912 00000100:00100000:0.0:1788271992.275864:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 26 00000100:00100000:0.0:1788271992.275877:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc2bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f7552d3-578c-40be-b601-54fb5b48de11+5:15591:x1875138577558912:12345-192.168.201.3@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1788271992.276766:0:17211:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 839us 00000100:00080000:2.0:1788271992.280862:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788271992.296701:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271992.296809:0:17212:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788271992.296820:0:17212:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788271992.298404:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc2bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f7552d3-578c-40be-b601-54fb5b48de11+5:15591:x1875138577558912:12345-192.168.201.3@tcp:59:lhsmtool_posix.0 Request processed in 22524us (23537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271992.298417:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577559040 00000100:00100000:1.0:1788271992.298417:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 26 00000100:00100000:2.0:1788271992.298425:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577559040 00000100:00100000:2.0:1788271992.298465:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 27 00000100:00100000:2.0:1788271992.298473:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83393800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f7552d3-578c-40be-b601-54fb5b48de11+9:15597:x1875138577559040:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788271992.298490:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271992.298511:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4c00/0x99288105fd38fe39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd8dc expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.298804:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5400/0x99288105fd38fe40 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.298818:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5400/0x99288105fd38fe40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.298834:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5400/0x99288105fd38fe40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.298850:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4a00/0x99288105fd38fe47 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.298857:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4a00/0x99288105fd38fe47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.298864:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4a00/0x99288105fd38fe47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.298914:0:17212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5400/0x99288105fd38fe40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.298921:0:17212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5400/0x99288105fd38fe40 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.298928:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5400/0x99288105fd38fe40 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.298935:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d81de5400 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271992.298939:0:17212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5400/0x99288105fd38fe40 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.298947:0:17212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5400/0x99288105fd38fe40 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.298959:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6e88835600) 00010000:00010000:2.0:1788271992.298962:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271992.298967:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5400/0x99288105fd38fe40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.298981:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5400/0x99288105fd38fe40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.298993:0:17212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4a00/0x99288105fd38fe47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.299000:0:17212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4a00/0x99288105fd38fe47 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.299006:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4a00/0x99288105fd38fe47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.299011:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d81de4a00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271992.299014:0:17212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4a00/0x99288105fd38fe47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.299020:0:17212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4a00/0x99288105fd38fe47 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.299027:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f6e90141400) 00010000:00010000:2.0:1788271992.299030:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271992.299032:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4a00/0x99288105fd38fe47 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.299038:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4a00/0x99288105fd38fe47 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.299066:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4c00/0x99288105fd38fe39 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd8dc expref: 10 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.299088:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6e88835600) 00010000:00010000:2.0:1788271992.299090:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271992.299094:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4c00/0x99288105fd38fe39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd8dc expref: 10 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.299102:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d81de4c00, rc 0) 00000100:00100000:2.0:1788271992.300677:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83393800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f7552d3-578c-40be-b601-54fb5b48de11+9:15597:x1875138577559040:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 2195us (3978us total) trans 0 rc 301/301 00000100:00100000:2.0:1788271992.300689:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 27 00000100:00100000:0.0:1788271992.308271:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271992.308491:0:17220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577559168 00000100:00100000:3.0:1788271992.308502:0:17220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577559168 00000100:00100000:3.0:1788271992.308698:0:17220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 0 00000100:00100000:3.0:1788271992.308719:0:17220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83390000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8f7552d3-578c-40be-b601-54fb5b48de11+9:15597:x1875138577559168:12345-192.168.201.3@tcp:700:lfs.0 00000100:00100000:3.0:1788271992.308800:0:17220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83390000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8f7552d3-578c-40be-b601-54fb5b48de11+9:15597:x1875138577559168:12345-192.168.201.3@tcp:700:lfs.0 Request processed in 84us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271992.308820:0:17220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 0 00000100:00100000:2.0:1788271992.313196:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271992.313289:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577559424 00000100:00100000:1.0:1788271992.313299:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577559424 00000100:00100000:1.0:1788271992.313383:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 28 00000100:00100000:1.0:1788271992.313393:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f7552d3-578c-40be-b601-54fb5b48de11+9:15597:x1875138577559424:12345-192.168.201.3@tcp:36:lfs.0 00010000:00010000:1.0:1788271992.313448:0:17211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271992.313475:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5a00/0x99288105fd38fd67 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd849 expref: 9 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271992.313495:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6e88835600) 00010000:00010000:1.0:1788271992.313500:0:17211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788271992.313571:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81728600/0x99288105fd38fe4e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271992.313583:0:17211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38fda6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd8b9 expref: 5 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271992.313592:0:17211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81728600/0x99288105fd38fe4e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271992.313661:0:17211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38fda6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd8b9 expref: 5 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271992.313675:0:17211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38fda6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd8b9 expref: 5 pid: 17213 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271992.313690:0:17211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebc2bf800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17211:1875138590219264:192.168.201.3@tcp:104: 00000100:00100000:1.0:1788271992.314111:0:17211:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6e870bcf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788271992.318962:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271992.319100:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577559552 00000100:00100000:2.0:1788271992.319111:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577559552 00010000:00010000:2.0:1788271992.319198:0:17197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38fda6 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd8b9 expref: 6 pid: 17213 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271992.319240:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 15 00000100:00100000:2.0:1788271992.319260:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83390700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a6e7813-b915-4224-95b8-fa91b7ad9b79+6:2398:x1875138577559552:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271992.319275:0:17197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271992.319290:0:17197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38fda6 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd8b9 expref: 6 pid: 17213 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.319305:0:17197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38fda6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd8b9 expref: 6 pid: 17213 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.319325:0:17197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6e88835600) 00010000:00010000:2.0:1788271992.319343:0:17197:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81728600/0x99288105fd38fe4e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.319352:0:17197:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81728600/0x99288105fd38fe4e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.319359:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81728600/0x99288105fd38fe4e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.319381:0:17197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271992.319434:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83390700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8a6e7813-b915-4224-95b8-fa91b7ad9b79+6:2398:x1875138577559552:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 183us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271992.319441:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 15 00010000:00010000:1.0:1788271992.319842:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38fda6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd8b9 expref: 5 pid: 17213 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271992.319867:0:17211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebc2bf800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17211:1875138590219264:192.168.201.3@tcp:104: 00010000:00010000:1.0:1788271992.319889:0:17211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81728600/0x99288105fd38fe4e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.319960:0:17211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81728600/0x99288105fd38fe4e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.319967:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81728600/0x99288105fd38fe4e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.319994:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5c00/0x99288105fd38fe55 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.320005:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5c00/0x99288105fd38fe55 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.320013:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5c00/0x99288105fd38fe55 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788271992.321931:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788271992.322001:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38fe5c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.322025:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38fe5c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.322035:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38fe5c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788271992.322056:0:17211:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dcd0981a reply state 000000009fb36267 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38fe5c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.322070:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38fe5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.322077:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f6d8305a700) 00010000:00010000:0.0:1788271992.322079:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788271992.322083:0:17211:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788271992.322089:0:17211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788271992.322097:0:17211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81728600/0x99288105fd38fe4e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.322103:0:17211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81728600/0x99288105fd38fe4e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.322110:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81728600/0x99288105fd38fe4e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.322116:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d81728600 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271992.322121:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81728600/0x99288105fd38fe4e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.322127:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81728600/0x99288105fd38fe4e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.322150:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6e88835600) 00010000:00010000:0.0:1788271992.322152:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271992.322156:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81728600/0x99288105fd38fe4e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.322162:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81728600/0x99288105fd38fe4e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788271992.322178:0:17211:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dcd0981a reply state 000000009fb36267 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5c00/0x99288105fd38fe55 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.322186:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5c00/0x99288105fd38fe55 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.322192:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f6d8305a400) 00010000:00010000:0.0:1788271992.322194:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788271992.322197:0:17211:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788271992.322433:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f7552d3-578c-40be-b601-54fb5b48de11+10:15597:x1875138577559424:12345-192.168.201.3@tcp:36:lfs.0 Request processed in 9037us (9242us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788271992.322442:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 28 00000100:00100000:1.0:1788271992.349873:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590219392:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788271992.349965:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271992.350087:0:17953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590219392 00000100:00100000:2.0:1788271992.350096:0:17953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590219392 00000100:00100000:2.0:1788271992.350155:0:17953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788271992.350164:0:17953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc2bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590219392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788271992.350196:0:17953:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788271992.351526:0:17953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc2bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3608:x1875138590219392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1356us (1554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271992.351537:0:17953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788271992.351653:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3608:1875138590219392:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788271992.351673:0:3608:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788271992.351682:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83391880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590219520:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788271992.351728:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788271992.351783:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590219520 00000100:00100000:1.0:1788271992.351788:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590219520 00000100:00100000:1.0:1788271992.351813:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788271992.351818:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc2bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590219520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788271992.351840:0:17217:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788271992.351879:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc2bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590219520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271992.351885:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788271992.351917:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83391880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590219520:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788271992.414389:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788271992.416309:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271992.416448:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577559680 00000100:00100000:3.0:1788271992.416457:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577559680 00000100:00100000:3.0:1788271992.416518:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 29 00000100:00100000:3.0:1788271992.416528:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83391880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f7552d3-578c-40be-b601-54fb5b48de11+10:15605:x1875138577559680:12345-192.168.201.3@tcp:101:lctl.0 00010000:00010000:3.0:1788271992.416552:0:17213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271992.416574:0:17213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20e00/0x99288105fd38fe63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd8e3 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.416676:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38fe6a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.416690:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38fe6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.416700:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38fe6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271992.416744:0:17213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788271992.416748:0:17213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788271992.416788:0:17213:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38fe6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.416813:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20e00/0x99288105fd38fe63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd8e3 expref: 12 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.416829:0:17213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20200/0x99288105fd38fe6a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd8e3 expref: 11 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.416856:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6e920a2300) 00010000:00010000:3.0:1788271992.416859:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788271992.416862:0:17213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e20200, rc 0) 00000100:00100000:3.0:1788271992.416923:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83391880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f7552d3-578c-40be-b601-54fb5b48de11+11:15605:x1875138577559680:12345-192.168.201.3@tcp:101:lctl.0 Request processed in 396us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271992.416931:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 29 00000100:00100000:2.0:1788271992.463863:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271992.463960:0:20353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577559808 00000100:00100000:0.0:1788271992.463970:0:20353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577559808 00000100:00100000:0.0:1788271992.464038:0:20353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 30 00000100:00100000:0.0:1788271992.464050:0:20353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a6e7813-b915-4224-95b8-fa91b7ad9b79+5:15606:x1875138577559808:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:0.0:1788271992.464084:0:20353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271992.464107:0:20353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4600/0x99288105fd38fe71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd8ea expref: -99 pid: 20353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.464192:0:20353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38fe78 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.464205:0:20353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38fe78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.464601:0:20353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38fe78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271992.464676:0:20353:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788271992.464680:0:20353:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788271992.464699:0:20353:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38fe78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.464725:0:20353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4600/0x99288105fd38fe71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd8ea expref: 7 pid: 20353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.464744:0:20353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5600/0x99288105fd38fe78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd8ea expref: 6 pid: 20353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.464752:0:20353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6e920a2300) 00010000:00010000:0.0:1788271992.464755:0:20353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788271992.464760:0:20353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c5600, rc 0) 00000100:00100000:0.0:1788271992.464874:0:20353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a6e7813-b915-4224-95b8-fa91b7ad9b79+6:15606:x1875138577559808:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 826us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271992.464881:0:20353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 30 00000100:00100000:0.0:1788271992.473303:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271992.473404:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577559936 00000100:00100000:3.0:1788271992.473415:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577559936 00000100:00100000:3.0:1788271992.473475:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 31 00000100:00100000:3.0:1788271992.473486:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc232300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a6e7813-b915-4224-95b8-fa91b7ad9b79+6:15606:x1875138577559936:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:3.0:1788271992.473505:0:17213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271992.473535:0:17213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20e00/0x99288105fd38fe7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd8f1 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.473600:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38fe86 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.473615:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38fe86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.473650:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38fe86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.473662:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38fe8d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.473670:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38fe8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.473689:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38fe8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.473769:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38fe94 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.473778:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38fe94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.473786:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38fe94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271992.473822:0:17213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788271992.473826:0:17213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788271992.473848:0:17213:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38fe94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.473860:0:17213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38fe86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.473867:0:17213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38fe86 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.473875:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38fe86 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.473881:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e21e00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271992.473885:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38fe86 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.473895:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38fe86 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.473914:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6e920a2300) 00010000:00010000:3.0:1788271992.473917:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271992.473922:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38fe86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.473929:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38fe86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.473941:0:17213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38fe8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.473948:0:17213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38fe8d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.473954:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38fe8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.473960:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e21000 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271992.473963:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38fe8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.473968:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38fe8d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.473976:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f6d8305a400) 00010000:00010000:3.0:1788271992.473978:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271992.473982:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38fe8d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.473988:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38fe8d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.474026:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20e00/0x99288105fd38fe7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd8f1 expref: 8 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.474039:0:17213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38fe94 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd8f1 expref: 7 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.474046:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f6d8305a700) 00010000:00010000:3.0:1788271992.474048:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788271992.474051:0:17213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e20a00, rc 0) 00000100:00100000:3.0:1788271992.474132:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc232300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a6e7813-b915-4224-95b8-fa91b7ad9b79+7:15606:x1875138577559936:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 648us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271992.474139:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 31 00000100:00100000:3.0:1788271992.484083:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271992.484191:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577560064 00000100:00100000:1.0:1788271992.484202:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577560064 00000100:00100000:1.0:1788271992.484297:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 6 00000100:00100000:1.0:1788271992.484308:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8a6e7813-b915-4224-95b8-fa91b7ad9b79+5:15606:x1875138577560064:12345-192.168.201.3@tcp:900:lfs.0 00000100:00100000:1.0:1788271992.484395:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8a6e7813-b915-4224-95b8-fa91b7ad9b79+5:15606:x1875138577560064:12345-192.168.201.3@tcp:900:lfs.0 Request processed in 88us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271992.484417:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 6 00000100:00080000:3.0:1788271992.484652:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788271992.501958:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271992.502081:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577560320 00000100:00100000:2.0:1788271992.502092:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577560320 00000100:00100000:2.0:1788271992.502152:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 32 00000100:00100000:2.0:1788271992.502163:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc230000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a6e7813-b915-4224-95b8-fa91b7ad9b79+7:15606:x1875138577560320:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788271992.502184:0:17211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271992.502204:0:17211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5600/0x99288105fd38fe9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd8f8 expref: -99 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271992.502333:0:17211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788271992.502430:0:17211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5600/0x99288105fd38fe9b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd8f8 expref: 9 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.502446:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6e920a2300) 00010000:00010000:2.0:1788271992.502449:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788271992.502454:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5600/0x99288105fd38fe9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd8f8 expref: 9 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.502469:0:17211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d81de5600, rc 0) 00000100:00100000:2.0:1788271992.502530:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc230000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a6e7813-b915-4224-95b8-fa91b7ad9b79+8:15606:x1875138577560320:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 368us (580us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1788271992.502538:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 32 00000100:00100000:0.0:1788271992.508376:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271992.508465:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577560576 00000100:00100000:3.0:1788271992.508474:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577560576 00000100:00100000:3.0:1788271992.508525:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 33 00000100:00100000:3.0:1788271992.508535:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc232d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a6e7813-b915-4224-95b8-fa91b7ad9b79+8:15606:x1875138577560576:12345-192.168.201.3@tcp:36:lfs.0 00010000:00010000:3.0:1788271992.508592:0:17213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271992.508646:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38fe94 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd8f1 expref: 8 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.508665:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f6d8305a700) 00010000:00010000:3.0:1788271992.508670:0:17213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788271992.508692:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20e00/0x99288105fd38fea9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.508724:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20e00/0x99288105fd38fea9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.508734:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20e00/0x99288105fd38fea9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788271992.508932:0:17213:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009ee13273 reply state 000000005ec1c2b7 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20e00/0x99288105fd38fea9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.508946:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20e00/0x99288105fd38fea9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.508953:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f6d8305a700) 00010000:00010000:3.0:1788271992.508956:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1788271992.508959:0:17213:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788271992.508965:0:17213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788271992.509412:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc232d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a6e7813-b915-4224-95b8-fa91b7ad9b79+9:15606:x1875138577560576:12345-192.168.201.3@tcp:36:lfs.0 Request processed in 876us (1043us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788271992.509421:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 33 00000100:00100000:0.0:1788271992.516741:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271992.516956:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577560832 00000100:00100000:1.0:1788271992.516966:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577560832 00000100:00100000:1.0:1788271992.517056:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 2 00000100:00100000:1.0:1788271992.517068:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc230e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a6e7813-b915-4224-95b8-fa91b7ad9b79+9:15606:x1875138577560832:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:1.0:1788271992.517342:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc230e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a6e7813-b915-4224-95b8-fa91b7ad9b79+10:15606:x1875138577560832:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 275us (610us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788271992.517350:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 2 00000100:00100000:1.0:1788271992.527335:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271992.527455:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577561088 00000100:00100000:2.0:1788271992.527474:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577561088 00000100:00100000:2.0:1788271992.527697:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 34 00000100:00100000:2.0:1788271992.527708:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc2be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a6e7813-b915-4224-95b8-fa91b7ad9b79+10:15606:x1875138577561088:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:2.0:1788271992.527731:0:17211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271992.527751:0:17211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4e00/0x99288105fd38feb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd8ff expref: -99 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.527836:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4400/0x99288105fd38feb7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.527851:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4400/0x99288105fd38feb7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.527880:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4400/0x99288105fd38feb7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.527891:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5000/0x99288105fd38febe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.527898:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5000/0x99288105fd38febe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.527905:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5000/0x99288105fd38febe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271992.528024:0:17211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788271992.528347:0:17211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4400/0x99288105fd38feb7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.528355:0:17211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4400/0x99288105fd38feb7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.528361:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4400/0x99288105fd38feb7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.528367:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d81de4400 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271992.528372:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4400/0x99288105fd38feb7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.528379:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4400/0x99288105fd38feb7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.528392:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6e920a2300) 00010000:00010000:2.0:1788271992.528395:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271992.528407:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4400/0x99288105fd38feb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.528413:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4400/0x99288105fd38feb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.528426:0:17211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5000/0x99288105fd38febe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.528432:0:17211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5000/0x99288105fd38febe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.528439:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5000/0x99288105fd38febe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.528444:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d81de5000 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271992.528447:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5000/0x99288105fd38febe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.528453:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5000/0x99288105fd38febe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.528461:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f6d8305a400) 00010000:00010000:2.0:1788271992.528464:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271992.528466:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5000/0x99288105fd38febe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.528472:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5000/0x99288105fd38febe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.528508:0:17211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4e00/0x99288105fd38feb0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd8ff expref: 12 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.528530:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6e920a2300) 00010000:00010000:2.0:1788271992.528532:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788271992.528537:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4e00/0x99288105fd38feb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd8ff expref: 12 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.528547:0:17211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d81de4e00, rc 0) 00000100:00100000:2.0:1788271992.528666:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc2be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8a6e7813-b915-4224-95b8-fa91b7ad9b79+11:15606:x1875138577561088:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 960us (1339us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788271992.528674:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 34 00000100:00100000:2.0:1788271992.532002:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271992.532133:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577561216 00000100:00100000:3.0:1788271992.532145:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577561216 00000100:00100000:3.0:1788271992.532206:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 35 00000100:00100000:3.0:1788271992.532215:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a6e7813-b915-4224-95b8-fa91b7ad9b79+11:15606:x1875138577561216:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:3.0:1788271992.532249:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271992.532270:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38fecc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd906 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.532375:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38fed3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.532401:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38fed3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.532412:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38fed3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271992.532437:0:17212:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788271992.532441:0:17212:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788271992.532459:0:17212:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38fed3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.532485:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38fecc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd906 expref: 13 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.532501:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38fed3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd906 expref: 12 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.532510:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f6d8305a700) 00010000:00010000:3.0:1788271992.532514:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788271992.532517:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e21000, rc 0) 00000100:00100000:3.0:1788271992.532592:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8a6e7813-b915-4224-95b8-fa91b7ad9b79+12:15606:x1875138577561216:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 378us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271992.532598:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 35 00000100:00100000:3.0:1788271992.536527:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271992.536686:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577561344 00000100:00100000:0.0:1788271992.536696:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577561344 00000100:00100000:0.0:1788271992.536757:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 3 00000100:00100000:0.0:1788271992.536769:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a6e7813-b915-4224-95b8-fa91b7ad9b79+12:15606:x1875138577561344:12345-192.168.201.3@tcp:37:lfs.0 00000100:00100000:0.0:1788271992.543467:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8a6e7813-b915-4224-95b8-fa91b7ad9b79+12:15606:x1875138577561344:12345-192.168.201.3@tcp:37:lfs.0 Request processed in 6692us (6938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271992.543481:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 3 00000100:00100000:2.0:1788271992.547040:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271992.547230:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577561600 00000100:00100000:1.0:1788271992.547247:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577561600 00000100:00100000:1.0:1788271992.547364:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 4 00000100:00100000:1.0:1788271992.547375:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83187850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a6e7813-b915-4224-95b8-fa91b7ad9b79+12:15606:x1875138577561600:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:1.0:1788271992.547610:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83187850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8a6e7813-b915-4224-95b8-fa91b7ad9b79+13:15606:x1875138577561600:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 236us (578us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788271992.547764:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 4 00000100:00100000:2.0:1788271992.611217:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271992.611714:0:20353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577561728 00000100:00100000:0.0:1788271992.611724:0:20353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577561728 00000100:00100000:0.0:1788271992.611800:0:20353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 36 00000100:00100000:0.0:1788271992.611811:0:20353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f7552d3-578c-40be-b601-54fb5b48de11+11:15612:x1875138577561728:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:0.0:1788271992.611833:0:20353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271992.611858:0:20353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38feda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd90d expref: -99 pid: 20353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.611925:0:20353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38fee1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.611939:0:20353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38fee1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.611950:0:20353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38fee1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.611962:0:20353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38fee8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.611988:0:20353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38fee8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.611997:0:20353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38fee8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.612087:0:20353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4600/0x99288105fd38feef lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.612097:0:20353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4600/0x99288105fd38feef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.612103:0:20353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4600/0x99288105fd38feef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271992.612139:0:20353:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788271992.612143:0:20353:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788271992.612183:0:20353:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4600/0x99288105fd38feef lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.612197:0:20353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38fee1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.612203:0:20353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38fee1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.612210:0:20353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38fee1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.612215:0:20353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4200 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271992.612220:0:20353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38fee1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.612233:0:20353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38fee1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.612259:0:20353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6e920a2300) 00010000:00010000:0.0:1788271992.612262:0:20353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271992.612267:0:20353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38fee1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.612273:0:20353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38fee1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.612298:0:20353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38fee8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.612304:0:20353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38fee8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.612310:0:20353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38fee8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.612315:0:20353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4400 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271992.612317:0:20353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38fee8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.612323:0:20353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38fee8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.612330:0:20353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f6d8305a400) 00010000:00010000:0.0:1788271992.612332:0:20353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271992.612335:0:20353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38fee8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.612350:0:20353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38fee8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.612375:0:20353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38feda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd90d expref: 13 pid: 20353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.612386:0:20353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4600/0x99288105fd38feef lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd90d expref: 12 pid: 20353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.612393:0:20353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f6d8305a700) 00010000:00010000:0.0:1788271992.612395:0:20353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788271992.612397:0:20353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c4600, rc 0) 00000100:00100000:0.0:1788271992.612772:0:20353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f7552d3-578c-40be-b601-54fb5b48de11+12:15612:x1875138577561728:12345-192.168.201.3@tcp:101:bash.0 Request processed in 962us (1564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271992.612779:0:20353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 36 00000100:00100000:2.0:1788271992.622210:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271992.622331:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577561856 00000100:00100000:1.0:1788271992.622342:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577561856 00000100:00100000:1.0:1788271992.622401:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:1.0:1788271992.622412:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8f7552d3-578c-40be-b601-54fb5b48de11+5:15612:x1875138577561856:12345-192.168.201.3@tcp:900:bash.0 00000100:00100000:1.0:1788271992.622502:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8f7552d3-578c-40be-b601-54fb5b48de11+5:15612:x1875138577561856:12345-192.168.201.3@tcp:900:bash.0 Request processed in 91us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271992.622509:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:2.0:1788271992.625981:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271992.626063:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577562112 00000100:00100000:3.0:1788271992.626073:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577562112 00000100:00100000:3.0:1788271992.626134:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 37 00000100:00100000:3.0:1788271992.626145:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f7552d3-578c-40be-b601-54fb5b48de11+12:15612:x1875138577562112:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:3.0:1788271992.626181:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271992.626204:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38fef6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd914 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.626333:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38fefd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.626348:0:17212:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38fed3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd906 expref: 12 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.626358:0:17212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38fefd lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.626392:0:17212:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38fed3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd906 expref: 12 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.626406:0:17212:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38fed3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd906 expref: 12 pid: 17212 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271992.626420:0:17212:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17212:1875138590219648:192.168.201.3@tcp:104: 00000100:00100000:3.0:1788271992.626500:0:17212:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc98de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788271992.630823:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271992.630924:0:18367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577562240 00000100:00100000:2.0:1788271992.630934:0:18367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577562240 00010000:00010000:2.0:1788271992.630976:0:18367:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38fed3 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd906 expref: 13 pid: 17212 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271992.631024:0:18367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 16 00000100:00100000:2.0:1788271992.631033:0:18367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc233800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a6e7813-b915-4224-95b8-fa91b7ad9b79+13:2398:x1875138577562240:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271992.631050:0:18367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271992.631057:0:18367:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38fed3 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd906 expref: 13 pid: 17212 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.631089:0:18367:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38fed3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd906 expref: 13 pid: 17212 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.631112:0:18367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f6d8305a700) 00010000:00010000:2.0:1788271992.631117:0:18367:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38fefd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.631128:0:18367:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38fefd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.631135:0:18367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38fefd lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.631153:0:18367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271992.631219:0:18367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc233800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8a6e7813-b915-4224-95b8-fa91b7ad9b79+13:2398:x1875138577562240:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 186us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271992.631228:0:18367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 16 00010000:00010000:3.0:1788271992.632038:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38fed3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd906 expref: 12 pid: 17212 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271992.632060:0:17212:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17212:1875138590219648:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788271992.632080:0:17212:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38fefd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.632104:0:17212:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38fefd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.632109:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38fefd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.632134:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20600/0x99288105fd38ff04 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.632145:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20600/0x99288105fd38ff04 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.632154:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20600/0x99288105fd38ff04 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.633013:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20400/0x99288105fd38ff0b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.633027:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20400/0x99288105fd38ff0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.633035:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20400/0x99288105fd38ff0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271992.633045:0:17212:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788271992.633069:0:17212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38fefd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.633076:0:17212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38fefd lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.633084:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38fefd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.633099:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e21e00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271992.633104:0:17212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38fefd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.633112:0:17212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38fefd lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.633124:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f6d8305a700) 00010000:00010000:3.0:1788271992.633127:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271992.633131:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38fefd lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.633137:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38fefd lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788271992.633148:0:17212:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000037f493ca reply state 00000000e7a22aa5 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20600/0x99288105fd38ff04 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.633159:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20600/0x99288105fd38ff04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.633164:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8f6e920a2b00) 00010000:00010000:3.0:1788271992.633166:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788271992.633169:0:17212:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788271992.633201:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38fef6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd914 expref: 15 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.633215:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20400/0x99288105fd38ff0b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd914 expref: 14 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.633233:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f6e920a2500) 00010000:00010000:3.0:1788271992.633235:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788271992.633238:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e20400, rc 0) 00000100:00100000:3.0:1788271992.633911:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f7552d3-578c-40be-b601-54fb5b48de11+15:15612:x1875138577562112:12345-192.168.201.3@tcp:101:bash.0 Request processed in 7764us (7936us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788271992.633919:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 37 00000100:00100000:0.0:1788271992.652483:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271992.652571:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577562368 00000100:00100000:2.0:1788271992.652579:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577562368 00000100:00100000:2.0:1788271992.652661:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 38 00000100:00100000:2.0:1788271992.652669:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc231180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f7552d3-578c-40be-b601-54fb5b48de11+15:15612:x1875138577562368:12345-192.168.201.3@tcp:101:bash.0 00010000:00010000:2.0:1788271992.652691:0:17211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271992.652708:0:17211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5200/0x99288105fd38ff19 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd91b expref: -99 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.652759:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4400/0x99288105fd38ff20 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.652785:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4400/0x99288105fd38ff20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.652802:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4400/0x99288105fd38ff20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788271992.652849:0:17211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788271992.652852:0:17211:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788271992.652869:0:17211:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4400/0x99288105fd38ff20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.652877:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4400/0x99288105fd38ff20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.652899:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5200/0x99288105fd38ff19 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd91b expref: 17 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.652914:0:17211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4400/0x99288105fd38ff20 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd91b expref: 16 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271992.652921:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f6e920a2500) 00010000:00010000:2.0:1788271992.652923:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788271992.652926:0:17211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d81de4400, rc 0) 00000100:00100000:2.0:1788271992.652971:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc231180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f7552d3-578c-40be-b601-54fb5b48de11+16:15612:x1875138577562368:12345-192.168.201.3@tcp:101:bash.0 Request processed in 303us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271992.652975:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 38 00000100:00100000:2.0:1788271992.656060:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271992.656166:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577562624 00000100:00100000:0.0:1788271992.656174:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577562624 00000100:00100000:0.0:1788271992.656353:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 5 00000100:00100000:0.0:1788271992.656361:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8f7552d3-578c-40be-b601-54fb5b48de11+16:15612:x1875138577562624:12345-192.168.201.3@tcp:35:bash.0 00000100:00100000:0.0:1788271992.656699:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8f7552d3-578c-40be-b601-54fb5b48de11+17:15612:x1875138577562624:12345-192.168.201.3@tcp:35:bash.0 Request processed in 338us (649us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788271992.656705:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 5 00000100:00100000:1.0:1788271992.775728:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271992.775837:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577562880 00000100:00100000:0.0:1788271992.775847:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577562880 00000100:00100000:0.0:1788271992.775924:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 39 00000100:00100000:0.0:1788271992.775934:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc2bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f7552d3-578c-40be-b601-54fb5b48de11+17:15622:x1875138577562880:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:0.0:1788271992.775961:0:17213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271992.775983:0:17213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38ff27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd922 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271992.776094:0:17213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788271992.776198:0:17213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38ff27 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd922 expref: 19 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.776213:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f6e920a2300) 00010000:00010000:0.0:1788271992.776215:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788271992.776221:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38ff27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd922 expref: 19 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.776234:0:17213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c4400, rc 0) 00000100:00100000:0.0:1788271992.776437:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc2bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f7552d3-578c-40be-b601-54fb5b48de11+18:15622:x1875138577562880:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 500us (714us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1788271992.776444:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 39 00000100:00100000:2.0:1788271992.781048:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271992.781141:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577563136 00000100:00100000:1.0:1788271992.781165:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577563136 00000100:00100000:1.0:1788271992.781762:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 6 00000100:00100000:1.0:1788271992.781775:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8f7552d3-578c-40be-b601-54fb5b48de11+18:15622:x1875138577563136:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:1.0:1788271992.782064:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8f7552d3-578c-40be-b601-54fb5b48de11+19:15622:x1875138577563136:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 292us (1025us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788271992.782073:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 6 00000040:00080000:3.0:1788271992.799514:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788271992.823702:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271992.823867:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577563392 00000100:00100000:0.0:1788271992.823875:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577563392 00000100:00100000:0.0:1788271992.823930:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 40 00000100:00100000:0.0:1788271992.823940:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f7552d3-578c-40be-b601-54fb5b48de11+19:15625:x1875138577563392:12345-192.168.201.3@tcp:101:lfs.0 00010000:00010000:0.0:1788271992.823964:0:17211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271992.823985:0:17211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38ff35 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd929 expref: -99 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.824083:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38ff3c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.824093:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38ff3c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.824100:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38ff3c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271992.824107:0:17211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788271992.824184:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38ff35 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd929 expref: 22 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.824197:0:17211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38ff3c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd929 expref: 21 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271992.824202:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f6e920a2500) 00010000:00010000:0.0:1788271992.824205:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788271992.824207:0:17211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c4200, rc 0) 00000100:00100000:0.0:1788271992.824321:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f7552d3-578c-40be-b601-54fb5b48de11+21:15625:x1875138577563392:12345-192.168.201.3@tcp:101:lfs.0 Request processed in 383us (626us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788271992.824326:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 40 00000100:00100000:2.0:1788271992.828775:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271992.828912:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271992.829005:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577563648 00000100:00100000:1.0:1788271992.829014:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577563648 00000100:00100000:1.0:1788271992.829078:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 0 00000100:00100000:1.0:1788271992.829088:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8f7552d3-578c-40be-b601-54fb5b48de11+21:2398:x1875138577563648:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788271992.829124:0:17197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788271992.829148:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38ff3c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd929 expref: 21 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271992.829167:0:17197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f6e920a2500) 00010000:00010000:1.0:1788271992.829171:0:17197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788271992.829227:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8f7552d3-578c-40be-b601-54fb5b48de11+20:2398:x1875138577563648:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 140us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271992.829234:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 0 00000100:00100000:3.0:1788271992.830964:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577563520 00000100:00100000:3.0:1788271992.830975:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577563520 00000100:00100000:3.0:1788271992.831026:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 41 00000100:00100000:3.0:1788271992.831035:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f7552d3-578c-40be-b601-54fb5b48de11+20:15625:x1875138577563520:12345-192.168.201.3@tcp:54:lfs.0 00010000:00010000:3.0:1788271992.831100:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ff4a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.831116:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ff4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.831127:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ff4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.831162:0:17212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ff4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.831169:0:17212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ff4a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.831175:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ff4a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.831195:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e20a00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271992.831200:0:17212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ff4a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.831208:0:17212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ff4a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.831220:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f6e920a2500) 00010000:00010000:3.0:1788271992.831222:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788271992.831226:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ff4a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271992.831233:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ff4a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271992.831320:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f7552d3-578c-40be-b601-54fb5b48de11+20:15625:x1875138577563520:12345-192.168.201.3@tcp:54:lfs.0 Request processed in 284us (2552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271992.831328:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 41 00000100:00100000:2.0:1788271992.834185:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271992.834283:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577563904 00000100:00100000:0.0:1788271992.834293:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577563904 00000100:00100000:0.0:1788271992.834346:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:0.0:1788271992.834359:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8f7552d3-578c-40be-b601-54fb5b48de11+20:15625:x1875138577563904:12345-192.168.201.3@tcp:35:lfs.0 00000100:00100000:0.0:1788271992.834582:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8f7552d3-578c-40be-b601-54fb5b48de11+21:15625:x1875138577563904:12345-192.168.201.3@tcp:35:lfs.0 Request processed in 225us (403us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788271992.834602:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 7 00000100:00100000:2.0:1788271993.106030:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271993.106128:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577564160 00000100:00100000:0.0:1788271993.106137:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577564160 00000100:00100000:0.0:1788271993.106190:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 42 00000100:00100000:0.0:1788271993.106197:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f7552d3-578c-40be-b601-54fb5b48de11+21:15656:x1875138577564160:12345-192.168.201.3@tcp:101:cat.0 00010000:00010000:0.0:1788271993.106217:0:17211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271993.106236:0:17211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38ff51 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd930 expref: -99 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.106371:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38ff58 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.106387:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38ff58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.106400:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38ff58 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271993.106411:0:17211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788271993.106534:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38ff51 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd930 expref: 24 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.106549:0:17211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38ff58 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd930 expref: 23 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.106556:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f6e920a2500) 00010000:00010000:0.0:1788271993.106558:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788271993.106561:0:17211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c4200, rc 0) 00000100:00100000:0.0:1788271993.106700:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f7552d3-578c-40be-b601-54fb5b48de11+23:15656:x1875138577564160:12345-192.168.201.3@tcp:101:cat.0 Request processed in 502us (681us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1788271993.106707:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 42 00000100:00100000:2.0:1788271993.117077:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271993.117135:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271993.117240:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577564544 00000100:00100000:1.0:1788271993.117251:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577564544 00000100:00100000:1.0:1788271993.117322:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 8 00000100:00100000:1.0:1788271993.117333:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8f7552d3-578c-40be-b601-54fb5b48de11+23:15656:x1875138577564544:12345-192.168.201.3@tcp:35:cat.0 00000100:00100000:1.0:1788271993.117684:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8f7552d3-578c-40be-b601-54fb5b48de11+24:15656:x1875138577564544:12345-192.168.201.3@tcp:35:cat.0 Request processed in 352us (547us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1788271993.117693:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 8 00000100:00100000:0.0:1788271993.118060:0:18367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577564288 00000100:00100000:0.0:1788271993.118067:0:18367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577564288 00000100:00100000:0.0:1788271993.118113:0:18367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 1 00000100:00100000:0.0:1788271993.118122:0:18367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8f7552d3-578c-40be-b601-54fb5b48de11+24:2397:x1875138577564288:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271993.118134:0:18367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271993.118163:0:18367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38ff58 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd930 expref: 24 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.118181:0:18367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f6e920a2500) 00010000:00010000:0.0:1788271993.118187:0:18367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271993.118224:0:18367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8f7552d3-578c-40be-b601-54fb5b48de11+23:2397:x1875138577564288:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 103us (1157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271993.118230:0:18367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 1 00000100:00100000:2.0:1788271993.195263:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271993.195370:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577564800 00000100:00100000:3.0:1788271993.195381:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577564800 00000100:00100000:3.0:1788271993.195446:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 43 00000100:00100000:3.0:1788271993.195457:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f7552d3-578c-40be-b601-54fb5b48de11+23:15662:x1875138577564800:12345-192.168.201.3@tcp:101:dd.0 00010000:00010000:3.0:1788271993.195480:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271993.195502:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ff66 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd937 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.195657:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ff6d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.195691:0:17212:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20400/0x99288105fd38ff0b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd914 expref: 24 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.195699:0:17212:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4400/0x99288105fd38ff20 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd91b expref: 24 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.195707:0:17212:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ff6d lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.195739:0:17212:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4400/0x99288105fd38ff20 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd91b expref: 24 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.195753:0:17212:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4400/0x99288105fd38ff20 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd91b expref: 24 pid: 17211 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271993.195767:0:17212:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17212:1875138590219776:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788271993.196558:0:17212:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20400/0x99288105fd38ff0b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd914 expref: 24 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.196572:0:17212:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20400/0x99288105fd38ff0b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd914 expref: 24 pid: 17212 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271993.196582:0:17212:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfc74a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17212:1875138590219904:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788271993.196610:0:17212:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc98dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788271993.201240:0:17212:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17212:1875138590219776:192.168.201.3@tcp:104: 00000100:00100000:2.0:1788271993.201255:0:17212:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfc74a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17212:1875138590219904:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788271993.201545:0:17212:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ff6d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271993.202497:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271993.202587:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577564928 00000100:00100000:2.0:1788271993.202595:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577564928 00010000:00010000:2.0:1788271993.202660:0:17197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4400/0x99288105fd38ff20 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd91b expref: 25 pid: 17211 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271993.202703:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 17 00000100:00100000:2.0:1788271993.202713:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc2be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8f7552d3-578c-40be-b601-54fb5b48de11+25:2398:x1875138577564928:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788271993.202742:0:17197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788271993.202749:0:17197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4400/0x99288105fd38ff20 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd91b expref: 25 pid: 17211 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.202763:0:17197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4400/0x99288105fd38ff20 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd91b expref: 25 pid: 17211 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.203003:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4400/0x99288105fd38ff20 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd91b expref: 25 pid: 17211 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.203021:0:17197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f6e920a2500) 00010000:00010000:2.0:1788271993.203025:0:17197:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ff6d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.203034:0:17197:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ff6d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.203040:0:17197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788271993.203203:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc2be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8f7552d3-578c-40be-b601-54fb5b48de11+24:2398:x1875138577564928:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 490us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271993.203211:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 17 00000100:00100000:3.0:1788271993.203675:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271993.203791:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577565056 00000100:00100000:0.0:1788271993.203808:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577565056 00010000:00010000:0.0:1788271993.203833:0:17198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20400/0x99288105fd38ff0b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd914 expref: 24 pid: 17212 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271993.203859:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 18 00000100:00100000:0.0:1788271993.203866:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8312a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8f7552d3-578c-40be-b601-54fb5b48de11+24:2398:x1875138577565056:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271993.203875:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271993.203881:0:17198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20400/0x99288105fd38ff0b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd914 expref: 24 pid: 17212 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.203904:0:17198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20400/0x99288105fd38ff0b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd914 expref: 24 pid: 17212 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.203920:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20400/0x99288105fd38ff0b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd914 expref: 24 pid: 17212 timeout: 654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.203942:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f6e920a2500) 00010000:00010000:0.0:1788271993.203946:0:17198:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ff6d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.203954:0:17198:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ff6d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.203961:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ff6d lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.203991:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271993.204026:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8312a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8f7552d3-578c-40be-b601-54fb5b48de11+23:2398:x1875138577565056:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 160us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271993.204033:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 18 00010000:00010000:3.0:1788271993.204285:0:17212:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ff6d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.204294:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ff6d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271993.204312:0:17212:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788271993.204456:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ff66 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd937 expref: 24 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.204472:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21e00/0x99288105fd38ff6d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd937 expref: 23 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.204486:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f6e920a2500) 00010000:00010000:3.0:1788271993.204489:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788271993.204492:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e21e00, rc 0) 00000100:00100000:3.0:1788271993.204531:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f7552d3-578c-40be-b601-54fb5b48de11+23:15662:x1875138577564800:12345-192.168.201.3@tcp:101:dd.0 Request processed in 9077us (9280us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1788271993.204538:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 43 00000100:00100000:0.0:1788271993.209130:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271993.209221:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577565184 00000100:00100000:2.0:1788271993.209230:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577565184 00000100:00100000:2.0:1788271993.209309:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 44 00000100:00100000:2.0:1788271993.209319:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc233800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f7552d3-578c-40be-b601-54fb5b48de11+23:15662:x1875138577565184:12345-192.168.201.3@tcp:101:dd.0 00010000:00010000:2.0:1788271993.209345:0:17211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271993.209364:0:17211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4600/0x99288105fd38ff7b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd93e expref: -99 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.209420:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5800/0x99288105fd38ff82 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.209434:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5800/0x99288105fd38ff82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.209445:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5800/0x99288105fd38ff82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.209552:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4600/0x99288105fd38ff7b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd93e expref: 25 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.209570:0:17211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5800/0x99288105fd38ff82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd93e expref: 24 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.209579:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f6e920a2500) 00010000:00010000:2.0:1788271993.209582:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788271993.209586:0:17211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d81de5800, rc 0) 00000100:00100000:2.0:1788271993.209675:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc233800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f7552d3-578c-40be-b601-54fb5b48de11+24:15662:x1875138577565184:12345-192.168.201.3@tcp:101:dd.0 Request processed in 356us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271993.209683:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 44 00000100:00100000:0.0:1788271993.217391:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271993.217567:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577565440 00000100:00100000:3.0:1788271993.217578:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577565440 00000100:00100000:3.0:1788271993.217668:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 45 00000100:00100000:3.0:1788271993.217679:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc231c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f7552d3-578c-40be-b601-54fb5b48de11+24:15662:x1875138577565440:12345-192.168.201.3@tcp:36:dd.0 00010000:00010000:3.0:1788271993.217901:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38ff89 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.217918:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38ff89 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.217930:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38ff89 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788271993.217975:0:17213:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1788271993.217997:0:17213:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064f83a64 reply state 0000000079855d3b transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38ff89 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.218010:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38ff89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.218018:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f6e920a2500) 00010000:00010000:3.0:1788271993.218021:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788271993.218038:0:17213:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788271993.218124:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc231c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f7552d3-578c-40be-b601-54fb5b48de11+27:15662:x1875138577565440:12345-192.168.201.3@tcp:36:dd.0 Request processed in 447us (745us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1788271993.218132:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 45 00000020:00080000:3.0:1788271993.218137:0:17213:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788271993.221104:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271993.221291:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577565568 00000100:00100000:2.0:1788271993.221302:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577565568 00000100:00100000:2.0:1788271993.221368:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 46 00000100:00100000:2.0:1788271993.221379:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f7552d3-578c-40be-b601-54fb5b48de11+27:15662:x1875138577565568:12345-192.168.201.3@tcp:101:dd.0 00010000:00010000:2.0:1788271993.221401:0:17211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788271993.221420:0:17211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4600/0x99288105fd38ff90 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd945 expref: -99 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.221492:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4600/0x99288105fd38ff90 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd945 expref: 28 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.221506:0:17211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4600/0x99288105fd38ff90 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd945 expref: 28 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.221702:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f6e920a2500) 00010000:00010000:2.0:1788271993.221706:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788271993.221709:0:17211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d81de4600, rc 0) 00000100:00100000:2.0:1788271993.221759:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f7552d3-578c-40be-b601-54fb5b48de11+28:15662:x1875138577565568:12345-192.168.201.3@tcp:101:dd.0 Request processed in 381us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271993.221766:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 46 00000100:00100000:0.0:1788271993.244984:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271993.245022:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271993.245113:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577565824 00000100:00100000:3.0:1788271993.245131:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577565824 00000100:00100000:3.0:1788271993.245191:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 50 00000100:00100000:3.0:1788271993.245201:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc232a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f7552d3-578c-40be-b601-54fb5b48de11+5:2397:x1875138577565824:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271993.245284:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc232a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f7552d3-578c-40be-b601-54fb5b48de11+5:2397:x1875138577565824:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 84us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271993.245292:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 50 00000040:00080000:3.0:1788271993.247036:0:17972:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788271993.247755:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271993.247797:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271993.248078:0:20353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577566336 00000100:00100000:3.0:1788271993.248086:0:20353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577566336 00000100:00100000:3.0:1788271993.248211:0:20353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 51 00000100:00100000:3.0:1788271993.248221:0:20353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc233480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a6e7813-b915-4224-95b8-fa91b7ad9b79+5:2397:x1875138577566336:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271993.248310:0:20353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc233480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8a6e7813-b915-4224-95b8-fa91b7ad9b79+5:2397:x1875138577566336:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 90us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271993.248318:0:20353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 51 00000100:00100000:1.0:1788271993.249364:0:19862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577566080 00000100:00100000:1.0:1788271993.249373:0:19862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577566080 00000100:00100000:1.0:1788271993.249425:0:19862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577566592 00000100:00100000:1.0:1788271993.249429:0:19862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577566592 00000100:00100000:1.0:1788271993.249450:0:19862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 14 00000100:00100000:1.0:1788271993.249458:0:19862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc232680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8f7552d3-578c-40be-b601-54fb5b48de11+5:2397:x1875138577566080:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271993.249500:0:19862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc232680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8f7552d3-578c-40be-b601-54fb5b48de11+5:2397:x1875138577566080:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 42us (4477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271993.249507:0:19862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 14 00000100:00100000:1.0:1788271993.249522:0:19862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 15 00000100:00100000:1.0:1788271993.249528:0:19862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc231f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8a6e7813-b915-4224-95b8-fa91b7ad9b79+5:2397:x1875138577566592:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271993.249550:0:19862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc231f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8a6e7813-b915-4224-95b8-fa91b7ad9b79+5:2397:x1875138577566592:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 23us (1754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271993.249556:0:19862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 15 00000100:00080000:0.0:1788271993.249640:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788271993.251884:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271993.251939:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271993.251974:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271993.252000:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271993.252022:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271993.252050:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577566848 00000100:00100000:0.0:1788271993.252058:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577566848 00000100:00100000:0.0:1788271993.252113:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 2 00000100:00100000:0.0:1788271993.252124:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc233100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8f7552d3-578c-40be-b601-54fb5b48de11+28:15662:x1875138577566848:12345-192.168.201.3@tcp:103:dd.0 00010000:00010000:0.0:1788271993.252138:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271993.252163:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4600/0x99288105fd38ff90 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd945 expref: 28 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.252182:0:17196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f6e920a2500) 00010000:00010000:0.0:1788271993.252187:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271993.252229:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc233100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8f7552d3-578c-40be-b601-54fb5b48de11+27:15662:x1875138577566848:12345-192.168.201.3@tcp:103:dd.0 Request processed in 107us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271993.252236:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 2 00000100:00100000:1.0:1788271993.252508:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577565696 00000100:00100000:1.0:1788271993.252521:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577565696 00000100:00100000:1.0:1788271993.252550:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 164 00000100:00100000:1.0:1788271993.252557:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e851a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1104fde8-2866-41ec-bd9b-e310797010eb+13:2397:x1875138577565696:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271993.252591:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e851a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1104fde8-2866-41ec-bd9b-e310797010eb+13:2397:x1875138577565696:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 34us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271993.252596:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 164 00000100:00100000:1.0:1788271993.252648:0:19862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577565952 00000100:00100000:1.0:1788271993.252652:0:19862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577565952 00000100:00100000:1.0:1788271993.252683:0:19862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577566464 00000100:00100000:1.0:1788271993.252685:0:19862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577566464 00000100:00100000:1.0:1788271993.252702:0:19862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 16 00000100:00100000:1.0:1788271993.252718:0:19862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8f7552d3-578c-40be-b601-54fb5b48de11+5:2397:x1875138577565952:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271993.252744:0:19862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc233b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8f7552d3-578c-40be-b601-54fb5b48de11+5:2397:x1875138577565952:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 29us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271993.252750:0:19862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 16 00000100:00100000:1.0:1788271993.252762:0:19862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 17 00000100:00100000:1.0:1788271993.252768:0:19862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc230380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8a6e7813-b915-4224-95b8-fa91b7ad9b79+5:2397:x1875138577566464:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:1.0:1788271993.252790:0:19862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc230380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8a6e7813-b915-4224-95b8-fa91b7ad9b79+5:2397:x1875138577566464:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 22us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271993.252796:0:19862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 17 00000100:00080000:1.0:1788271993.252821:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788271993.254312:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577566208 00000100:00100000:3.0:1788271993.254324:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577566208 00000100:00100000:3.0:1788271993.254378:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 52 00000100:00100000:3.0:1788271993.254387:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc231500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a6e7813-b915-4224-95b8-fa91b7ad9b79+12:2397:x1875138577566208:12345-192.168.201.3@tcp:400:kworker.0 00000100:00100000:3.0:1788271993.254447:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc231500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8a6e7813-b915-4224-95b8-fa91b7ad9b79+12:2397:x1875138577566208:12345-192.168.201.3@tcp:400:kworker.0 Request processed in 61us (2471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271993.254470:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 52 00000100:00100000:0.0:1788271993.273353:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271993.273441:0:20353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577566976 00000100:00100000:3.0:1788271993.273451:0:20353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577566976 00000100:00100000:3.0:1788271993.273515:0:20353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 47 00000100:00100000:3.0:1788271993.273526:0:20353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc231880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f7552d3-578c-40be-b601-54fb5b48de11+27:15662:x1875138577566976:12345-192.168.201.3@tcp:58:dd.0 00010000:00010000:3.0:1788271993.273671:0:20353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ff97 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.273689:0:20353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ff97 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.273700:0:20353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ff97 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788271993.275095:0:20353:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788271993.275530:0:20353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788271993.275690:0:20353:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788271993.275783:0:20353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc231880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f7552d3-578c-40be-b601-54fb5b48de11+27:15662:x1875138577566976:12345-192.168.201.3@tcp:58:dd.0 Request processed in 2255us (2437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271993.275793:0:20353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 47 00000100:00100000:1.0:1788271993.279095:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271993.279190:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577567104 00000100:00100000:3.0:1788271993.279198:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577567104 00000100:00100000:3.0:1788271993.279308:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 48 00000100:00100000:3.0:1788271993.279318:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc2bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f7552d3-578c-40be-b601-54fb5b48de11+27:15662:x1875138577567104:12345-192.168.201.3@tcp:101:dd.0 00010000:00010000:3.0:1788271993.279336:0:17213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271993.279353:0:17213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21800/0x99288105fd38ff9e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd94c expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.279397:0:17213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ff97 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.279405:0:17213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21800/0x99288105fd38ff9e lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd94c expref: 28 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.279434:0:17213:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ff97 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.279444:0:17213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21800/0x99288105fd38ff9e lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd94c expref: 28 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.279454:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f6e920a2500) 00010000:00010000:3.0:1788271993.279456:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788271993.279459:0:17213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21800/0x99288105fd38ff9e lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd94c expref: 28 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.279464:0:17213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e21800, rc 0) 00000100:00100000:3.0:1788271993.279517:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc2bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f7552d3-578c-40be-b601-54fb5b48de11+28:15662:x1875138577567104:12345-192.168.201.3@tcp:101:dd.0 Request processed in 200us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271993.279524:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 48 00010000:00010000:0.0:1788271993.439214:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788271993.823048:0:17247:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788271993.823058:0:17247:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788271993.823109:0:17247:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788271993.823119:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788271993.823269:0:17247:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17247:1875138590220032:192.168.201.3@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788271993.823374:0:17247:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc98dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788271993.835352:0:17247:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17247:1875138590220032:192.168.201.3@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788271993.837075:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271993.837182:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577567232 00000100:00100000:2.0:1788271993.837193:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577567232 00000100:00100000:2.0:1788271993.837278:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 49 00000100:00100000:2.0:1788271993.837289:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc2bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f7552d3-578c-40be-b601-54fb5b48de11+28:15663:x1875138577567232:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788271993.837330:0:17211:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788271993.837480:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc2bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f7552d3-578c-40be-b601-54fb5b48de11+28:15663:x1875138577567232:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 Request processed in 192us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271993.837488:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 49 00000100:00100000:1.0:1788271993.841752:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271993.841915:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577567360 00000100:00100000:0.0:1788271993.841926:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577567360 00000100:00100000:0.0:1788271993.841998:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 50 00000100:00100000:0.0:1788271993.842009:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc2bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f7552d3-578c-40be-b601-54fb5b48de11+28:15663:x1875138577567360:12345-192.168.201.3@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788271993.842107:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38ffa5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.842124:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38ffa5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.842146:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38ffa5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.842200:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38ffac lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.842209:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38ffac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.842217:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38ffac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.842259:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38ffb3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.842272:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38ffb3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.842278:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38ffb3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271993.842343:0:17212:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788271993.842348:0:17212:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788271993.842363:0:17212:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38ffb3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.842375:0:17212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38ffa5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.842383:0:17212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38ffa5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.842413:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38ffa5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.842420:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4c00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271993.842425:0:17212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38ffa5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.842433:0:17212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38ffa5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.842447:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f6d8305a200) 00010000:00010000:0.0:1788271993.842450:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271993.842455:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38ffa5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.842463:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd38ffa5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.842480:0:17212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38ffac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.842486:0:17212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38ffac lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.842491:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38ffac lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.842496:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4400 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271993.842499:0:17212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38ffac lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.843923:0:17212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38ffac lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.843936:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8f6d8305ad00) 00010000:00010000:0.0:1788271993.843939:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271993.843943:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38ffac lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.844050:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38ffac lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.844075:0:17212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38ffb3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.844080:0:17212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38ffb3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.844086:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38ffb3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.844090:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4200 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271993.844093:0:17212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38ffb3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.844100:0:17212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38ffb3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.844107:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f6e920a2500) 00010000:00010000:0.0:1788271993.844110:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788271993.844113:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38ffb3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.844128:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38ffb3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271993.844305:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc2bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f7552d3-578c-40be-b601-54fb5b48de11+28:15663:x1875138577567360:12345-192.168.201.3@tcp:34:lhsmtool_posix.0 Request processed in 2293us (2557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271993.844316:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 50 00000100:00100000:0.0:1788271993.856396:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271993.857297:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577567616 00000100:00100000:3.0:1788271993.857310:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577567616 00000100:00100000:3.0:1788271993.857369:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 51 00000100:00100000:3.0:1788271993.857392:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc230700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f7552d3-578c-40be-b601-54fb5b48de11+28:15663:x1875138577567616:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788271993.857428:0:17211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271993.857451:0:17211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21400/0x99288105fd38ffba lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd953 expref: -99 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.857574:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20800/0x99288105fd38ffc1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.857592:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20800/0x99288105fd38ffc1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.857603:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20800/0x99288105fd38ffc1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788271993.857614:0:17211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788271993.858198:0:17211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20800/0x99288105fd38ffc1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271993.858208:0:17211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20800/0x99288105fd38ffc1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271993.858214:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20800/0x99288105fd38ffc1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271993.858221:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e20800 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:1.0:1788271993.858226:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20800/0x99288105fd38ffc1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271993.858234:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20800/0x99288105fd38ffc1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271993.858438:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f6e920a2500) 00010000:00010000:1.0:1788271993.858443:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788271993.858448:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20800/0x99288105fd38ffc1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271993.858455:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20800/0x99288105fd38ffc1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271993.858516:0:17211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21400/0x99288105fd38ffba lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd953 expref: 30 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271993.858527:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f6d8305a200) 00010000:00010000:1.0:1788271993.858530:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788271993.858534:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21400/0x99288105fd38ffba lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd953 expref: 30 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271993.858545:0:17211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e21400, rc 0) 00000100:00100000:1.0:1788271993.858615:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc230700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f7552d3-578c-40be-b601-54fb5b48de11+29:15663:x1875138577567616:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 1236us (2238us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1788271993.858995:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 51 00000100:00100000:1.0:1788271993.870927:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271993.871102:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577567744 00000100:00100000:3.0:1788271993.871112:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577567744 00000100:00100000:3.0:1788271993.871173:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 52 00000100:00100000:3.0:1788271993.871184:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc2be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f7552d3-578c-40be-b601-54fb5b48de11+29:15663:x1875138577567744:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788271993.871218:0:17213:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788271993.871451:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc2be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f7552d3-578c-40be-b601-54fb5b48de11+29:15663:x1875138577567744:12345-192.168.201.3@tcp:53:lhsmtool_posix.0 Request processed in 202us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271993.871461:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 52 00000100:00100000:3.0:1788271993.880212:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271993.887097:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590220160:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788271993.887175:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271993.887313:0:18723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590220160 00000100:00100000:3.0:1788271993.887322:0:18723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590220160 00000100:00100000:3.0:1788271993.887411:0:18723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788271993.887426:0:18723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc230a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590220160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788271993.887459:0:18723:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788271993.887466:0:20353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577568000 00000100:00100000:1.0:1788271993.887470:0:20353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577568000 00000100:00100000:1.0:1788271993.887531:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 53 00000100:00100000:1.0:1788271993.887539:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f7552d3-578c-40be-b601-54fb5b48de11+29:15663:x1875138577568000:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788271993.887552:0:17211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788271993.887572:0:17211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81729400/0x99288105fd38ffcf lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd95a expref: -99 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271993.887647:0:18723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc230a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3606:x1875138590220160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 222us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271993.887656:0:18723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788271993.887916:0:3609:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788271993.887928:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfc74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590220416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788271993.888031:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271993.888062:0:18724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590220416 00000100:00100000:2.0:1788271993.888066:0:18724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590220416 00000100:00100000:2.0:1788271993.888095:0:18724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788271993.888102:0:18724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590220416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788271993.888113:0:18724:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788271993.888143:0:18724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3609:x1875138590220416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271993.888149:0:18724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788271993.888187:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfc74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3609:1875138590220416:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788271993.888271:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788271993.888284:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d82ecfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590220288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788271993.888314:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788271993.888404:0:17211:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =27 00000004:00080000:1.0:1788271993.888413:0:17211:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+27 in llog 00000004:00080000:1.0:1788271993.888433:0:17211:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00000100:00100000:2.0:1788271993.888472:0:18724:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590220288 00000100:00100000:2.0:1788271993.888477:0:18724:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590220288 00010000:00010000:1.0:1788271993.888573:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81729600/0x99288105fd38ffd6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271993.888587:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81729600/0x99288105fd38ffd6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271993.888597:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81729600/0x99288105fd38ffd6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271993.888666:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81729400/0x99288105fd38ffcf lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd95a expref: 32 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788271993.888671:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788271993.888682:0:17211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81729600/0x99288105fd38ffd6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd95a expref: 31 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271993.888685:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875138590220800:0@lo:400:kworker.0 00010000:00010000:1.0:1788271993.888693:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f6e8718e300) 00010000:00010000:1.0:1788271993.888696:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788271993.888699:0:17211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d81729600, rc 0) 00000100:00100000:1.0:1788271993.888736:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f7552d3-578c-40be-b601-54fb5b48de11+31:15663:x1875138577568000:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 1199us (8536us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1788271993.888741:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 53 00000100:00100000:3.0:1788271993.888761:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590220928:0@lo:400:kworker.0 00000100:00100000:2.0:1788271993.890904:0:18724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788271993.890949:0:18724:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebc230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590220288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788271993.890992:0:18724:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788271993.891375:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271993.891431:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3607:1875138590221312:0@lo:400:kworker.0 00000100:00100000:0.0:1788271993.891478:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271993.891506:0:3607:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788271993.891513:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590220672:0@lo:400:kworker.0 00000100:00100000:0.0:1788271993.891539:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271993.891565:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875138590221184:0@lo:400:kworker.0 00000100:00100000:0.0:1788271993.891586:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271993.891603:0:3607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3607:1875138590221696:0@lo:400:kworker.0 00000100:00100000:0.0:1788271993.891640:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271993.891686:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590220672 00000100:00100000:0.0:1788271993.891693:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590220672 00000100:00100000:0.0:1788271993.891736:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788271993.891744:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590220672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271993.891800:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590220672:12345-0@lo:400:kworker.0 Request processed in 56us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271993.891807:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788271993.891829:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590220800 00000100:00100000:0.0:1788271993.891833:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590220800 00000100:00100000:0.0:1788271993.891851:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590221312 00000100:00100000:0.0:1788271993.891854:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590221312 00000100:00100000:0.0:1788271993.891874:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590221184 00000100:00100000:0.0:1788271993.891877:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590221184 00000100:00100000:0.0:1788271993.891887:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590221696 00000100:00100000:0.0:1788271993.891889:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590221696 00000100:00100000:0.0:1788271993.891905:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788271993.891911:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875138590220800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271993.891943:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3607:x1875138590220800:12345-0@lo:400:kworker.0 Request processed in 32us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271993.891949:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788271993.891962:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788271993.891968:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875138590221312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271993.891993:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3607:x1875138590221312:12345-0@lo:400:kworker.0 Request processed in 25us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271993.891999:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788271993.892012:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788271993.892018:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875138590221184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271993.892787:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3607:x1875138590221184:12345-0@lo:400:kworker.0 Request processed in 768us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271993.892804:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788271993.892821:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788271993.892828:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875138590221696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271993.893071:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3607:x1875138590221696:12345-0@lo:400:kworker.0 Request processed in 243us (1430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271993.893078:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1788271993.893104:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788271993.893109:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788271993.893124:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83390700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3609:1875138590220544:0@lo:400:kworker.0 00000100:00100000:0.0:1788271993.893161:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271993.893195:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590221056:0@lo:400:kworker.0 00000100:00100000:0.0:1788271993.893220:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271993.893241:0:3609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3609:1875138590221568:0@lo:400:kworker.0 00000100:00100000:0.0:1788271993.893274:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271993.893305:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590220544 00000100:00100000:0.0:1788271993.893310:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590220544 00000100:00100000:0.0:1788271993.893339:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788271993.893345:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e851a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+24:3609:x1875138590220544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788271993.893377:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e851a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08d4e6e3-b587-4543-a287-4a9ae9a31c24+24:3609:x1875138590220544:12345-0@lo:400:kworker.0 Request processed in 32us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271993.893513:0:20353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590221568 00000100:00100000:1.0:1788271993.893518:0:20353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590221568 00000100:00100000:1.0:1788271993.893550:0:20353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788271993.893557:0:20353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875138590221568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271993.893595:0:20353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3609:x1875138590221568:12345-0@lo:400:kworker.0 Request processed in 39us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271993.893600:0:20353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788271993.893650:0:19409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590221056 00000100:00100000:1.0:1788271993.893653:0:19409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590221056 00000100:00100000:1.0:1788271993.893672:0:19409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788271993.893676:0:19409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590221056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788271993.893696:0:19409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3609:x1875138590221056:12345-0@lo:400:kworker.0 Request processed in 20us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271993.893700:0:19409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788271993.893740:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3606:1875138590220160:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788271993.893763:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590220672:0@lo:400:kworker.0 00000100:00100000:1.0:1788271993.893769:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3607:1875138590221184:0@lo:400:kworker.0 00010000:00080000:1.0:1788271993.893778:0:3607:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d81f6ed80 x1875138590221696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788272009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788271993.893785:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3607:1875138590221696:0@lo:400:kworker.0 00000100:00100000:1.0:1788271993.893791:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3607:1875138590220800:0@lo:400:kworker.0 00000100:00100000:1.0:1788271993.893797:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3607:1875138590221312:0@lo:400:kworker.0 00000100:00100000:1.0:1788271993.893832:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83390700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08d4e6e3-b587-4543-a287-4a9ae9a31c24:3609:1875138590220544:0@lo:400:kworker.0 00000100:00100000:1.0:1788271993.893837:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3609:1875138590221056:0@lo:400:kworker.0 00000100:00100000:1.0:1788271993.893846:0:3609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3609:1875138590221568:0@lo:400:kworker.0 00000100:00080000:1.0:1788271993.893859:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788271993.893866:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788271993.894049:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271993.894374:0:3608:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3608:1875138590221440:0@lo:400:kworker.0 00000100:00100000:3.0:1788271993.894399:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788271993.894425:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590220928 00000100:00100000:3.0:1788271993.894428:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590220928 00000100:00100000:3.0:1788271993.894449:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788271993.894453:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590220928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271993.894479:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3608:x1875138590220928:12345-0@lo:400:kworker.0 Request processed in 26us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271993.894483:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788271993.894500:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3608:1875138590220928:0@lo:400:kworker.0 00000100:00100000:3.0:1788271993.894510:0:20353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590221440 00000100:00100000:3.0:1788271993.894512:0:20353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590221440 00000100:00080000:3.0:1788271993.894524:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788271993.894545:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788271993.894552:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d8313d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875138590221440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788271993.894584:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d8313d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3608:x1875138590221440:12345-0@lo:400:kworker.0 Request processed in 33us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271993.894590:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1788271993.894607:0:3608:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f6d81f6e300 x1875138590221440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788272009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788271993.894614:0:3608:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3608:1875138590221440:0@lo:400:kworker.0 00000100:00100000:0.0:1788271993.894712:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788271993.894736:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271993.894857:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577568256 00000100:00100000:3.0:1788271993.894860:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577568256 00000100:00100000:3.0:1788271993.894880:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 54 00000100:00100000:3.0:1788271993.894884:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83390700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f7552d3-578c-40be-b601-54fb5b48de11+31:15663:x1875138577568256:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788271993.894920:0:17212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271993.894941:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81729600/0x99288105fd38ffd6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd95a expref: 31 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.894963:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f6e8718e300) 00010000:00010000:3.0:1788271993.894970:0:17212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788271993.894988:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20c00/0x99288105fd38ffe4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.894999:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20c00/0x99288105fd38ffe4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.895005:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20c00/0x99288105fd38ffe4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.895015:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21a00/0x99288105fd38ffeb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xcefae24b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.895019:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21a00/0x99288105fd38ffeb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcefae24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.895023:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21a00/0x99288105fd38ffeb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcefae24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.895061:0:17212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20c00/0x99288105fd38ffe4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.895205:0:17212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20c00/0x99288105fd38ffe4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.895210:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20c00/0x99288105fd38ffe4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.895214:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e20c00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271993.895217:0:17212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20c00/0x99288105fd38ffe4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.895223:0:17212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20c00/0x99288105fd38ffe4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.895232:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f6d8305a700) 00010000:00010000:3.0:1788271993.895235:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271993.895238:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20c00/0x99288105fd38ffe4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.895243:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20c00/0x99288105fd38ffe4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.895262:0:17212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21a00/0x99288105fd38ffeb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcefae24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.895268:0:17212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21a00/0x99288105fd38ffeb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcefae24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.895273:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21a00/0x99288105fd38ffeb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcefae24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.895279:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e21a00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:3.0:1788271993.895288:0:17212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21a00/0x99288105fd38ffeb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcefae24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.895293:0:17212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21a00/0x99288105fd38ffeb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xcefae24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.895299:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xcefae24b (ffff8f6e920a2400) 00010000:00010000:3.0:1788271993.895301:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788271993.895303:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21a00/0x99288105fd38ffeb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xcefae24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.895307:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21a00/0x99288105fd38ffeb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xcefae24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271993.895602:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83390700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f7552d3-578c-40be-b601-54fb5b48de11+30:15663:x1875138577568256:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 Request processed in 714us (865us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788271993.895607:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 54 00000100:00100000:1.0:1788271993.897853:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271993.897944:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577568384 00000100:00100000:0.0:1788271993.897958:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577568384 00000100:00100000:0.0:1788271993.898005:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 55 00000100:00100000:0.0:1788271993.898012:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6eb3d2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f7552d3-578c-40be-b601-54fb5b48de11+30:15663:x1875138577568384:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788271993.898041:0:17213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271993.898126:0:17213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38fff2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd961 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.898158:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38fff9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.898168:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38fff9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.898176:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38fff9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.898479:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd38fff2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd961 expref: 32 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.898493:0:17213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4400/0x99288105fd38fff9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd961 expref: 31 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.898499:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f6d8305ad00) 00010000:00010000:0.0:1788271993.898501:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788271993.898687:0:17213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c4400, rc 0) 00000100:00100000:0.0:1788271993.898763:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6eb3d2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f7552d3-578c-40be-b601-54fb5b48de11+31:15663:x1875138577568384:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 750us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271993.898769:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 55 00000100:00100000:2.0:1788271993.900983:0:18724:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebc230e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3607:x1875138590220288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10039us (12661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271993.900994:0:18724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788271993.901214:0:3607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d82ecfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3607:1875138590220288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788271993.909567:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271993.909659:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577568640 00000100:00100000:0.0:1788271993.909668:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577568640 00000100:00100000:0.0:1788271993.909716:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 56 00000100:00100000:0.0:1788271993.909723:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d82ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f7552d3-578c-40be-b601-54fb5b48de11+31:15663:x1875138577568640:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788271993.909811:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd390000 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.909823:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd390000 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.909831:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd390000 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788271993.909967:0:17211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1788271993.909974:0:17211:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 554999354257ns, next at 555999352431ns, rc = 0 00000004:00010000:0.0:1788271993.910010:0:17211:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dd7aca45 reply state 000000005386b671 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd390000 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.910019:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd390000 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.910024:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f6d8305ad00) 00010000:00010000:0.0:1788271993.910026:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788271993.910028:0:17211:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788271993.910097:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d82ecfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f7552d3-578c-40be-b601-54fb5b48de11+33:15663:x1875138577568640:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 Request processed in 374us (541us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1788271993.910102:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 56 00000100:00100000:1.0:1788271993.914869:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271993.915210:0:20353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577568768 00000100:00100000:3.0:1788271993.915220:0:20353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577568768 00000100:00100000:3.0:1788271993.915309:0:20353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 57 00000100:00100000:3.0:1788271993.915319:0:20353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d831f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f7552d3-578c-40be-b601-54fb5b48de11+33:15663:x1875138577568768:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788271993.915343:0:20353:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271993.915363:0:20353:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21a00/0x99288105fd390007 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd968 expref: -99 pid: 20353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.915607:0:20353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21a00/0x99288105fd390007 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd968 expref: 34 pid: 20353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.915658:0:20353:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21a00/0x99288105fd390007 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd968 expref: 34 pid: 20353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.915888:0:20353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f6d8305ad00) 00010000:00010000:3.0:1788271993.915892:0:20353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788271993.915897:0:20353:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e21a00, rc 0) 00000100:00100000:2.0:1788271993.916001:0:20353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d831f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f7552d3-578c-40be-b601-54fb5b48de11+34:15663:x1875138577568768:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 683us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788271993.916008:0:20353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 57 00000100:00100000:1.0:1788271993.919709:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:2.0:1788271993.919839:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577568896 00000100:00100000:2.0:1788271993.919848:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577568896 00000100:00100000:2.0:1788271993.919897:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 20 00000100:00100000:2.0:1788271993.919904:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d831f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8f7552d3-578c-40be-b601-54fb5b48de11+5:2397:x1875138577568896:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788271993.920150:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d831f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8f7552d3-578c-40be-b601-54fb5b48de11+6:2397:x1875138577568896:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 Request processed in 245us (447us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788271993.920155:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 20 00000100:00100000:1.0:1788271993.926431:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271993.926528:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577569152 00000100:00100000:0.0:1788271993.926540:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577569152 00000100:00100000:0.0:1788271993.926605:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 9 00000100:00100000:0.0:1788271993.926616:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d831f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8f7552d3-578c-40be-b601-54fb5b48de11+34:15663:x1875138577569152:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788271993.926827:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d831f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8f7552d3-578c-40be-b601-54fb5b48de11+35:15663:x1875138577569152:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 Request processed in 214us (407us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1788271993.926849:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 9 00000100:00100000:0.0:1788271993.933659:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271993.933747:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577569408 00000100:00100000:3.0:1788271993.933758:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577569408 00000100:00100000:0.0:1788271993.933989:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 58 00000100:00100000:0.0:1788271993.934001:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f7552d3-578c-40be-b601-54fb5b48de11+35:15663:x1875138577569408:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788271993.934126:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f7552d3-578c-40be-b601-54fb5b48de11+35:15663:x1875138577569408:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 Request processed in 126us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271993.934134:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 58 00000100:00100000:1.0:1788271993.938688:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271993.938839:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577569536 00000100:00100000:0.0:1788271993.938850:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577569536 00000100:00100000:0.0:1788271993.938911:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 59 00000100:00100000:0.0:1788271993.938931:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d831f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f7552d3-578c-40be-b601-54fb5b48de11+35:15663:x1875138577569536:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788271993.938952:0:17213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271993.938974:0:17213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd39000e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd96f expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.939046:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd390015 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.939060:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd390015 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.939071:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd390015 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788271993.939114:0:17213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788271993.939133:0:17213:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd390015 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.939180:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd39000e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd96f expref: 37 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.939198:0:17213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd390015 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd96f expref: 36 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.939207:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f6d8305ad00) 00010000:00010000:0.0:1788271993.939209:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788271993.939212:0:17213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6e8511d800, rc 0) 00000100:00100000:0.0:1788271993.939383:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d831f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f7552d3-578c-40be-b601-54fb5b48de11+36:15663:x1875138577569536:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 463us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271993.939390:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 59 00000100:00100000:1.0:1788271993.945803:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271993.945894:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577569664 00000100:00100000:3.0:1788271993.945904:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577569664 00000100:00100000:3.0:1788271993.945958:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 21 00000100:00100000:3.0:1788271993.945967:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d831f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8f7552d3-578c-40be-b601-54fb5b48de11+6:2397:x1875138577569664:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788271993.945984:0:18721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788271993.946003:0:18721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067bf92a6/0x99288105fd39001c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd976 expref: -99 pid: 18721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788271993.946027:0:18721:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a96dd79, blocks: 0x0 00010000:00010000:3.0:1788271993.946044:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=555s v=(0 0) 00010000:00010000:3.0:1788271993.946049:0:18721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271993.946057:0:18721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067bf92a6/0x99288105fd39001c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd976 expref: 7 pid: 18721 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.946074:0:18721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000067bf92a6/0x99288105fd39001c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd976 expref: 7 pid: 18721 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.946087:0:18721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6eb4e20c00, rc 0) 00000100:00100000:3.0:1788271993.946141:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d831f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8f7552d3-578c-40be-b601-54fb5b48de11+7:2397:x1875138577569664:12345-192.168.201.3@tcp:101:lhsmtool_posix.0 Request processed in 174us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271993.946160:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 21 00000100:00100000:1.0:1788271993.951859:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271993.951932:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577569920 00000100:00100000:0.0:1788271993.951944:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577569920 00000100:00100000:0.0:1788271993.952009:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 60 00000100:00100000:0.0:1788271993.952019:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d831f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f7552d3-578c-40be-b601-54fb5b48de11+36:15663:x1875138577569920:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788271993.952135:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d831f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f7552d3-578c-40be-b601-54fb5b48de11+36:15663:x1875138577569920:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 Request processed in 116us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271993.952143:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 60 00000100:00100000:0.0:1788271993.959867:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271993.959948:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577570048 00000100:00100000:3.0:1788271993.959957:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577570048 00000100:00100000:3.0:1788271993.960014:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 61 00000100:00100000:3.0:1788271993.960024:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f7552d3-578c-40be-b601-54fb5b48de11+36:15663:x1875138577570048:12345-192.168.201.3@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788271993.966014:0:17191:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1788271993.966031:0:17191:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1788271993.966087:0:17191:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:0.0:1788271993.966197:0:3593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20e00/0x99288105fd38fea9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.966211:0:3593:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20e00/0x99288105fd38fea9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.966219:0:3593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20e00/0x99288105fd38fea9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.966239:0:3593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e20e00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:0.0:1788271993.966244:0:3593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20e00/0x99288105fd38fea9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.966260:0:3593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20e00/0x99288105fd38fea9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.966286:0:3593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f6d8305a700) 00010000:00010000:0.0:1788271993.966290:0:3593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788271993.966295:0:3593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20e00/0x99288105fd38fea9 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271993.966300:0:3593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20e00/0x99288105fd38fea9 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271993.966736:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f7552d3-578c-40be-b601-54fb5b48de11+19:15663:x1875138577570048:12345-192.168.201.3@tcp:44:lhsmtool_posix.0 Request processed in 6707us (6872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271993.966746:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 61 00000100:00100000:0.0:1788271993.966959:0:3606:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788271993.966978:0:3606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d8313c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590221824:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788271993.967034:0:3606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788271993.967077:0:19862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590221824 00000100:00100000:0.0:1788271993.967084:0:19862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590221824 00000100:00100000:0.0:1788271993.967125:0:19862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788271993.967133:0:19862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3606:x1875138590221824:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788271993.967259:0:19862:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788271993.967263:0:19862:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788271993.967272:0:19862:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788271993.967275:0:19862:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788271993 -> 1788271993 00002000:00010000:0.0:1788271993.967277:0:19862:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788271993.967311:0:19862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3606:x1875138590221824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 178us (277us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788271993.967326:0:19862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:0.0:1788271993.967367:0:3606:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f6d8313c000/2, rc 0, transno 8589934596 00000100:00100000:0.0:1788271993.967375:0:3606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d8313c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3606:1875138590221824:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1788271993.973745:0:3592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5c00/0x99288105fd38fe55 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.973764:0:3592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5c00/0x99288105fd38fe55 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.973772:0:3592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5c00/0x99288105fd38fe55 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.973778:0:3592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c5c00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271993.973783:0:3592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5c00/0x99288105fd38fe55 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.973790:0:3592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5c00/0x99288105fd38fe55 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.973809:0:3592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f6d8305a400) 00010000:00010000:2.0:1788271993.973812:0:3592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271993.973818:0:3592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5c00/0x99288105fd38fe55 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.973824:0:3592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5c00/0x99288105fd38fe55 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.973849:0:3592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38fe5c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.973855:0:3592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38fe5c lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.973877:0:3592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38fe5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.973881:0:3592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4000 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271993.973884:0:3592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38fe5c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.973890:0:3592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38fe5c lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.973898:0:3592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f6d8305a700) 00010000:00010000:2.0:1788271993.973900:0:3592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271993.973903:0:3592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38fe5c lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.973909:0:3592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd38fe5c lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.973934:0:3592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20600/0x99288105fd38ff04 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.973941:0:3592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20600/0x99288105fd38ff04 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.973947:0:3592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20600/0x99288105fd38ff04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.973952:0:3592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e20600 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271993.973954:0:3592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20600/0x99288105fd38ff04 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.973971:0:3592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20600/0x99288105fd38ff04 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.973979:0:3592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8f6e920a2b00) 00010000:00010000:2.0:1788271993.973981:0:3592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271993.973984:0:3592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20600/0x99288105fd38ff04 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.973990:0:3592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20600/0x99288105fd38ff04 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.974005:0:3592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38ff89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.974011:0:3592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38ff89 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.974016:0:3592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38ff89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.974021:0:3592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e21000 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271993.974024:0:3592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38ff89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.974029:0:3592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38ff89 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.974037:0:3592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f6e920a2500) 00010000:00010000:2.0:1788271993.974039:0:3592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271993.974042:0:3592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38ff89 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.974052:0:3592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21000/0x99288105fd38ff89 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.974063:0:3592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd390000 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.974068:0:3592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd390000 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.974074:0:3592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd390000 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.974079:0:3592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4c00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271993.974082:0:3592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd390000 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.974088:0:3592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd390000 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.974097:0:3592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f6d8305ad00) 00010000:00010000:2.0:1788271993.974099:0:3592:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788271993.974102:0:3592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd390000 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271993.974107:0:3592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4c00/0x99288105fd390000 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271993.977401:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271993.978587:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577570176 00000100:00100000:1.0:1788271993.978600:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577570176 00000100:00100000:1.0:1788271993.978738:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 23 00000100:00100000:1.0:1788271993.978750:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8f7552d3-578c-40be-b601-54fb5b48de11+7:2398:x1875138577570176:12345-192.168.201.3@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788271993.978866:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8f7552d3-578c-40be-b601-54fb5b48de11+7:2398:x1875138577570176:12345-192.168.201.3@tcp:16:lhsmtool_posix.0 Request processed in 118us (1478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788271993.978873:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 23 00000100:00100000:0.0:1788271993.989665:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271993.989730:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577570432 00000100:00100000:3.0:1788271993.989739:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577570432 00000100:00100000:3.0:1788271993.989788:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 62 00000100:00100000:3.0:1788271993.989797:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f7552d3-578c-40be-b601-54fb5b48de11+15:15663:x1875138577570432:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788271993.989854:0:17212:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271993.989880:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511d800/0x99288105fd390015 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd96f expref: 15 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.989896:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f6d8305ad00) 00010000:00010000:3.0:1788271993.989900:0:17212:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788271993.989929:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21c00/0x99288105fd390023 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.989943:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21c00/0x99288105fd390023 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.989953:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21c00/0x99288105fd390023 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788271993.990103:0:17212:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006cce58dd reply state 0000000028c31976 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21c00/0x99288105fd390023 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.990117:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21c00/0x99288105fd390023 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271993.990122:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f6d8305ad00) 00010000:00010000:3.0:1788271993.990124:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788271993.990126:0:17212:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788271993.990210:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f7552d3-578c-40be-b601-54fb5b48de11+16:15663:x1875138577570432:12345-192.168.201.3@tcp:36:lhsmtool_posix.0 Request processed in 414us (554us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1788271993.990215:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 62 00000100:00100000:0.0:1788271993.992945:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271993.995766:0:19409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577570560 00000100:00100000:1.0:1788271993.995780:0:19409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577570560 00000100:00100000:1.0:1788271993.995886:0:19409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 24 00000100:00100000:1.0:1788271993.995898:0:19409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6e880fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8f7552d3-578c-40be-b601-54fb5b48de11+7:2397:x1875138577570560:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788271993.996057:0:19409:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788271993.996061:0:19409:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788271992 00002000:00010000:1.0:1788271993.996078:0:19409:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788271992 00002000:00010000:1.0:1788271993.996081:0:19409:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788271993 -> 1788271992 00002000:00010000:1.0:1788271993.996083:0:19409:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788271993.996162:0:19409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6e880fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8f7552d3-578c-40be-b601-54fb5b48de11+8:2397:x1875138577570560:12345-192.168.201.3@tcp:2:lhsmtool_posix.0 Request processed in 266us (3224us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788271993.996170:0:19409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 24 00000100:00100000:3.0:1788271993.999891:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271994.002647:0:19862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577570688 00000100:00100000:0.0:1788271994.002662:0:19862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577570688 00000100:00100000:0.0:1788271994.002731:0:19862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 25 00000100:00100000:0.0:1788271994.002742:0:19862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8f7552d3-578c-40be-b601-54fb5b48de11+8:2396:x1875138577570688:12345-192.168.201.3@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788271994.002788:0:19862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f8400575/0x99288105fd39002a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271994.002805:0:19862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271994.002810:0:19862:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788271994.002817:0:19862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8400575/0x99288105fd39002a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271994.002831:0:19862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8400575/0x99288105fd39002a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271994.002857:0:19862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f8400575/0x99288105fd39002a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271994.002866:0:19862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8400575/0x99288105fd39002a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271994.002893:0:19862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8400575/0x99288105fd39002a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271994.002901:0:19862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511c800 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:0.0:1788271994.002906:0:19862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8400575/0x99288105fd39002a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271994.002915:0:19862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8400575/0x99288105fd39002a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271994.002930:0:19862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8400575/0x99288105fd39002a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271994.002938:0:19862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8400575/0x99288105fd39002a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271994.003023:0:19862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8f7552d3-578c-40be-b601-54fb5b48de11+8:2396:x1875138577570688:12345-192.168.201.3@tcp:1:lhsmtool_posix.0 Request processed in 282us (3140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271994.003031:0:19862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 25 00000100:00100000:3.0:1788271994.005409:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271994.005520:0:20353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577570944 00000100:00100000:0.0:1788271994.005529:0:20353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577570944 00000100:00100000:0.0:1788271994.005615:0:20353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 63 00000100:00100000:0.0:1788271994.005645:0:20353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f7552d3-578c-40be-b601-54fb5b48de11+16:15663:x1875138577570944:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788271994.005721:0:20353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd390031 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271994.005751:0:20353:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5800/0x99288105fd38ff82 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd93e expref: 16 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271994.005761:0:20353:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd390031 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271994.005797:0:20353:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5800/0x99288105fd38ff82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd93e expref: 16 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271994.005811:0:20353:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5800/0x99288105fd38ff82 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd93e expref: 16 pid: 17211 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271994.005830:0:20353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f6c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20353:1875138590221952:192.168.201.3@tcp:104: 00000100:00100000:0.0:1788271994.005979:0:20353:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830e66c0 going to sleep for 11 seconds 00000100:00080000:3.0:1788271994.006358:0:17207:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788271994.007526:0:20353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f6c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20353:1875138590221952:192.168.201.3@tcp:104: 00010000:00010000:0.0:1788271994.007555:0:20353:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd390031 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271994.008788:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271994.008821:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577571072 00000100:00100000:3.0:1788271994.008829:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577571072 00010000:00010000:3.0:1788271994.008867:0:17198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5800/0x99288105fd38ff82 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd93e expref: 17 pid: 17211 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271994.008903:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 19 00000100:00100000:3.0:1788271994.008912:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8f7552d3-578c-40be-b601-54fb5b48de11+17:2397:x1875138577571072:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788271994.008928:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271994.008934:0:17198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5800/0x99288105fd38ff82 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd93e expref: 17 pid: 17211 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271994.008993:0:17198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5800/0x99288105fd38ff82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd93e expref: 17 pid: 17211 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271994.009352:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de5800/0x99288105fd38ff82 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd93e expref: 17 pid: 17211 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271994.009373:0:17198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f6e920a2500) 00010000:00010000:3.0:1788271994.009379:0:17198:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21800/0x99288105fd38ff9e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd94c expref: 16 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271994.009388:0:17198:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd390031 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271994.009395:0:17198:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd390031 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271994.009401:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd390031 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271994.009431:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788271994.009473:0:20353:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd390031 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271994.009482:0:20353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd390031 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271994.009489:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f6c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8f7552d3-578c-40be-b601-54fb5b48de11+16:2397:x1875138577571072:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 578us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271994.009496:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 19 00010000:00010000:0.0:1788271994.009703:0:20353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd390038 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271994.009725:0:20353:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21a00/0x99288105fd390007 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd968 expref: 16 pid: 20353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271994.009731:0:20353:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd390038 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271994.009753:0:20353:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21a00/0x99288105fd390007 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd968 expref: 16 pid: 20353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271994.009773:0:20353:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21a00/0x99288105fd390007 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd968 expref: 16 pid: 20353 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271994.009784:0:20353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f6d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20353:1875138590222080:192.168.201.3@tcp:104: 00000100:00100000:0.0:1788271994.009851:0:20353:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6d830e6000 going to sleep for 11 seconds 00000100:00100000:2.0:1788271994.013261:0:20353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f6d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20353:1875138590222080:192.168.201.3@tcp:104: 00010000:00010000:2.0:1788271994.013291:0:20353:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd390038 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271994.013867:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271994.014016:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577571200 00000100:00100000:0.0:1788271994.014024:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577571200 00010000:00010000:0.0:1788271994.014060:0:17196:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21a00/0x99288105fd390007 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd968 expref: 17 pid: 20353 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788271994.014101:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 20 00000100:00100000:0.0:1788271994.014110:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d831f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8f7552d3-578c-40be-b601-54fb5b48de11+17:2398:x1875138577571200:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788271994.014125:0:17196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788271994.014132:0:17196:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21a00/0x99288105fd390007 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd968 expref: 17 pid: 20353 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271994.014145:0:17196:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21a00/0x99288105fd390007 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd968 expref: 17 pid: 20353 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271994.014175:0:17196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21a00/0x99288105fd390007 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd968 expref: 17 pid: 20353 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271994.014191:0:17196:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f6d8305ad00) 00010000:00010000:0.0:1788271994.014196:0:17196:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd390038 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271994.014206:0:17196:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd390038 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271994.014213:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd390038 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271994.014240:0:17196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788271994.014298:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d831f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8f7552d3-578c-40be-b601-54fb5b48de11+16:2398:x1875138577571200:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 189us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271994.014306:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 20 00010000:00010000:2.0:1788271994.014371:0:20353:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd390038 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271994.014379:0:20353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd390038 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788271994.014489:0:20353:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1788271994.014668:0:20353:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1788271994.014709:0:20353:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1788271994.014858:0:20353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfc74a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:20353:1875138590222208:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788271994.014916:0:20353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271994.014938:0:20353:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4ed3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788271994.015042:0:17953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590222208 00000100:00100000:0.0:1788271994.015047:0:17953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590222208 00000100:00100000:0.0:1788271994.015088:0:17953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788271994.015096:0:17953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:20353:x1875138590222208:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788271994.015871:0:17953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:20353:x1875138590222208:12345-0@lo:1000:mdt00_003.0 Request processed in 772us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271994.015880:0:17953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788271994.015936:0:20353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfc74a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:20353:1875138590222208:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788271994.016091:0:20353:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1788271994.016144:0:20353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6ebfc74a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:20353:1875138590222336:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788271994.016180:0:20353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788271994.016240:0:20353:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4ed3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788271994.016286:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138590222336 00000100:00100000:0.0:1788271994.016292:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138590222336 00000100:00100000:0.0:1788271994.016367:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788271994.016375:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6ebfc76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:20353:x1875138590222336:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788271994.016500:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6ebfc76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:20353:x1875138590222336:12345-0@lo:1000:mdt00_003.0 Request processed in 125us (319us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1788271994.016506:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788271994.016606:0:20353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6ebfc74a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:20353:1875138590222336:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788271994.016665:0:20353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd390038 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271994.016675:0:20353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd390038 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271994.016682:0:20353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd390038 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271994.016688:0:20353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d830c4000 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271994.016699:0:20353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd390038 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271994.016707:0:20353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd390038 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271994.016721:0:20353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f6d8305ad00) 00010000:00010000:2.0:1788271994.016724:0:20353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788271994.016728:0:20353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd390038 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271994.016735:0:20353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4000/0x99288105fd390038 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271994.016830:0:20353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ff97 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271994.016837:0:20353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ff97 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271994.016843:0:20353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ff97 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271994.016848:0:20353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e20a00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271994.016850:0:20353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ff97 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271994.016856:0:20353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ff97 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271994.016864:0:20353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f6e920a2500) 00010000:00010000:2.0:1788271994.016867:0:20353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788271994.016878:0:20353:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21800/0x99288105fd38ff9e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd94c expref: 19 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271994.016888:0:20353:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21800/0x99288105fd38ff9e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd94c expref: 19 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271994.016896:0:20353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21800/0x99288105fd38ff9e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd94c expref: 19 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271994.016941:0:20353:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21800/0x99288105fd38ff9e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd94c expref: 19 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271994.016951:0:20353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d83252a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20353:1875138590222464:192.168.201.3@tcp:105: 00000100:00100000:2.0:1788271994.017008:0:20353:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6eb4ed3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788271994.021473:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271994.021572:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577571328 00000100:00100000:3.0:1788271994.021584:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577571328 00000100:00100000:3.0:1788271994.021677:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 10 00000100:00100000:3.0:1788271994.021687:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83184850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8f7552d3-578c-40be-b601-54fb5b48de11+20:15662:x1875138577571328:12345-192.168.201.3@tcp:49:dd.0 00000100:00100000:3.0:1788271994.021810:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83184850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8f7552d3-578c-40be-b601-54fb5b48de11+20:15662:x1875138577571328:12345-192.168.201.3@tcp:49:dd.0 Request processed in 125us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271994.021818:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 10 00000100:00100000:2.0:1788271994.022361:0:20353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d83252a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20353:1875138590222464:192.168.201.3@tcp:105: 00010000:00010000:2.0:1788271994.022387:0:20353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ff97 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271994.022398:0:20353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e20a00/0x99288105fd38ff97 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271994.022430:0:20353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4400/0x99288105fd39003f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271994.022444:0:20353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4400/0x99288105fd39003f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271994.022455:0:20353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4400/0x99288105fd39003f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271994.022477:0:20353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4400/0x99288105fd39003f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271994.022484:0:20353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4400/0x99288105fd39003f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271994.022490:0:20353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4400/0x99288105fd39003f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271994.022495:0:20353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6d81de4400 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271994.022510:0:20353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4400/0x99288105fd39003f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271994.022518:0:20353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4400/0x99288105fd39003f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271994.022530:0:20353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f6e920a2500) 00010000:00010000:2.0:1788271994.022534:0:20353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788271994.022537:0:20353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4400/0x99288105fd39003f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271994.022542:0:20353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d81de4400/0x99288105fd39003f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271994.022552:0:20353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd390031 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271994.022557:0:20353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd390031 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271994.022563:0:20353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd390031 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271994.022574:0:20353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6e8511dc00 already unused, calling callback (ffffffffc174a4f0) 00010000:00010000:2.0:1788271994.022577:0:20353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd390031 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271994.022583:0:20353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd390031 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271994.022592:0:20353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f6e920a2500) 00010000:00010000:2.0:1788271994.022594:0:20353:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788271994.022597:0:20353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd390031 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788271994.022602:0:20353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6e8511dc00/0x99288105fd390031 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20353 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271994.022899:0:20353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f7552d3-578c-40be-b601-54fb5b48de11+19:15663:x1875138577570944:12345-192.168.201.3@tcp:57:lhsmtool_posix.0 Request processed in 17255us (17499us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788271994.022910:0:20353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 63 00000020:00080000:2.0:1788271994.022914:0:20353:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788271994.023248:0:17247:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788271994.023263:0:17247:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788271994.023283:0:17247:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788271994.023291:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788271994.027335:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271994.027382:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:0.0:1788271994.027474:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577571712 00000100:00100000:0.0:1788271994.027485:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577571712 00000100:00100000:0.0:1788271994.027558:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 64 00000100:00100000:0.0:1788271994.027569:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d831f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f7552d3-578c-40be-b601-54fb5b48de11+19:15662:x1875138577571712:12345-192.168.201.3@tcp:101:dd.0 00010000:00010000:0.0:1788271994.027593:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788271994.027614:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5c00/0x99288105fd390046 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x24a403972fcfd97d expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271994.027683:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd39004d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271994.027697:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd39004d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271994.027709:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd39004d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271994.027828:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c5c00/0x99288105fd390046 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd97d expref: 21 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271994.027846:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6d830c4200/0x99288105fd39004d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd97d expref: 20 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271994.027866:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f6e920a2500) 00010000:00010000:0.0:1788271994.027869:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788271994.027873:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f6d830c4200, rc 0) 00000100:00100000:0.0:1788271994.027931:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d831f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f7552d3-578c-40be-b601-54fb5b48de11+20:15662:x1875138577571712:12345-192.168.201.3@tcp:101:dd.0 Request processed in 365us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788271994.027938:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 64 00000100:00100000:3.0:1788271994.028176:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577571584 00000100:00100000:3.0:1788271994.028181:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577571584 00000100:00100000:3.0:1788271994.028211:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 11 00000100:00100000:3.0:1788271994.028218:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d831f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8f7552d3-578c-40be-b601-54fb5b48de11+20:15663:x1875138577571584:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788271994.028443:0:17215:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788271994.028475:0:17215:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1788271994.028502:0:17215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21400/0x99288105fd390054 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271994.028511:0:17215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21400/0x99288105fd390054 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271994.028520:0:17215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21400/0x99288105fd390054 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271994.028527:0:17215:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21400/0x99288105fd390054 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271994.028532:0:17215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21400/0x99288105fd390054 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271994.028537:0:17215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21400/0x99288105fd390054 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271994.028564:0:17215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788271994.028640:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d831f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8f7552d3-578c-40be-b601-54fb5b48de11+22:15663:x1875138577571584:12345-192.168.201.3@tcp:35:lhsmtool_posix.0 Request processed in 399us (1293us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1788271994.028648:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 11 00000020:00080000:3.0:1788271994.028652:0:17215:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788271994.028799:0:17199:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788271994.028806:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21400/0x99288105fd390054 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271994.028813:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e21400 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:1.0:1788271994.028817:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21400/0x99288105fd390054 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271994.028824:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21400/0x99288105fd390054 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271994.028834:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f6d8305ad00) 00010000:00010000:1.0:1788271994.028837:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788271994.028841:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21400/0x99288105fd390054 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271994.028846:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f6eb4e21400/0x99288105fd390054 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271994.028855:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271994.028864:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788271994.028866:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788271994.215890:0:3599:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271994.215991:0:18725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577571840 00000100:00100000:3.0:1788271994.216002:0:18725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577571840 00000100:00100000:3.0:1788271994.216101:0:18725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 0 00000100:00100000:3.0:1788271994.216111:0:18725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d831f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8f7552d3-578c-40be-b601-54fb5b48de11+8:2396:x1875138577571840:12345-192.168.201.3@tcp:4:dd.0 00010000:00010000:3.0:1788271994.216147:0:18725:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001751c298/0x99288105fd39005b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271994.216168:0:18725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000067bf92a6/0x99288105fd39001c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd976 expref: 8 pid: 18721 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271994.216177:0:18725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271994.216182:0:18725:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271994.216187:0:18725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001751c298/0x99288105fd39005b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271994.216220:0:18725:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000067bf92a6/0x99288105fd39001c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd976 expref: 8 pid: 18721 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271994.216235:0:18725:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000067bf92a6/0x99288105fd39001c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd976 expref: 8 pid: 18721 timeout: 655 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271994.216274:0:18725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8f6d81f41f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:18725:1875138590222592:192.168.201.3@tcp:104: 00000100:00100000:3.0:1788271994.216358:0:18725:0:(client.c:2715:ptlrpc_set_wait()) set ffff8f6ebc98d600 going to sleep for 11 seconds 00000100:00100000:3.0:1788271994.222497:0:3600:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:1.0:1788271994.222881:0:18727:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788271994.222892:0:18727:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1788271994.223146:0:18727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577571968 00000100:00100000:1.0:1788271994.223156:0:18727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577571968 00000100:00100000:3.0:1788271994.223754:0:20355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 1 00000100:00100000:3.0:1788271994.223947:0:20355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d81f43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8f7552d3-578c-40be-b601-54fb5b48de11+9:2395:x1875138577571968:12345-192.168.201.3@tcp:4:dd.0 00010000:00010000:3.0:1788271994.223983:0:20355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a0e132a/0x99288105fd390062 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271994.224009:0:20355:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271994.224014:0:20355:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271994.224019:0:20355:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a0e132a/0x99288105fd390062 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271994.224029:0:20355:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004a0e132a/0x99288105fd390062 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271994.231320:0:18725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8f6d81f41f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:18725:1875138590222592:192.168.201.3@tcp:104: 00010000:00010000:3.0:1788271994.231353:0:18725:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001751c298/0x99288105fd39005b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788271994.234488:0:3601:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.3@tcp (source: 12345-192.168.201.3@tcp) 00000100:00100000:3.0:1788271994.234569:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875138577572096 00000100:00100000:3.0:1788271994.234578:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875138577572096 00010000:00010000:3.0:1788271994.234649:0:17198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000067bf92a6/0x99288105fd39001c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd976 expref: 10 pid: 18721 timeout: 655 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271994.234690:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.3@tcp, seq: 21 00000100:00100000:3.0:1788271994.234700:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f6d83252a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8f7552d3-578c-40be-b601-54fb5b48de11+10:2397:x1875138577572096:12345-192.168.201.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788271994.234714:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788271994.234733:0:17198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000067bf92a6/0x99288105fd39001c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd976 expref: 10 pid: 18721 timeout: 655 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271994.234747:0:17198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000067bf92a6/0x99288105fd39001c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd976 expref: 10 pid: 18721 timeout: 655 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271994.234780:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067bf92a6/0x99288105fd39001c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.3@tcp remote: 0x24a403972fcfd976 expref: 10 pid: 18721 timeout: 655 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271994.234796:0:17198:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271994.234800:0:17198:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271994.234805:0:17198:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001751c298/0x99288105fd39005b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271994.234814:0:17198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001751c298/0x99288105fd39005b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271994.234822:0:17198:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271994.234824:0:17198:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788271994.234828:0:17198:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004a0e132a/0x99288105fd390062 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271994.234834:0:17198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a0e132a/0x99288105fd390062 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271994.234869:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788271994.234916:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d83252a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8f7552d3-578c-40be-b601-54fb5b48de11+9:2397:x1875138577572096:12345-192.168.201.3@tcp:103:ldlm_bl.0 Request processed in 218us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788271994.234923:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 21 00010000:00010000:1.0:1788271994.235071:0:18725:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001751c298/0x99288105fd39005b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271994.235078:0:18725:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001751c298/0x99288105fd39005b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271994.236399:0:20355:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004a0e132a/0x99288105fd390062 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788271994.236414:0:20355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a0e132a/0x99288105fd390062 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788271994.338944:0:19535:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:0.0:1788271994.338960:0:19535:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:1.0:1788271994.345133:0:18725:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1788271994.345143:0:18725:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1788271992 -> 1788271993 00002000:00010000:1.0:1788271994.345146:0:18725:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788271992 -> 1788271993 00002000:00010000:1.0:1788271994.345149:0:18725:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:1.0:1788271994.345166:0:18725:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001751c298/0x99288105fd39005b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271994.345179:0:18725:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001751c298/0x99288105fd39005b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271994.345189:0:18725:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001751c298/0x99288105fd39005b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271994.345196:0:18725:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e20e00 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:1.0:1788271994.345201:0:18725:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001751c298/0x99288105fd39005b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271994.345223:0:18725:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001751c298/0x99288105fd39005b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271994.345243:0:18725:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001751c298/0x99288105fd39005b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788271994.345263:0:18725:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001751c298/0x99288105fd39005b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788271994.345432:0:18725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d831f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8f7552d3-578c-40be-b601-54fb5b48de11+7:2396:x1875138577571840:12345-192.168.201.3@tcp:4:dd.0 Request processed in 129318us (129546us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788271994.345442:0:18725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 0 00000001:00080000:1.0:1788271994.386097:0:19535:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:3.0:1788271994.386916:0:20355:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:3.0:1788271994.386923:0:20355:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:3.0:1788271994.386939:0:20355:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a0e132a/0x99288105fd390062 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271994.386962:0:20355:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a0e132a/0x99288105fd390062 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271994.386973:0:20355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a0e132a/0x99288105fd390062 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271994.386980:0:20355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f6eb4e20800 already unused, calling callback (ffffffffc0b52230) 00010000:00010000:3.0:1788271994.386985:0:20355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a0e132a/0x99288105fd390062 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271994.386995:0:20355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a0e132a/0x99288105fd390062 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271994.387015:0:20355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a0e132a/0x99288105fd390062 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788271994.387023:0:20355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a0e132a/0x99288105fd390062 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788271994.387182:0:20355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f6d81f43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8f7552d3-578c-40be-b601-54fb5b48de11+5:2395:x1875138577571968:12345-192.168.201.3@tcp:4:dd.0 Request processed in 163236us (164689us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788271994.387193:0:20355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.3@tcp, seq: 1 00010000:00010000:2.0:1788271994.461795:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788271995.038055:0:17247:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788271995.038604:0:17247:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788271995.038818:0:17247:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788271995.038829:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788271995.486881:0:19859:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788271995.550792:0:20392:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1788271996.509917:0:17199:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 41831 lines, 41831 kept, 0 dropped, 0 bad.